What are tokens?

What should delimit the tokens?