AZ logo

Package tokenizer:
A tokenizer.

A tokenizer for LaTeX. \GetTokens{Target1}{Target2}{Source} Splits Source into two tokens at the first encounter of a comma. The first token is saved in a newly created command with the name passed as Target1 and the second token likewise. A package option 'trim' causes leading and trailing space to be removed from each token; with this option, the \TrimSpaces command is defined, which removes leading and trailing spaces from its argument.

Getting it

If possible, get this package from your distribution using its installation manager. (For installation help, click on your distribution's name.)

Distribution Package name
MiKTeX tokenizer
TeX Live tokenizer

You can also visit tokenizer's CTAN directory to browse the source or download the material for installation by hand.

More

Documentation on CTAN
tokenizer.pdf
Documentation off CTAN -none known-
Maintainers
Sascha Herpers
Version 1.1.0
License LaTeX Project Public License
Related packages
csvtools:
Reading data from CSV files.
Keywords
macro programming
Characterizations
primary:
Programming in TeX > Other

You can suggest changes to the keywords and characterizations and the maintainer information.

You can get information about any package.