* * HELP & MANUAL PREMIUM PACK 4 DEMO VERSION * *
This documentation was styled with a demo skin from the Premium Pack 4 add-on for Help & Manual. The contents of the skin are encrypted and not configurable. You can only publish HM projects with this skin. You cannot edit it or change it.
This version is copyright and may only be used for local testing purposes. It may not be distributed.
Please purchase the full version of the Premium Pack to get the configurable skins and remove this notice. The package will also include the Toolbox configuration utility for Premium Pack skins.
Equates for Tokenizer module.
Symbol |
Meaning |
%TOKENIZER_FINISHED |
The returned token is end of buffer |
%TOKENIZER_ERROR |
There was an error in parsing next token |
%TOKENIZER_UNDEFTOK |
The next token is undefined |
%TOKENIZER_EOL |
The next token is end of line |
%TOKENIZER_DELIMITER |
The next token is a delimiter |
%TOKENIZER_NUMBER |
The next token is a number |
%TOKENIZER_STRING |
The next token is a string |
%TOKENIZER_QUOTE |
The next token is a quoted string |
The following equates are mainly used by the following functions:
Symbol |
Meaning |
%TOKENIZER_DEFAULT_NewLine |
Identify chars belonging to NewLine group |
%TOKENIZER_DEFAULT_Space |
Identify chars belonging to Space group |
%TOKENIZER_DEFAULT_DQuote |
Identify chars belonging to Double Quote group |
%TOKENIZER_DEFAULT_Delim |
Identify chars belonging to Delimiters group |
%TOKENIZER_DEFAULT_Numeric |
Identify chars belonging to Numeric group |
%TOKENIZER_DEFAULT_Alpha |
Identify chars belonging to Alphabetic group |
