TOK_ERR is returned by the lexer whenever a character is encountered
which cannot be lexed.
| lexspec) |
lexspec argument is passed in from a generated table module.
It should be a tuple made up of a DFA table, a list of start states,
a list of actions for each accepting state, a list of actions to
be performed at the end of file and a dictionary of character classes.
The format of the lexspec argument is subject to change.
The lexer class provides lexing from input strings or from files. The class can be subclassed to provide lexers with different input behaviors.
value member holds the value associated with the most
recently returned token.
| str) |
str argument.
| fname) |
stdin.
| ) |
None is returned. If an error occurs
the value pyggy.lexer.TOK_EOF is returned. In the future an
exception may be raised in this situation. Before a token is returned,
the value member is set to the value specified in the action
code for the token, or to a string of the characters in the token.
See the PyGgy Home Page.