The type of tokens produced by the language lexer.

The type of top-level directives recognised by the parser.

The Lexer module for the language.

The Parser module for the language.

Helper function to find a file using a language specification. Separates directory and file because most include directives in languages are relative to the directory of the original file being processed.

Parse the given file.

• parameter dir:

  optional directory to use if the file path is relative.

Incremental parsing. Given an input to read (either a file, or stdin), returns a generator that will incrementally parse the statements, together with a cleanup function to close file descriptors. In case of a syntax error, the current line will be completely consumed and parsing will restart at the beginning of the next line. Useful to process input from stdin, or even large files where it would be impractical to parse the entire file before processing it.