Command line

scilex --list                      the built-in example grammars
scilex --example <lang> [file|-]   lex with a built-in grammar (its bundled sample without a file)
scilex <grammar.lex> [file|-]      lex with your grammar (standard input without a file)
scilex --check                     run every built-in grammar's self-check
scilex --version                   SciLex's version and the REAL it was built with

option	effect
--layout	add NEWLINE / INDENT / DEDENT
--errors=token	turn unlexable runs into ERROR tokens instead of stopping
--columns=codepoints, --columns=utf16	count columns in that unit (default: bytes)

Output is one token per line: the kind’s name, a tab, the lexeme, a tab, line:column. The lexeme is escaped so that each line is one token: a backslash, a tab, a line feed and a carriage return are written \\, \t, \n, \r, any other control byte \xHH; every other byte, UTF-8 included, as it is.

--example python measures indentation as CPython does: a tab advances to the next multiple of 8, and a line whose tabs and spaces make its level ambiguous is refused. A malformed grammar is reported as file:line:column: cause, a lexical error as lex error at line:column: cause and an indentation error as layout error at line:column: cause, all on standard error with a non-zero exit status. The grammar format is in The .lex grammar format.