scilex::token Struct Reference

One lexical token: a typed slice of the source. More...

#include <token.hpp>

Collaboration diagram for scilex::token:

Public Attributes
int	kind
	Caller-defined token kind (e.g. an enum value).
std::string_view	lexeme
	The matched text, viewing into the source.
position	start
	Position of the token's first byte.
std::size_t	mode_id {0}
	The mode this token was lexed in (0 = the default/root mode).

Detailed Description

One lexical token: a typed slice of the source.

Member Data Documentation

kind

int scilex::token::kind

Caller-defined token kind (e.g. an enum value).

lexeme

std::string_view scilex::token::lexeme

The matched text, viewing into the source.

mode_id

std::size_t scilex::token::mode_id {0}

The mode this token was lexed in (0 = the default/root mode).

start

position scilex::token::start

Position of the token's first byte.

---

The documentation for this struct was generated from the following file:

• include/scilex/token.hpp