Module
lexie/token
src/lexie/token.pookaThe cast list: everyone who will appear in the generated Token family.
Every class the generated Token family will have, worked out from a
specification. Shared by the generators and the checks.
API reference
- classKind
- classKeyword
- classLiteral
- classOperator
- classPunctuation
- classIdentKind
- classIntKind
- classFloatKind
- classStringKind
- classCharKind
- classCommentKind
- classDocCommentKind
- classModuleCommentKind
- classBlockCommentKind
- classWhitespaceKind
- classErrorKind
- classEndKind
- classTokenDef
- functionfixed_name
- functionword_name
- functionsymbol_name
- functiondefinitions
- functiondescribe
- functionfixed_text
class Kind
Where a token class comes from.
class Keyword(text: String) is Kind
text: String
INFERRED
String
INFERRED
fn(String) -> lexie/token.Keywordclass Literal(text: String) is Kind
text: String
INFERRED
String
INFERRED
fn(String) -> lexie/token.Literalclass Operator(text: String) is Kind
text: String
INFERRED
String
INFERRED
fn(String) -> lexie/token.Operatorclass Punctuation(text: String) is Kind
text: String
INFERRED
String
INFERRED
fn(String) -> lexie/token.Punctuationclass IdentKind is Kind
class IntKind is Kind
class FloatKind is Kind
class StringKind is Kind
class CharKind is Kind
class CommentKind is Kind
class DocCommentKind is Kind
class ModuleCommentKind is Kind
class BlockCommentKind is Kind
class WhitespaceKind is Kind
class ErrorKind is Kind
class EndKind is Kind
class TokenDef(name: String, payload: Bool, kind: Kind)
One token class: its name, whether it carries text, and its kind.
name: String
INFERRED
Stringpayload: Bool
INFERRED
Boolkind: Kind
INFERRED
lexie/token.Kind
INFERRED
fn(String, Bool, lexie/token.Kind) -> lexie/token.TokenDeffixed_name(config: Config, text: String, section: String) -> String
INFERRED
fn(lexie/config.Config, String, String) -> StringThe class name for a fixed token in a section such as Keyword. Falls
back to Invalid; the checks report that before anything is generated.
word_name(config: Config, text: String) -> String
INFERRED
fn(lexie/config.Config, String) -> StringThe class for a keyword or literal, by its text.
symbol_name(config: Config, text: String) -> String
INFERRED
fn(lexie/config.Config, String) -> StringThe class for an operator or punctuation, by its text.
definitions(config: Config) -> List(TokenDef)
INFERRED
fn(lexie/config.Config) -> List(lexie/token.TokenDef)Every class of the generated family, in declaration order.
import lexie/config
import lexie/token
let definitions = token.definitions(config.default_config())
// Ident, numeric and error/end definitions follow the fixed tokens.
describe(kind: Kind) -> String
INFERRED
fn(lexie/token.Kind) -> StringWhere a token class came from, for messages.
fixed_text(kind: Kind) -> Option(String)
INFERRED
fn(lexie/token.Kind) -> Option(String)The fixed text of a keyword, literal, operator or punctuation.