Class LexerATNFactory

java.lang.Object

org.antlr.v4.automata.ParserATNFactory

org.antlr.v4.automata.LexerATNFactory

All Implemented Interfaces:

ATNFactory

public class LexerATNFactory
extends ParserATNFactory

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	LexerATNFactory.CharSetParseState

Nested classes/interfaces inherited from interface ATNFactory

ATNFactory.Handle

Field Summary

Fields

Modifier and Type	Field	Description
protected Map<LexerAction, Integer>	actionToIndexMap	Maps from a LexerAction object to the action index.
org.stringtemplate.v4.STGroup	codegenTemplates
static final Map<String,Integer>	COMMON_CONSTANTS	Provides a map of names of predefined constants which are likely to appear as the argument for lexer commands.
protected Map<Integer, LexerAction>	indexToActionMap	Maps from an action index to a LexerAction object.
private final List<String>	ruleCommands

Fields inherited from class ParserATNFactory

atn, currentOuterAlt, currentRule, g, preventEpsilonClosureBlocks, preventEpsilonOptionalBlocks

Constructor Summary

Constructors

Constructor	Description
LexerATNFactory(LexerGrammar g)
LexerATNFactory(LexerGrammar g, CodeGenerator codeGenerator)

Method Summary

Modifier and Type	Method	Description
ATNFactory.Handle	action(String action)
ATNFactory.Handle	action(ActionAST action)	Build what amounts to an epsilon transition with an action.
protected ATNFactory.Handle	action(GrammarAST node, LexerAction lexerAction)
private void	applyPrevState(GrammarAST charSetAST, IntervalSet set, LexerATNFactory.CharSetParseState state)
private LexerATNFactory.CharSetParseState	applyPrevStateAndMoveToCodePoint(GrammarAST charSetAST, IntervalSet set, LexerATNFactory.CharSetParseState state, int codePoint)
private LexerATNFactory.CharSetParseState	applyPrevStateAndMoveToProperty(GrammarAST charSetAST, IntervalSet set, LexerATNFactory.CharSetParseState state, IntervalSet property)
ATNFactory.Handle	charSetLiteral(GrammarAST charSetAST)	[Aa\t ሴa-z\]\p{Letter}\-] char sets
private void	checkCharAndAddToSet(GrammarAST ast, IntervalSet set, int c)
private void	checkCommands(String command, org.antlr.runtime.Token commandToken)
protected boolean	checkRange(GrammarAST leftNode, GrammarAST rightNode, int leftValue, int rightValue)
private void	checkRangeAndAddToSet(GrammarAST mainAst, IntervalSet set, int a, int b)
private CharactersDataCheckStatus	checkRangeAndAddToSet(GrammarAST rootAst, GrammarAST ast, IntervalSet set, int a, int b, boolean caseInsensitive, CharactersDataCheckStatus previousStatus)
ATN	createATN()
private LexerAction	createLexerAction(GrammarAST ID, GrammarAST arg)
private Transition	createTransition(ATNState target, int from, int to, org.antlr.runtime.tree.CommonTree tree)
private Integer	getChannelConstantValue(String channelName, org.antlr.runtime.Token token)
static Set<String>	getCommonConstants()
protected int	getLexerActionIndex(LexerAction lexerAction)
private Integer	getModeConstantValue(String modeName, org.antlr.runtime.Token token)
IntervalSet	getSetFromCharSetLiteral(GrammarAST charSetAST)
private Integer	getTokenConstantValue(String tokenName, org.antlr.runtime.Token token)
ATNFactory.Handle	lexerAltCommands(ATNFactory.Handle alt, ATNFactory.Handle cmds)
ATNFactory.Handle	lexerCallCommand(GrammarAST ID, GrammarAST arg)
private ATNFactory.Handle	lexerCallCommandOrCommand(GrammarAST ID, GrammarAST arg)
ATNFactory.Handle	lexerCommand(GrammarAST ID)
ATNFactory.Handle	range(GrammarAST a, GrammarAST b)	Not valid for non-lexers.
ATNFactory.Handle	rule(GrammarAST ruleAST, String name, ATNFactory.Handle blk)
ATNFactory.Handle	set(GrammarAST associatedAST, List<GrammarAST> alts, boolean invert)	From set build single edge graph o->o-set->o.
ATNFactory.Handle	stringLiteral(TerminalAST stringLiteralAST)	For a lexer, a string is a sequence of char to match.
ATNFactory.Handle	tokenRef(TerminalAST node)	From label A build graph o-A->o.

Methods inherited from class ParserATNFactory

_createATN, _ruleRef, addEOFTransitionToStartRules, addFollowLink, addRuleFollowLinks, alt, block, blockHasWildcardAlt, checkEpsilonClosure, createRuleStartAndStopATNStates, elemList, epsilon, epsilon, epsilon, expectNonGreedy, getTokenType, label, listLabel, makeBlock, newState, newState, newState, optional, plus, ruleRef, sempred, setCurrentOuterAlt, setCurrentRuleName, star, wildcard

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

codegenTemplates

public org.stringtemplate.v4.STGroup codegenTemplates

COMMON_CONSTANTS

public static final Map<String,Integer> COMMON_CONSTANTS

Provides a map of names of predefined constants which are likely to appear as the argument for lexer commands. These names would be resolved by the Java compiler for lexer commands that are translated to embedded actions, but are required during code generation for creating LexerAction instances that are usable by a lexer interpreter.

ruleCommands

private final List<String> ruleCommands

indexToActionMap

protected Map<Integer, LexerAction> indexToActionMap

Maps from an action index to a LexerAction object.

actionToIndexMap

protected Map<LexerAction, Integer> actionToIndexMap

Maps from a LexerAction object to the action index.

Constructor Details

LexerATNFactory

public LexerATNFactory(LexerGrammar g)

LexerATNFactory

public LexerATNFactory(LexerGrammar g,
 CodeGenerator codeGenerator)

Method Details

getCommonConstants

public static Set<String> getCommonConstants()

createATN

public ATN createATN()

Specified by:

createATN in interface ATNFactory

Overrides:

createATN in class ParserATNFactory

rule

public ATNFactory.Handle rule(GrammarAST ruleAST,
 String name,
 ATNFactory.Handle blk)

Specified by:

rule in interface ATNFactory

Overrides:

rule in class ParserATNFactory

action

public ATNFactory.Handle action(ActionAST action)

Description copied from class: ParserATNFactory

Build what amounts to an epsilon transition with an action. The action goes into ATN though it is ignored during prediction if actionIndex<0.

Specified by:

action in interface ATNFactory

Overrides:

action in class ParserATNFactory

getLexerActionIndex

protected int getLexerActionIndex(LexerAction lexerAction)

action

public ATNFactory.Handle action(String action)

Specified by:

action in interface ATNFactory

Overrides:

action in class ParserATNFactory

action

protected ATNFactory.Handle action(GrammarAST node,
 LexerAction lexerAction)

lexerAltCommands

public ATNFactory.Handle lexerAltCommands(ATNFactory.Handle alt,
 ATNFactory.Handle cmds)

Specified by:

lexerAltCommands in interface ATNFactory

Overrides:

lexerAltCommands in class ParserATNFactory

lexerCallCommand

public ATNFactory.Handle lexerCallCommand(GrammarAST ID,
 GrammarAST arg)

Specified by:

lexerCallCommand in interface ATNFactory

Overrides:

lexerCallCommand in class ParserATNFactory

lexerCommand

public ATNFactory.Handle lexerCommand(GrammarAST ID)

Specified by:

lexerCommand in interface ATNFactory

Overrides:

lexerCommand in class ParserATNFactory

lexerCallCommandOrCommand

private ATNFactory.Handle lexerCallCommandOrCommand(GrammarAST ID,
 GrammarAST arg)

range

public ATNFactory.Handle range(GrammarAST a,
 GrammarAST b)

Description copied from class: ParserATNFactory

Not valid for non-lexers.

Specified by:

range in interface ATNFactory

Overrides:

range in class ParserATNFactory

set

public ATNFactory.Handle set(GrammarAST associatedAST,
 List<GrammarAST> alts,
 boolean invert)

Description copied from class: ParserATNFactory

From set build single edge graph o->o-set->o. To conform to what an alt block looks like, must have extra state on left. This also handles ~A, converted to ~{A} set.

Specified by:

set in interface ATNFactory

Overrides:

set in class ParserATNFactory

checkRange

protected boolean checkRange(GrammarAST leftNode,
 GrammarAST rightNode,
 int leftValue,
 int rightValue)

stringLiteral

public ATNFactory.Handle stringLiteral(TerminalAST stringLiteralAST)

For a lexer, a string is a sequence of char to match. That is, "fog" is treated as 'f' 'o' 'g' not as a single transition in the DFA. Machine== o-'f'->o-'o'->o-'g'->o and has n+1 states for n characters. if "caseInsensitive" option is enabled, "fog" will be treated as o-('f'|'F') -> o-('o'|'O') -> o-('g'|'G')

Specified by:

stringLiteral in interface ATNFactory

Overrides:

stringLiteral in class ParserATNFactory

charSetLiteral

public ATNFactory.Handle charSetLiteral(GrammarAST charSetAST)

[Aa\t ሴa-z\]\p{Letter}\-] char sets

Specified by:

charSetLiteral in interface ATNFactory

Overrides:

charSetLiteral in class ParserATNFactory

getSetFromCharSetLiteral

public IntervalSet getSetFromCharSetLiteral(GrammarAST charSetAST)

applyPrevStateAndMoveToCodePoint

private LexerATNFactory.CharSetParseState applyPrevStateAndMoveToCodePoint(GrammarAST charSetAST,
 IntervalSet set,
 LexerATNFactory.CharSetParseState state,
 int codePoint)

applyPrevStateAndMoveToProperty

private LexerATNFactory.CharSetParseState applyPrevStateAndMoveToProperty(GrammarAST charSetAST,
 IntervalSet set,
 LexerATNFactory.CharSetParseState state,
 IntervalSet property)

applyPrevState

private void applyPrevState(GrammarAST charSetAST,
 IntervalSet set,
 LexerATNFactory.CharSetParseState state)

checkCharAndAddToSet

private void checkCharAndAddToSet(GrammarAST ast,
 IntervalSet set,
 int c)

checkRangeAndAddToSet

private void checkRangeAndAddToSet(GrammarAST mainAst,
 IntervalSet set,
 int a,
 int b)

checkRangeAndAddToSet

private CharactersDataCheckStatus checkRangeAndAddToSet(GrammarAST rootAst,
 GrammarAST ast,
 IntervalSet set,
 int a,
 int b,
 boolean caseInsensitive,
 CharactersDataCheckStatus previousStatus)

createTransition

private Transition createTransition(ATNState target,
 int from,
 int to,
 org.antlr.runtime.tree.CommonTree tree)

tokenRef

public ATNFactory.Handle tokenRef(TerminalAST node)

Description copied from class: ParserATNFactory

From label A build graph o-A->o.

Specified by:

tokenRef in interface ATNFactory

Overrides:

tokenRef in class ParserATNFactory

createLexerAction

private LexerAction createLexerAction(GrammarAST ID,
 GrammarAST arg)

checkCommands

private void checkCommands(String command,
 org.antlr.runtime.Token commandToken)

getModeConstantValue

private Integer getModeConstantValue(String modeName,
 org.antlr.runtime.Token token)

getTokenConstantValue

private Integer getTokenConstantValue(String tokenName,
 org.antlr.runtime.Token token)

getChannelConstantValue

private Integer getChannelConstantValue(String channelName,
 org.antlr.runtime.Token token)