Class Lexer

java.lang.Object
com.fasterxml.jackson.dataformat.toml.Lexer
class Lexer extends Object

  • Field Details

    • YYEOF

      public static final int YYEOF
      This character denotes the end of file.
      See Also:

    • ZZ_BUFFERSIZE

      private static final int ZZ_BUFFERSIZE
      Initial size of the lookahead buffer.
      See Also:

    • YYINITIAL

      public static final int YYINITIAL
      See Also:

    • EXPECT_EXPRESSION

      public static final int EXPECT_EXPRESSION
      See Also:

    • EXPECT_INLINE_KEY

      public static final int EXPECT_INLINE_KEY
      See Also:

    • EXPECT_VALUE

      public static final int EXPECT_VALUE
      See Also:

    • EXPECT_EOL

      public static final int EXPECT_EOL
      See Also:

    • EXPECT_ARRAY_SEP

      public static final int EXPECT_ARRAY_SEP
      See Also:

    • EXPECT_TABLE_SEP

      public static final int EXPECT_TABLE_SEP
      See Also:

    • ML_BASIC_STRING

      public static final int ML_BASIC_STRING
      See Also:

    • BASIC_STRING

      public static final int BASIC_STRING
      See Also:

    • ML_LITERAL_STRING

      public static final int ML_LITERAL_STRING
      See Also:

    • LITERAL_STRING

      public static final int LITERAL_STRING
      See Also:

    • ZZ_LEXSTATE

      private static final int[] ZZ_LEXSTATE
      ZZ_LEXSTATE[l] is the state in the DFA for the lexical state l ZZ_LEXSTATE[l+1] is the state in the DFA for the lexical state l at the beginning of a line l is of the form l = 2*k, k a non negative integer

    • ZZ_CMAP_TOP

      private static final int[] ZZ_CMAP_TOP
      Top-level table for translating characters to character classes

    • ZZ_CMAP_TOP_PACKED_0

      private static final String ZZ_CMAP_TOP_PACKED_0
      See Also:

    • ZZ_CMAP_BLOCKS

      private static final int[] ZZ_CMAP_BLOCKS
      Second-level tables for translating characters to character classes

    • ZZ_CMAP_BLOCKS_PACKED_0

      private static final String ZZ_CMAP_BLOCKS_PACKED_0
      See Also:

    • ZZ_ACTION

      private static final int[] ZZ_ACTION
      Translates DFA states to action switch labels.

    • ZZ_ACTION_PACKED_0

      private static final String ZZ_ACTION_PACKED_0
      See Also:

    • ZZ_ROWMAP

      private static final int[] ZZ_ROWMAP
      Translates a state to a row index in the transition table

    • ZZ_ROWMAP_PACKED_0

      private static final String ZZ_ROWMAP_PACKED_0
      See Also:

    • ZZ_TRANS

      private static final int[] ZZ_TRANS
      The transition table of the DFA

    • ZZ_TRANS_PACKED_0

      private static final String ZZ_TRANS_PACKED_0
      See Also:

    • ZZ_UNKNOWN_ERROR

      private static final int ZZ_UNKNOWN_ERROR
      Error code for "Unknown internal scanner error".
      See Also:

    • ZZ_NO_MATCH

      private static final int ZZ_NO_MATCH
      Error code for "could not match input".
      See Also:

    • ZZ_PUSHBACK_2BIG

      private static final int ZZ_PUSHBACK_2BIG
      Error code for "pushback value was too large".
      See Also:

    • ZZ_ERROR_MSG

      private static final String[] ZZ_ERROR_MSG
      Error messages for ZZ_UNKNOWN_ERROR, ZZ_NO_MATCH, and ZZ_PUSHBACK_2BIG respectively.

    • ZZ_ATTRIBUTE

      private static final int[] ZZ_ATTRIBUTE
      ZZ_ATTRIBUTE[aState] contains the attributes of state aState

    • ZZ_ATTRIBUTE_PACKED_0

      private static final String ZZ_ATTRIBUTE_PACKED_0
      See Also:

    • zzReader

      private Reader zzReader
      Input device.

    • zzState

      private int zzState
      Current state of the DFA.

    • zzLexicalState

      private int zzLexicalState
      Current lexical state.

    • zzBuffer

      private char[] zzBuffer
      This buffer contains the current text to be matched and is the source of the yytext() string.

    • zzMarkedPos

      private int zzMarkedPos
      Text position at the last accepting state.

    • zzCurrentPos

      private int zzCurrentPos
      Current text position in the buffer.

    • zzStartRead

      private int zzStartRead
      Marks the beginning of the yytext() string in the buffer.

    • zzEndRead

      private int zzEndRead
      Marks the last character in the buffer, that has been read from input.

    • zzAtEOF

      private boolean zzAtEOF
      Whether the scanner is at the end of file.
      See Also:

    • zzFinalHighSurrogate

      private int zzFinalHighSurrogate
      The number of occupied positions in zzBuffer beyond zzEndRead.

      When a lead/high surrogate has been read from the input stream into the final zzBuffer position, this will have a value of 1; otherwise, it will have a value of 0.

    • yyline

      private int yyline
      Number of newlines encountered up to the start of the matched text.

    • yycolumn

      private int yycolumn
      Number of characters from the last newline up to the start of the matched text.

    • yychar

      private long yychar
      Number of characters up to the start of the matched text.

    • zzAtBOL

      private boolean zzAtBOL
      Whether the scanner is currently at the beginning of a line.

    • zzEOFDone

      private boolean zzEOFDone
      Whether the user-EOF-code has already been executed.

    • ioContext

      private final com.fasterxml.jackson.core.io.IOContext ioContext

    • errorContext

      private final TomlStreamReadException.ErrorContext errorContext

    • prohibitInternalBufferAllocate

      boolean prohibitInternalBufferAllocate

    • releaseTokenBuffer

      private boolean releaseTokenBuffer

    • trimmedNewline

      private boolean trimmedNewline

    • textBuffer

      final com.fasterxml.jackson.core.util.TextBuffer textBuffer

    • streamReadConstraints

      private final com.fasterxml.jackson.core.StreamReadConstraints streamReadConstraints

    • nestingDepth

      private int nestingDepth

  • Constructor Details

  • Method Details

    • zzUnpackcmap_top

      private static int[] zzUnpackcmap_top()

    • zzUnpackcmap_top

      private static int zzUnpackcmap_top(String packed, int offset, int[] result)

    • zzUnpackcmap_blocks

      private static int[] zzUnpackcmap_blocks()

    • zzUnpackcmap_blocks

      private static int zzUnpackcmap_blocks(String packed, int offset, int[] result)

    • zzUnpackAction

      private static int[] zzUnpackAction()

    • zzUnpackAction

      private static int zzUnpackAction(String packed, int offset, int[] result)

    • zzUnpackRowMap

      private static int[] zzUnpackRowMap()

    • zzUnpackRowMap

      private static int zzUnpackRowMap(String packed, int offset, int[] result)

    • zzUnpacktrans

      private static int[] zzUnpacktrans()

    • zzUnpacktrans

      private static int zzUnpacktrans(String packed, int offset, int[] result)

    • zzUnpackAttribute

      private static int[] zzUnpackAttribute()

    • zzUnpackAttribute

      private static int zzUnpackAttribute(String packed, int offset, int[] result)

    • requestLargerBuffer

      private void requestLargerBuffer() throws TomlStreamReadException
      Throws:
      TomlStreamReadException

    • releaseBuffers

      public void releaseBuffers()

    • getNestingDepth

      public int getNestingDepth()

    • startString

      private void startString()

    • appendNormalTextToken

      private void appendNormalTextToken() throws IOException
      Throws:
      IOException

    • appendNewlineWithPossibleTrim

      private void appendNewlineWithPossibleTrim() throws IOException
      Throws:
      IOException

    • appendUnicodeEscapeShort

      private void appendUnicodeEscapeShort() throws IOException
      Throws:
      IOException

    • appendUnicodeEscapeLong

      private void appendUnicodeEscapeLong() throws IOException
      Throws:
      IOException

    • getLine

      int getLine()

    • getColumn

      int getColumn()

    • getCharPos

      long getCharPos()

    • getTextBuffer

      char[] getTextBuffer()

    • getTextBufferStart

      int getTextBufferStart()

    • getTextBufferEnd

      int getTextBufferEnd()

    • zzMaxBufferLen

      private int zzMaxBufferLen()
      Returns the maximum size of the scanner buffer, which limits the size of tokens.

    • zzCanGrow

      private boolean zzCanGrow()
      Whether the scanner buffer can grow to accommodate a larger token.

    • zzCMap

      private static int zzCMap(int input)
      Translates raw input code points to DFA table row

    • zzRefill

      private boolean zzRefill() throws IOException
      Refills the input buffer.
      Returns:
      false iff there was new input.
      Throws:
      IOException - if any I/O-Error occurs

    • yyclose

      public final void yyclose() throws IOException
      Closes the input reader.
      Throws:
      IOException - if the reader could not be closed.

    • yyResetPosition

      private final void yyResetPosition()
      Resets the input position.

    • yyatEOF

      public final boolean yyatEOF()
      Returns whether the scanner has reached the end of the reader it reads from.
      Returns:
      whether the scanner has reached EOF.

    • yystate

      public final int yystate()
      Returns the current lexical state.
      Returns:
      the current lexical state.

    • yybegin

      public final void yybegin(int newState)
      Enters a new lexical state.
      Parameters:
      newState - the new lexical state

    • yytext

      public final String yytext()
      Returns the text matched by the current regular expression.
      Returns:
      the matched text.

    • yycharat

      public final char yycharat(int position)
      Returns the character at the given position from the matched text.

      It is equivalent to yytext().charAt(pos), but faster.

      Parameters:
      position - the position of the character to fetch. A value from 0 to yylength()-1.
      Returns:
      the character at position.

    • yylength

      public final int yylength()
      How many characters were matched.
      Returns:
      the length of the matched text region.

    • zzScanError

      private static void zzScanError(int errorCode)
      Reports an error that occurred while scanning.

      In a well-formed scanner (no or only correct usage of yypushback(int) and a match-all fallback rule) this method will only be called with things that "Can't Possibly Happen".

      If this method is called, something is seriously wrong (e.g. a JFlex bug producing a faulty scanner etc.).

      Usual syntax/scanner level error handling should be done in error fallback rules.

      Parameters:
      errorCode - the code of the error message to display.

    • yypushback

      public void yypushback(int number)
      Pushes the specified amount of characters back into the input stream.

      They will be read again by then next call of the scanning method.

      Parameters:
      number - the number of characters to be read again. This number must not be greater than yylength().

    • yylex

      public TomlToken yylex() throws IOException
      Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
      Returns:
      the next token.
      Throws:
      IOException - if any I/O-Error occurs.