Package com.javacc.parser

Class JavaCCLexer

java.lang.Object
com.javacc.parser.JavaCCLexer
All Implemented Interfaces:
JavaCCConstants
public class JavaCCLexer extends Object implements JavaCCConstants

  • Constructor Details

    • JavaCCLexer

      public JavaCCLexer(CharSequence input)

    • JavaCCLexer

      public JavaCCLexer(String inputSource, CharSequence input)
      Parameters:
      inputSource - just the naem of the input source (typically the filename) that will be used in error messages and so on.
      input - the input

    • JavaCCLexer

      public JavaCCLexer(String inputSource, CharSequence input, JavaCCConstants.LexicalState lexState, int startingLine, int startingColumn)
      Parameters:
      inputSource - just the name of the input source (typically the filename) that will be used in error messages and so on.
      input - the input
      line - The line number at which we are starting for the purposes of location/error messages. In most normal usage, this is 1.
      column - number at which we are starting for the purposes of location/error messages. In most normal usages this is 1.

    • JavaCCLexer

      public JavaCCLexer(Reader reader)

    • JavaCCLexer

      public JavaCCLexer(String inputSource, Reader reader)

    • JavaCCLexer

      public JavaCCLexer(String inputSource, Reader reader, JavaCCConstants.LexicalState lexState, int line, int column)

  • Method Details

    • getInputSource

      public String getInputSource()

    • setInputSource

      public void setInputSource(String inputSource)

    • getNextToken

      public Token getNextToken(Token tok)
      The public method for getting the next token. If the tok parameter is null, it just tokenizes starting at the internal bufferPosition Otherwise, it checks whether we have already cached the token after this one. If not, it finally goes to the NFA machinery

    • getNextToken

      public Token getNextToken(int offset)
      A lower level method to tokenize, that takes the absolute offset into the content buffer as a parameter
      Parameters:
      offset - where to start
      Returns:
      the token that results from scanning from the given starting point

    • switchTo

      public boolean switchTo(JavaCCConstants.LexicalState lexState)
      Switch to specified lexical state.
      Parameters:
      lexState - the lexical state to switch to
      Returns:
      whether we switched (i.e. we weren't already in the desired lexical state)

    • setParsedLines

      public void setParsedLines(BitSet parsedLines)
      This is used in conjunction with having a preprocessor. We set which lines are actually parsed lines and the unset ones are ignored.
      Parameters:
      parsedLines - a #java.util.BitSet that holds which lines are parsed (i.e. not ignored)