Class TokenImpl

java.lang.Object

org.fife.rsta.ac.java.rjc.lexer.TokenImpl

All Implemented Interfaces:

Token, TokenTypes

class TokenImpl
extends Object
implements Token

Implementation of a token in a Java source file.

Version:

1.0

Field Summary

Fields

Modifier and Type	Field	Description
private int	column	The column the token is on.
private boolean	invalid	Whether the token is invalid (e.g.
private String	lexeme	The token's text.
private int	line	The line the token is on.
private int	offset	The absolute offset into the source of the token.
private int	type

Fields inherited from interface TokenTypes

ANNOTATION_START, ASSIGNMENT_OPERATOR, COMMENT, DATA_TYPE, DOC_COMMENT, ELIPSIS, IDENTIFIER, KEYWORD, KEYWORD_ABSTRACT, KEYWORD_ASSERT, KEYWORD_BOOLEAN, KEYWORD_BREAK, KEYWORD_BYTE, KEYWORD_CASE, KEYWORD_CATCH, KEYWORD_CHAR, KEYWORD_CLASS, KEYWORD_CONST, KEYWORD_CONTINUE, KEYWORD_DEFAULT, KEYWORD_DO, KEYWORD_DOUBLE, KEYWORD_ELSE, KEYWORD_ENUM, KEYWORD_EXTENDS, KEYWORD_FINAL, KEYWORD_FINALLY, KEYWORD_FLOAT, KEYWORD_FOR, KEYWORD_GOTO, KEYWORD_IF, KEYWORD_IMPLEMENTS, KEYWORD_IMPORT, KEYWORD_INSTANCEOF, KEYWORD_INT, KEYWORD_INTERFACE, KEYWORD_LONG, KEYWORD_NATIVE, KEYWORD_NEW, KEYWORD_PACKAGE, KEYWORD_PRIVATE, KEYWORD_PROTECTED, KEYWORD_PUBLIC, KEYWORD_RETURN, KEYWORD_SHORT, KEYWORD_STATIC, KEYWORD_STRICTFP, KEYWORD_SUPER, KEYWORD_SWITCH, KEYWORD_SYNCHRONIZED, KEYWORD_THIS, KEYWORD_THROW, KEYWORD_THROWS, KEYWORD_TRANSIENT, KEYWORD_TRY, KEYWORD_VOID, KEYWORD_VOLATILE, KEYWORD_WHILE, LITERAL, LITERAL_BOOLEAN, LITERAL_CHAR, LITERAL_FP, LITERAL_INT, LITERAL_NULL, LITERAL_STRING, OPERATOR, OPERATOR_BITWISE_AND, OPERATOR_BITWISE_AND_EQUALS, OPERATOR_BITWISE_NOT, OPERATOR_BITWISE_OR, OPERATOR_BITWISE_OR_EQUALS, OPERATOR_BITWISE_XOR, OPERATOR_BITWISE_XOR_EQUALS, OPERATOR_COLON, OPERATOR_DECREMENT, OPERATOR_DIVIDE, OPERATOR_DIVIDE_EQUALS, OPERATOR_EQUALS, OPERATOR_EQUALS_EQUALS, OPERATOR_GT, OPERATOR_GTE, OPERATOR_INCREMENT, OPERATOR_LOGICAL_AND, OPERATOR_LOGICAL_NOT, OPERATOR_LOGICAL_OR, OPERATOR_LSHIFT, OPERATOR_LSHIFT_EQUALS, OPERATOR_LT, OPERATOR_LTE, OPERATOR_MINUS, OPERATOR_MINUS_EQUALS, OPERATOR_MOD, OPERATOR_MOD_EQUALS, OPERATOR_NE, OPERATOR_PLUS, OPERATOR_PLUS_EQUALS, OPERATOR_QUESTION, OPERATOR_RSHIFT, OPERATOR_RSHIFT_EQUALS, OPERATOR_RSHIFT2, OPERATOR_RSHIFT2_EQUALS, OPERATOR_TIMES, OPERATOR_TIMES_EQUALS, SEPARATOR, SEPARATOR_COMMA, SEPARATOR_DOT, SEPARATOR_LBRACE, SEPARATOR_LBRACKET, SEPARATOR_LPAREN, SEPARATOR_RBRACE, SEPARATOR_RBRACKET, SEPARATOR_RPAREN, SEPARATOR_SEMICOLON, WHITESPACE

Constructor Summary

Constructors

Constructor	Description
TokenImpl(int type, String lexeme, int line, int column, int offs)
TokenImpl(int type, String lexeme, int line, int column, int offs, boolean invalid)

Method Summary

Modifier and Type	Method	Description
boolean	equals(Object obj)
int	getColumn()	Returns the column (offset into the line) of this token.
int	getLength()	Returns the length of this token.
String	getLexeme()	Returns the text of this token.
int	getLine()	Returns the line this token is on.
int	getOffset()	Returns the offset into the document of this token.
int	getType()	Returns the type of this token.
int	hashCode()
boolean	isBasicType()	Returns whether this token is a primitive data type (int, float, string, etc.).
boolean	isIdentifier()	Returns whether this token is an identifier.
boolean	isInvalid()	Returns whether this token is invalid.
boolean	isOperator()	Returns whether this token is an operator.
boolean	isType(int type)	Returns whether this token is of the specified type.
String	toString()

Methods inherited from class Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Details

type

private int type

lexeme

private String lexeme

The token's text.

line

private int line

The line the token is on.

column

private int column

The column the token is on.

offset

private int offset

The absolute offset into the source of the token.

invalid

private boolean invalid

Whether the token is invalid (e.g. an invalid char of String).

Constructor Details

TokenImpl

TokenImpl(int type,
 String lexeme,
 int line,
 int column,
 int offs)

TokenImpl

TokenImpl(int type,
 String lexeme,
 int line,
 int column,
 int offs,
 boolean invalid)

Method Details

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

getColumn

public int getColumn()

Description copied from interface: Token

Returns the column (offset into the line) of this token.

Specified by:

getColumn in interface Token

Returns:

The column of the token.

See Also:

• Token.getLine()

getLength

public int getLength()

Description copied from interface: Token

Returns the length of this token.

Specified by:

getLength in interface Token

Returns:

The token's length.

getLexeme

public String getLexeme()

Description copied from interface: Token

Returns the text of this token.

Specified by:

getLexeme in interface Token

Returns:

This token's textual value.

getLine

public int getLine()

Description copied from interface: Token

Returns the line this token is on.

Specified by:

getLine in interface Token

Returns:

The token's line number.

See Also:

• Token.getColumn()

getOffset

public int getOffset()

Description copied from interface: Token

Returns the offset into the document of this token.

Specified by:

getOffset in interface Token

Returns:

The token's offset.

See Also:

• Token.getLine()
• Token.getColumn()

getType

public int getType()

Description copied from interface: Token

Returns the type of this token.

Specified by:

getType in interface Token

Returns:

The type of this token.

hashCode

public int hashCode()

Overrides:

hashCode in class Object

isBasicType

public boolean isBasicType()

Description copied from interface: Token

Returns whether this token is a primitive data type (int, float, string, etc.).

Specified by:

isBasicType in interface Token

Returns:

Whether this token is a primitive data type.

isIdentifier

public boolean isIdentifier()

Description copied from interface: Token

Returns whether this token is an identifier.

Specified by:

isIdentifier in interface Token

Returns:

Whether this token is an identifier.

isInvalid

public boolean isInvalid()

Description copied from interface: Token

Returns whether this token is invalid.

Specified by:

isInvalid in interface Token

Returns:

Whether this token is invalid.

isOperator

public boolean isOperator()

Description copied from interface: Token

Returns whether this token is an operator.

Specified by:

isOperator in interface Token

Returns:

Whether this token is an operator.

isType

public boolean isType(int type)

Description copied from interface: Token

Returns whether this token is of the specified type.

Specified by:

isType in interface Token

Parameters:

type - The type to check.

Returns:

Whether this token is of the specified type.

toString

public String toString()

Overrides:

toString in class Object