Class Token

java.lang.Object

com.sun.tools.corba.ee.idl.Token

class Token
extends Object

Class Token represents a lexeme appearing within an IDL source. Every Token has a type. Depending on its type and on the supported version of IDL, a Token will have other associated attributes, such as a name (identifier, e.g.), and whether it is escaped, deprecated, or is a type that is known to be in a future version of IDL.

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static final int	Abstract	////////////
(package private) static final int	Ampersand	////////////
(package private) static final int	Any	////////////
(package private) static final int	Apostrophe	////////////
(package private) static final int	Attribute	////////////
(package private) static final int	Backslash	////////////
(package private) static final int	Bar	////////////
(package private) static final int	Boolean	////////////
(package private) static final int	BooleanLiteral	////////////
(package private) static final int	Carat	////////////
(package private) static final int	Case	////////////
(package private) static final int	Char	////////////
(package private) static final int	CharacterLiteral	////////////
(package private) boolean	collidesWithKeyword	True iff this token is an identifier that is known to be a keyword in another version of CORBA or matches a keyword in letter, but not case.
(package private) static final int	Colon	////////////
(package private) static final int	Comma	////////////
(package private) Comment	comment	Source comment associated with this token.
(package private) static final int	Component	////////////
(package private) static final int	Const	////////////
(package private) static final int	Consumes	////////////
(package private) static final int	Context	////////////
private static final int	CORBA_LEVEL_22
private static final int	CORBA_LEVEL_23
private static final int	CORBA_LEVEL_24RTF
private static final int	CORBA_LEVEL_30
(package private) static final int	Custom	////////////
(package private) static final int	Default	////////////
(package private) static final int	Define	////////////
(package private) static final int	Defined	////////////
(package private) static final String[]	Directives
(package private) static final int	Double	////////////
(package private) static final int	DoubleAmpersand	////////////
(package private) static final int	DoubleBar	////////////
(package private) static final int	DoubleColon	////////////
(package private) static final int	DoubleEqual	////////////
(package private) static final int	Elif	////////////
(package private) static final int	Else	////////////
(package private) static final int	Emits	////////////
(package private) static final int	Endif	////////////
(package private) static final int	Enum	////////////
(package private) static final int	EOF	////////////
(package private) static final int	Equal	////////////
(package private) static final int	Error	////////////
(package private) static final int	Exception	////////////
(package private) static final int	Exclamation	////////////
(package private) static final int	Factory	////////////
(package private) static final int	FALSE	////////////
(package private) static final int	Finder	////////////
private static final int	First22Keyword
private static final int	First23Keyword
private static final int	First24rtfKeyword
private static final int	First30Keyword
(package private) static final int	FirstDirective
private static final int	FirstKeyword
(package private) static final int	FirstLiteral	////////////
(package private) static final int	FirstSpecial	////////////
(package private) static final int	FirstSymbol	////////////
(package private) static final int	Fixed	////////////
(package private) static final int	Float	////////////
(package private) static final int	FloatingPointLiteral	////////////
(package private) static final int	GetRaises	////////////
(package private) static final int	GreaterEqual	////////////
(package private) static final int	GreaterThan	////////////
(package private) static final int	Hash	////////////
(package private) static final int	Home	////////////
(package private) static final int	Identifier	////////////
(package private) static final int	If	////////////
(package private) static final int	Ifdef	////////////
(package private) static final int	Ifndef	////////////
(package private) static final int	Import	////////////
(package private) static final int	In	////////////
(package private) static final int	Include	////////////
(package private) static final int	Init	////////////
(package private) static final int	Inout	////////////
(package private) static final int	IntegerLiteral	////////////
(package private) static final int	Interface	////////////
(package private) boolean	isDeprecated	True iff this token is deprecated.
(package private) boolean	isEscaped	True iff this token is an escaped identifier.
(package private) boolean	isWide	**
(package private) static final String[]	Keywords	////////////
private static final int	Last22Keyword
private static final int	Last23Keyword
private static final int	Last24rtfKeyword
private static final int	Last30Keyword
(package private) static final int	LastDirective
private static final int	LastKeyword
(package private) static final int	LastLiteral	////////////
(package private) static final int	LastSpecial	////////////
(package private) static final int	LastSymbol	////////////
(package private) static final int	LeftBrace	////////////
(package private) static final int	LeftBracket	////////////
(package private) static final int	LeftParen	////////////
(package private) static final int	LessEqual	////////////
(package private) static final int	LessThan	////////////
(package private) static final int	Line	////////////
(package private) static final int	Literal	////////////
(package private) static final String[]	Literals
(package private) static final int	Local	////////////
(package private) static final int	Long	////////////
(package private) static final int	MacroIdentifier	////////////
(package private) static final int	Manages	////////////
(package private) static final int	Minus	////////////
(package private) static final int	Module	////////////
(package private) static final int	Multiple	////////////
(package private) String	name	Lexeme extracted from the source for this token.
(package private) static final int	Native	////////////
(package private) static final int	NotEqual	////////////
(package private) static final int	Null	////////////
(package private) static final int	Object	////////////
(package private) static final int	Octet	////////////
(package private) static final int	Oneway	////////////
(package private) static final int	Out	////////////
(package private) static final int	Percent	////////////
(package private) static final int	Period	////////////
(package private) static final int	Plus	////////////
(package private) static final int	Pragma	////////////
(package private) static final int	PrimaryKey	////////////
(package private) static final int	Private	////////////
(package private) static final int	Provides	////////////
(package private) static final int	Public	////////////
(package private) static final int	Publishes	////////////
(package private) static final int	Quote	////////////
(package private) static final int	Raises	////////////
(package private) static final int	Readonly	////////////
(package private) static final int	RightBrace	////////////
(package private) static final int	RightBracket	////////////
(package private) static final int	RightParen	////////////
(package private) static final int	Semicolon	////////////
(package private) static final int	Sequence	////////////
(package private) static final int	SetRaises	////////////
(package private) static final int	ShiftLeft	////////////
(package private) static final int	ShiftRight	////////////
(package private) static final int	Short	////////////
(package private) static final int	Slash	////////////
(package private) static final String[]	Special
(package private) static final int	Star	////////////
(package private) static final int	String	////////////
(package private) static final int	StringLiteral	////////////
(package private) static final int	Struct	////////////
(package private) static final int	Supports	////////////
(package private) static final int	Switch	////////////
(package private) static final String[]	Symbols
(package private) static final int	Tilde	////////////
(package private) static final int	TRUE	////////////
(package private) static final int	Truncatable	////////////
(package private) int	type	Code identifying the lexical class to which this token belongs, e.g., Keyword, Identifier, ...
(package private) static final int	Typedef	////////////
(package private) static final int	TypeId	////////////
(package private) static final int	TypePrefix	////////////
(package private) static final int	Undef	////////////
(package private) static final int	Union	////////////
(package private) static final int	Unknown	////////////
(package private) static final int	Unsigned	////////////
(package private) static final int	Uses	////////////
(package private) static final int	ValueBase	////////////
(package private) static final int	Valuetype	////////////
(package private) static final int	Void	////////////
(package private) static final int	Wchar	////////////
(package private) static final int	Wstring	////////////

Constructor Summary

Constructors

Constructor	Description
Token(int tokenType)	Constructor.
Token(int tokenType, boolean deprecated)	Constructor.
Token(int tokenType, String tokenName)	Constructor.
Token(int tokenType, String tokenName, boolean isWide)	Constructor.
Token(int tokenType, String tokenName, boolean escaped, boolean collision, boolean deprecated)	Constructor.

Method Summary

Modifier and Type	Method	Description
boolean	collidesWithKeyword()	Accessor.
(package private) boolean	equals(int type)	Determine whether the this token is of a supplied type.
(package private) boolean	equals(Token that)	Determine whether this token equals a supplied token.
(package private) boolean	equals(String name)	Determine whether this identifier has the supplied name.
private static int	getLastKeyword(int level)
private static int	getLevel(float cLevel)
boolean	isDeprecated()	Accessor.
(package private) boolean	isDirective()	Determine whether this token is a preprocessor directive.
boolean	isEscaped()	Accessor.
(package private) boolean	isKeyword()	Determine whether this token is a keyword.
boolean	isWide()
static Token	makeKeywordToken(String string, float corbaLevel, boolean escapedOK, boolean[] collision)	Create a keyword token from a string.
String	toString()	Get the String representation of this Token.
(package private) static String	toString(int type)	Get the String representation of a supplied Token type.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

Any

static final int Any

////////////

See Also:

• Constant Field Values

Attribute

static final int Attribute

////////////

See Also:

• Constant Field Values

Boolean

static final int Boolean

////////////

See Also:

• Constant Field Values

Case

static final int Case

////////////

See Also:

• Constant Field Values

Char

static final int Char

////////////

See Also:

• Constant Field Values

Const

static final int Const

////////////

See Also:

• Constant Field Values

Context

static final int Context

////////////

See Also:

• Constant Field Values

Default

static final int Default

////////////

See Also:

• Constant Field Values

Double

static final int Double

////////////

See Also:

• Constant Field Values

Enum

static final int Enum

////////////

See Also:

• Constant Field Values

Exception

static final int Exception

////////////

See Also:

• Constant Field Values

FALSE

static final int FALSE

////////////

See Also:

• Constant Field Values

Fixed

static final int Fixed

////////////

See Also:

• Constant Field Values

Float

static final int Float

////////////

See Also:

• Constant Field Values

In

static final int In

////////////

See Also:

• Constant Field Values

Inout

static final int Inout

////////////

See Also:

• Constant Field Values

Interface

static final int Interface

////////////

See Also:

• Constant Field Values

Long

static final int Long

////////////

See Also:

• Constant Field Values

Module

static final int Module

////////////

See Also:

• Constant Field Values

Native

static final int Native

////////////

See Also:

• Constant Field Values

Object

static final int Object

////////////

See Also:

• Constant Field Values

Octet

static final int Octet

////////////

See Also:

• Constant Field Values

Oneway

static final int Oneway

////////////

See Also:

• Constant Field Values

Out

static final int Out

////////////

See Also:

• Constant Field Values

Raises

static final int Raises

////////////

See Also:

• Constant Field Values

Readonly

static final int Readonly

////////////

See Also:

• Constant Field Values

Sequence

static final int Sequence

////////////

See Also:

• Constant Field Values

Short

static final int Short

////////////

See Also:

• Constant Field Values

String

static final int String

////////////

See Also:

• Constant Field Values

Struct

static final int Struct

////////////

See Also:

• Constant Field Values

Switch

static final int Switch

////////////

See Also:

• Constant Field Values

TRUE

static final int TRUE

////////////

See Also:

• Constant Field Values

Typedef

static final int Typedef

////////////

See Also:

• Constant Field Values

Unsigned

static final int Unsigned

////////////

See Also:

• Constant Field Values

Union

static final int Union

////////////

See Also:

• Constant Field Values

Void

static final int Void

////////////

See Also:

• Constant Field Values

Wchar

static final int Wchar

////////////

See Also:

• Constant Field Values

Wstring

static final int Wstring

////////////

See Also:

• Constant Field Values

Init

static final int Init

////////////

See Also:

• Constant Field Values

Abstract

static final int Abstract

////////////

See Also:

• Constant Field Values

Custom

static final int Custom

////////////

See Also:

• Constant Field Values

Private

static final int Private

////////////

See Also:

• Constant Field Values

Public

static final int Public

////////////

See Also:

• Constant Field Values

Supports

static final int Supports

////////////

See Also:

• Constant Field Values

Truncatable

static final int Truncatable

////////////

See Also:

• Constant Field Values

ValueBase

static final int ValueBase

////////////

See Also:

• Constant Field Values

Valuetype

static final int Valuetype

////////////

See Also:

• Constant Field Values

Factory

static final int Factory

////////////

See Also:

• Constant Field Values

Component

static final int Component

////////////

See Also:

• Constant Field Values

Consumes

static final int Consumes

////////////

See Also:

• Constant Field Values

Emits

static final int Emits

////////////

See Also:

• Constant Field Values

Finder

static final int Finder

////////////

See Also:

• Constant Field Values

GetRaises

static final int GetRaises

////////////

See Also:

• Constant Field Values

Home

static final int Home

////////////

See Also:

• Constant Field Values

Import

static final int Import

////////////

See Also:

• Constant Field Values

Local

static final int Local

////////////

See Also:

• Constant Field Values

Manages

static final int Manages

////////////

See Also:

• Constant Field Values

Multiple

static final int Multiple

////////////

See Also:

• Constant Field Values

PrimaryKey

static final int PrimaryKey

////////////

See Also:

• Constant Field Values

Provides

static final int Provides

////////////

See Also:

• Constant Field Values

Publishes

static final int Publishes

////////////

See Also:

• Constant Field Values

SetRaises

static final int SetRaises

////////////

See Also:

• Constant Field Values

TypeId

static final int TypeId

////////////

See Also:

• Constant Field Values

TypePrefix

static final int TypePrefix

////////////

See Also:

• Constant Field Values

Uses

static final int Uses

////////////

See Also:

• Constant Field Values

Identifier

static final int Identifier

////////////

See Also:

• Constant Field Values

MacroIdentifier

static final int MacroIdentifier

////////////

See Also:

• Constant Field Values

Semicolon

static final int Semicolon

////////////

See Also:

• Constant Field Values

LeftBrace

static final int LeftBrace

////////////

See Also:

• Constant Field Values

RightBrace

static final int RightBrace

////////////

See Also:

• Constant Field Values

Colon

static final int Colon

////////////

See Also:

• Constant Field Values

Comma

static final int Comma

////////////

See Also:

• Constant Field Values

Equal

static final int Equal

////////////

See Also:

• Constant Field Values

Plus

static final int Plus

////////////

See Also:

• Constant Field Values

Minus

static final int Minus

////////////

See Also:

• Constant Field Values

LeftParen

static final int LeftParen

////////////

See Also:

• Constant Field Values

RightParen

static final int RightParen

////////////

See Also:

• Constant Field Values

LessThan

static final int LessThan

////////////

See Also:

• Constant Field Values

GreaterThan

static final int GreaterThan

////////////

See Also:

• Constant Field Values

LeftBracket

static final int LeftBracket

////////////

See Also:

• Constant Field Values

RightBracket

static final int RightBracket

////////////

See Also:

• Constant Field Values

Apostrophe

static final int Apostrophe

////////////

See Also:

• Constant Field Values

Quote

static final int Quote

////////////

See Also:

• Constant Field Values

Backslash

static final int Backslash

////////////

See Also:

• Constant Field Values

Bar

static final int Bar

////////////

See Also:

• Constant Field Values

Carat

static final int Carat

////////////

See Also:

• Constant Field Values

Ampersand

static final int Ampersand

////////////

See Also:

• Constant Field Values

Star

static final int Star

////////////

See Also:

• Constant Field Values

Slash

static final int Slash

////////////

See Also:

• Constant Field Values

Percent

static final int Percent

////////////

See Also:

• Constant Field Values

Tilde

static final int Tilde

////////////

See Also:

• Constant Field Values

DoubleColon

static final int DoubleColon

////////////

See Also:

• Constant Field Values

ShiftLeft

static final int ShiftLeft

////////////

See Also:

• Constant Field Values

ShiftRight

static final int ShiftRight

////////////

See Also:

• Constant Field Values

Period

static final int Period

////////////

See Also:

• Constant Field Values

Hash

static final int Hash

////////////

See Also:

• Constant Field Values

Exclamation

static final int Exclamation

////////////

See Also:

• Constant Field Values

DoubleEqual

static final int DoubleEqual

////////////

See Also:

• Constant Field Values

NotEqual

static final int NotEqual

////////////

See Also:

• Constant Field Values

GreaterEqual

static final int GreaterEqual

////////////

See Also:

• Constant Field Values

LessEqual

static final int LessEqual

////////////

See Also:

• Constant Field Values

DoubleBar

static final int DoubleBar

////////////

See Also:

• Constant Field Values

DoubleAmpersand

static final int DoubleAmpersand

////////////

See Also:

• Constant Field Values

BooleanLiteral

static final int BooleanLiteral

////////////

See Also:

• Constant Field Values

CharacterLiteral

static final int CharacterLiteral

////////////

See Also:

• Constant Field Values

IntegerLiteral

static final int IntegerLiteral

////////////

See Also:

• Constant Field Values

FloatingPointLiteral

static final int FloatingPointLiteral

////////////

See Also:

• Constant Field Values

StringLiteral

static final int StringLiteral

////////////

See Also:

• Constant Field Values

Literal

static final int Literal

////////////

See Also:

• Constant Field Values

Define

static final int Define

////////////

See Also:

• Constant Field Values

Undef

static final int Undef

////////////

See Also:

• Constant Field Values

If

static final int If

////////////

See Also:

• Constant Field Values

Ifdef

static final int Ifdef

////////////

See Also:

• Constant Field Values

Ifndef

static final int Ifndef

////////////

See Also:

• Constant Field Values

Else

static final int Else

////////////

See Also:

• Constant Field Values

Elif

static final int Elif

////////////

See Also:

• Constant Field Values

Include

static final int Include

////////////

See Also:

• Constant Field Values

Endif

static final int Endif

////////////

See Also:

• Constant Field Values

Line

static final int Line

////////////

See Also:

• Constant Field Values

Error

static final int Error

////////////

See Also:

• Constant Field Values

Pragma

static final int Pragma

////////////

See Also:

• Constant Field Values

Null

static final int Null

////////////

See Also:

• Constant Field Values

Unknown

static final int Unknown

////////////

See Also:

• Constant Field Values

Defined

static final int Defined

////////////

See Also:

• Constant Field Values

EOF

static final int EOF

////////////

See Also:

• Constant Field Values

Keywords

static final String[] Keywords

////////////

FirstKeyword

private static final int FirstKeyword

See Also:

• Constant Field Values

LastKeyword

private static final int LastKeyword

See Also:

• Constant Field Values

First22Keyword

private static final int First22Keyword

See Also:

• Constant Field Values

Last22Keyword

private static final int Last22Keyword

See Also:

• Constant Field Values

First23Keyword

private static final int First23Keyword

See Also:

• Constant Field Values

Last23Keyword

private static final int Last23Keyword

See Also:

• Constant Field Values

First24rtfKeyword

private static final int First24rtfKeyword

See Also:

• Constant Field Values

Last24rtfKeyword

private static final int Last24rtfKeyword

See Also:

• Constant Field Values

First30Keyword

private static final int First30Keyword

See Also:

• Constant Field Values

Last30Keyword

private static final int Last30Keyword

See Also:

• Constant Field Values

CORBA_LEVEL_22

private static final int CORBA_LEVEL_22

See Also:

• Constant Field Values

CORBA_LEVEL_23

private static final int CORBA_LEVEL_23

See Also:

• Constant Field Values

CORBA_LEVEL_24RTF

private static final int CORBA_LEVEL_24RTF

See Also:

• Constant Field Values

CORBA_LEVEL_30

private static final int CORBA_LEVEL_30

See Also:

• Constant Field Values

FirstSymbol

static final int FirstSymbol

////////////

See Also:

• Constant Field Values

LastSymbol

static final int LastSymbol

////////////

See Also:

• Constant Field Values

Symbols

static final String[] Symbols

FirstLiteral

static final int FirstLiteral

////////////

See Also:

• Constant Field Values

LastLiteral

static final int LastLiteral

////////////

See Also:

• Constant Field Values

Literals

static final String[] Literals

FirstDirective

static final int FirstDirective

See Also:

• Constant Field Values

LastDirective

static final int LastDirective

See Also:

• Constant Field Values

Directives

static final String[] Directives

FirstSpecial

static final int FirstSpecial

////////////

See Also:

• Constant Field Values

LastSpecial

static final int LastSpecial

////////////

See Also:

• Constant Field Values

Special

static final String[] Special

type

int type

Code identifying the lexical class to which this token belongs, e.g., Keyword, Identifier, ...

name

String name

Lexeme extracted from the source for this token.

comment

Comment comment

Source comment associated with this token.

isEscaped

boolean isEscaped

True iff this token is an escaped identifier.

collidesWithKeyword

boolean collidesWithKeyword

True iff this token is an identifier that is known to be a keyword in another version of CORBA or matches a keyword in letter, but not case.

isDeprecated

boolean isDeprecated

True iff this token is deprecated.

isWide

boolean isWide

**

Constructor Details

Token

Token(int tokenType)

Constructor.

Token

Token(int tokenType,
 boolean deprecated)

Constructor.

Token

Token(int tokenType,
 String tokenName)

Constructor.

Token

Token(int tokenType,
 String tokenName,
 boolean isWide)

Constructor.

Token

Token(int tokenType,
 String tokenName,
 boolean escaped,
 boolean collision,
 boolean deprecated)

Constructor.

Method Details

isKeyword

boolean isKeyword()

Determine whether this token is a keyword.

Returns:

true iff this token is a keyword.

getLevel

private static int getLevel(float cLevel)

getLastKeyword

private static int getLastKeyword(int level)

makeKeywordToken

public static Token makeKeywordToken(String string,
 float corbaLevel,
 boolean escapedOK,
 boolean[] collision)

Create a keyword token from a string. Determines whether the string is an IDL keyword based on the corbaLevel. Strings that are keywords at higher CORBA levels than the corbaLevel argument create identifier tokens that are marked as "collidesWithKeyword", unless escapedOK is FALSE, which is the case only when preprocessing is taking place. In the case of the "init" keyword, which was only defined in CORBA 2.3, init is marked deprecated in CORBA 2.3 since it is not supported in higher levels.

Parameters:

String - string The string we are converting to a token.

float - corbaLevel The CORBA level, currently in the interval [2.2, 3.0].

boolean - escapedOK Flag set true if _ is used to escape an IDL keyword for use as an identifier.

boolean - [] collidesWithKeyword is an array containing one value: a flag representing whether this string is an identifier that collides with a keyword. This is set by this method.

isDirective

boolean isDirective()

Determine whether this token is a preprocessor directive.

Returns:

true iff this token is a preprocessor directive.

toString

public String toString()

Get the String representation of this Token.

Overrides:

toString in class Object

Returns:

a String containing representation of this Token.

toString

static String toString(int type)

Get the String representation of a supplied Token type.

Returns:

A String containing the name of the supplied Token type.

equals

boolean equals(Token that)

Determine whether this token equals a supplied token.

Returns:

true iff the types and names of this and the supplied Token are equal.

equals

boolean equals(int type)

Determine whether the this token is of a supplied type.

Returns:

true iff the type of this Token equals that supplied.

equals

boolean equals(String name)

Determine whether this identifier has the supplied name.

Returns:

true iff this Token is an identifier having the supplied name.

isEscaped

public boolean isEscaped()

Accessor.

Returns:

true iff this token is an escaped identifier.

collidesWithKeyword

public boolean collidesWithKeyword()

Accessor.

Returns:

true iff this token is an identifier having a name matching a keyword in a version of CORBA greater than the specified CORBA level, or iff it matches a keyword in letter, but note case.

isDeprecated

public boolean isDeprecated()

Accessor.

Returns:

true iff this token is a deprecated lexeme or lexical type with respect to the specified CORBA level.

isWide

public boolean isWide()