cpp.tokenize.Token Class Reference

Inheritance diagram for cpp.tokenize.Token:

Collaboration diagram for cpp.tokenize.Token:

Public Member Functions
	__init__ (self, token_type, name, start, end)
	__str__ (self)

Public Attributes
	token_type
	name
	start
	end
	whence

Static Private Attributes
	__repr__ = __str__

Detailed Description

Data container to represent a C++ token.

Tokens can be identifiers, syntax char(s), constants, or
pre-processor directives.

start contains the index of the first char of the token in the source
end contains the index of the last char of the token in the source

Constructor & Destructor Documentation

__init__()

cpp.tokenize.Token.__init__	(		self,
			token_type,
			name,
			start,
			end )

Member Function Documentation

__str__()

cpp.tokenize.Token.__str__

(

self

)

Member Data Documentation

__repr__

cpp.tokenize.Token.__repr__ = __str__

staticprivate

end

cpp.tokenize.Token.end

name

cpp.tokenize.Token.name

start

cpp.tokenize.Token.start

token_type

cpp.tokenize.Token.token_type

whence

cpp.tokenize.Token.whence

---

The documentation for this class was generated from the following file:

• external/rapidjson/thirdparty/gtest/googlemock/scripts/generator/cpp/tokenize.py