manifold.templates.tokenizer

Class Tokenizer

java.lang.Object

manifold.templates.tokenizer.Tokenizer

public class Tokenizer
extends Object

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
List<Token>	tokenize(CharSequence text)

Methods inherited from class java.lang.Object

clone, emptyArray, equals, finalize, getClass, hashCode, jailbreak, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

tokenize

public List<Token> tokenize(CharSequence text)