Package org.languagetool.tagging.disambiguation

Class MultiWordChunker

java.lang.Object

org.languagetool.tagging.disambiguation.AbstractDisambiguator

org.languagetool.tagging.disambiguation.MultiWordChunker

All Implemented Interfaces:

Disambiguator

public class MultiWordChunker
extends AbstractDisambiguator

Multiword tagger-chunker.

Field Summary

Fields

Modifier and Type	Field	Description
private final boolean	allowFirstCapitalized
private final String	filename
private Map<String,String>	mFull
private Map<String,Integer>	mStartNoSpace
private Map<String,Integer>	mStartSpace

Constructor Summary

Constructors

Constructor	Description
MultiWordChunker(String filename)
MultiWordChunker(String filename, boolean allowFirstCapitalized)

Method Summary

Modifier and Type	Method	Description
final AnalyzedSentence	disambiguate(AnalyzedSentence input)	Implements multiword POS tags, e.g., <ELLIPSIS> for ellipsis (...) start, and </ELLIPSIS> for ellipsis end.
private void	lazyInit()
private List<String>	loadWords(InputStream stream)
private AnalyzedTokenReadings	prepareNewReading(String tokens, String tok, AnalyzedTokenReadings token, boolean isLast)
private AnalyzedTokenReadings	setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)

Methods inherited from class org.languagetool.tagging.disambiguation.AbstractDisambiguator

preDisambiguate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

filename

private final String filename

allowFirstCapitalized

private final boolean allowFirstCapitalized

mStartSpace

private Map<String,Integer> mStartSpace

mStartNoSpace

private Map<String,Integer> mStartNoSpace

mFull

private Map<String,String> mFull

Constructor Details

MultiWordChunker

public MultiWordChunker(String filename)

Parameters:

filename - file text with multiwords and tags

MultiWordChunker

public MultiWordChunker(String filename,
 boolean allowFirstCapitalized)

Parameters:

filename - file text with multiwords and tags

allowFirstCapitalized - if set to true, first word of the multiword can be capitalized

Method Details

lazyInit

private void lazyInit()

disambiguate

public final AnalyzedSentence disambiguate(AnalyzedSentence input)

Implements multiword POS tags, e.g., <ELLIPSIS> for ellipsis (...) start, and </ELLIPSIS> for ellipsis end.

Parameters:

input - The tokens to be chunked.

Returns:

AnalyzedSentence with additional markers.

prepareNewReading

private AnalyzedTokenReadings prepareNewReading(String tokens,
 String tok,
 AnalyzedTokenReadings token,
 boolean isLast)

setAndAnnotate

private AnalyzedTokenReadings setAndAnnotate(AnalyzedTokenReadings oldReading,
 AnalyzedToken newReading)

loadWords

private List<String> loadWords(InputStream stream)