Uses of Class
org.languagetool.AnalyzedTokenReadings
-
-
Uses of AnalyzedTokenReadings in org.languagetool
Fields in org.languagetool declared as AnalyzedTokenReadings Modifier and Type Field Description private AnalyzedTokenReadings[]AnalyzedSentence. nonBlankPreDisambigTokensprivate AnalyzedTokenReadings[]AnalyzedSentence. nonBlankTokensprivate AnalyzedTokenReadings[]AnalyzedSentence. preDisambigTokensprivate AnalyzedTokenReadings[]AnalyzedSentence. tokensMethods in org.languagetool that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadings[]AnalyzedSentence. getPreDisambigTokens()AnalyzedTokenReadings[]AnalyzedSentence. getPreDisambigTokensWithoutWhitespace()AnalyzedTokenReadings[]AnalyzedSentence. getTokens()Returns theAnalyzedTokenReadingsof the analyzed text.AnalyzedTokenReadings[]AnalyzedSentence. getTokensWithoutWhitespace()Returns theAnalyzedTokenReadingsof the analyzed text, with whitespace tokens removed but with the artificialSENT_STARTtoken included.Methods in org.languagetool that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description private @NotNull java.util.List<AnalyzedTokenReadings>AnalyzedSentence. getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping)Methods in org.languagetool with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private java.util.Set<java.lang.String>AnalyzedSentence. getLemmaSet(AnalyzedTokenReadings[] tokens)private @NotNull java.util.List<AnalyzedTokenReadings>AnalyzedSentence. getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping)private java.util.Set<java.lang.String>AnalyzedSentence. getTokenSet(AnalyzedTokenReadings[] tokens)Constructors in org.languagetool with parameters of type AnalyzedTokenReadings Constructor Description AnalyzedSentence(AnalyzedTokenReadings[] tokens)Creates an AnalyzedSentence from the givenAnalyzedTokenReadings.AnalyzedSentence(AnalyzedTokenReadings[] tokens, int[] mapping, AnalyzedTokenReadings[] nonBlankTokens, AnalyzedTokenReadings[] nonBlankPreDisambigTokens)AnalyzedSentence(AnalyzedTokenReadings[] tokens, AnalyzedTokenReadings[] preDisambigTokens)AnalyzedTokenReadings(AnalyzedTokenReadings oldAtr, java.util.List<AnalyzedToken> newReadings, java.lang.String ruleApplied) -
Uses of AnalyzedTokenReadings in org.languagetool.chunking
Method parameters in org.languagetool.chunking with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description voidChunker. addChunkTags(java.util.List<AnalyzedTokenReadings> sentenceTokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.noop
Method parameters in org.languagetool.noop with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description voidNoopChunker. addChunkTags(java.util.List<AnalyzedTokenReadings> tokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.rules
Methods in org.languagetool.rules that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description private java.util.Map<java.lang.String,AnalyzedTokenReadings>AbstractCompoundRule. getStringToTokenMap(java.util.Queue<AnalyzedTokenReadings> prevTokens, java.util.List<java.lang.String> stringsToCheck, java.util.List<java.lang.String> origStringsToCheck)protected abstract @Nullable java.util.List<AnalyzedTokenReadings>PartialPosTagFilter. tag(java.lang.String token)Methods in org.languagetool.rules with parameters of type AnalyzedTokenReadings Modifier and Type Method Description RuleMatchAbstractDateCheckFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)RuleMatchAbstractFutureDateFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)RuleMatchAbstractNewYearDateFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)@Nullable RuleMatchDateRangeChecker. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)RuleMatchPartialPosTagFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)@Nullable RuleMatchShortenedYearRangeChecker. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)RuleMatchWhitespaceCheckFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)private voidAbstractCompoundRule. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)private voidAbstractSimpleReplaceRule2. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)protected RuleMatchAbstractSimpleReplaceRule. createRuleMatch(AnalyzedTokenReadings tokenReadings, java.util.List<java.lang.String> replacements, AnalyzedSentence sentence)private @Nullable java.lang.StringUppercaseSentenceStartRule. dutchSpecialCase(java.lang.String firstToken, java.lang.String secondToken, AnalyzedTokenReadings[] tokens)private booleanGenericUnpairedBracketsRule. fillSymbolStack(int startPosBase, AnalyzedTokenReadings[] tokens, int i, int j, UnsyncStack<SymbolLocator> symbolStack, AnalyzedSentence sentence)protected java.util.List<RuleMatch>AbstractSimpleReplaceRule. findMatches(AnalyzedTokenReadings tokenReadings, AnalyzedSentence sentence)private booleanGenericUnpairedBracketsRule. getFollowedByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j)private booleanGenericUnpairedBracketsRule. getPrecededByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j)java.util.List<java.lang.String>AbstractStyleRepeatedWordRule. getSynonyms(AnalyzedTokenReadings token)get synonyms for a repeated wordprivate static booleanAbstractStyleRepeatedWordRule. hasBreakToken(AnalyzedTokenReadings[] tokens)booleanWordRepeatRule. ignore(AnalyzedTokenReadings[] tokens, int position)Implement this method to returntrueif there's a potential word repetition at the current position that should be ignored, i.e.protected booleanWordRepeatBeginningRule. isAdverb(AnalyzedTokenReadings token)booleanParagraphRepeatBeginningRule. isArticle(AnalyzedTokenReadings token)protected booleanAbstractFillerWordsRule. isException(AnalyzedTokenReadings[] tokens, int num)private static booleanMultipleWhitespaceRule. isFirstWhite(AnalyzedTokenReadings token)protected booleanGenericUnpairedBracketsRule. isNoException(java.lang.String token, AnalyzedTokenReadings[] tokens, int i, int j, boolean precSpace, boolean follSpace, UnsyncStack<SymbolLocator> symbolStack)Generic method to specify an exception.private static booleanPunctuationMarkAtParagraphEnd. isPunctuationMark(AnalyzedTokenReadings tk)private static booleanPunctuationMarkAtParagraphEnd. isQuotationMark(AnalyzedTokenReadings tk)private static booleanMultipleWhitespaceRule. isRemovableWhite(AnalyzedTokenReadings token)protected booleanAbstractSimpleReplaceRule. isTagged(AnalyzedTokenReadings tokenReadings)This method allows to override which tags will mark token as taggedprivate booleanAbstractStyleRepeatedWordRule. isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens)private booleanAbstractStyleRepeatedWordRule. isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens, int notCheck)protected abstract booleanAbstractStyleRepeatedWordRule. isTokenPair(AnalyzedTokenReadings[] tokens, int n, boolean before)protected abstract booleanAbstractStyleRepeatedWordRule. isTokenToCheck(AnalyzedTokenReadings token)private booleanWhiteSpaceAtBeginOfParagraph. isWhitespaceDel(AnalyzedTokenReadings token)private static booleanCommaWhitespaceRule. isWhitespaceToken(AnalyzedTokenReadings token)private static booleanPunctuationMarkAtParagraphEnd. isWord(AnalyzedTokenReadings tk)private intParagraphRepeatBeginningRule. numCharEqualBeginning(AnalyzedTokenReadings[] lastTokens, AnalyzedTokenReadings[] nextTokens)protected java.net.URLAbstractStyleRepeatedWordRule. setURL(AnalyzedTokenReadings token)Method parameters in org.languagetool.rules with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description private voidAbstractCompoundRule. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)private voidAbstractSimpleReplaceRule2. addToQueue(AnalyzedTokenReadings token, java.util.Queue<AnalyzedTokenReadings> prevTokens)private java.util.Map<java.lang.String,AnalyzedTokenReadings>AbstractCompoundRule. getStringToTokenMap(java.util.Queue<AnalyzedTokenReadings> prevTokens, java.util.List<java.lang.String> stringsToCheck, java.util.List<java.lang.String> origStringsToCheck)private booleanPartialPosTagFilter. partialTagHasRequiredTag(java.util.List<AnalyzedTokenReadings> tags, java.lang.String requiredTagRegexp, boolean negatePos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.neuralnetwork
Methods in org.languagetool.rules.neuralnetwork with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private @NotNull RuleMatchNeuralNetworkRule. createRuleMatch(AnalyzedTokenReadings token, Suggestion suggestion, float[] y, AnalyzedSentence sentence)private @NotNull java.lang.String[]NeuralNetworkRule. getContext(AnalyzedTokenReadings[] tokens, int center)private static java.lang.StringNeuralNetworkRule. safeGetToken(AnalyzedTokenReadings[] arr, int i) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.patterns
Fields in org.languagetool.rules.patterns declared as AnalyzedTokenReadings Modifier and Type Field Description private AnalyzedTokenReadingsMatchState. formattedTokenprivate AnalyzedTokenReadingsMatchState. matchedTokenprotected AnalyzedTokenReadings[]AbstractPatternRulePerformer. unifiedTokensFields in org.languagetool.rules.patterns with type parameters of type AnalyzedTokenReadings Modifier and Type Field Description private java.util.List<AnalyzedTokenReadings>Unifier. tokSequenceMethods in org.languagetool.rules.patterns that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadingsMatchState. filterReadings()@Nullable AnalyzedTokenReadings[]Unifier. getFinalUnified()Used for getting a unified sequence in case when simple test methodUnifier.isUnified(AnalyzedToken, Map, boolean)} was used.@Nullable AnalyzedTokenReadings[]Unifier. getUnifiedTokens()Gets a full sequence of filtered tokens.Methods in org.languagetool.rules.patterns with parameters of type AnalyzedTokenReadings Modifier and Type Method Description abstract @Nullable RuleMatchRuleFilter. acceptRuleMatch(RuleMatch match, java.util.Map<java.lang.String,java.lang.String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens)Returns the original rule match or a modified one, ornullif the rule match is filtered out.voidUnifier. addNeutralElement(AnalyzedTokenReadings analyzedTokenReadings)Used to add neutral elements (AnalyzedTokenReadingsto the unified sequence.PatternTokenPatternToken. compile(AnalyzedTokenReadings token, Synthesizer synth)Prepare PatternToken for matching by formatting its string token and POS (if the Element is supposed to refer to some other token).private java.lang.String[]PatternRuleMatcher. concatMatches(int start, int index, int tokenIndex, AnalyzedTokenReadings[] tokens, int nextTokenPos, java.util.List<Match> suggestionMatches)Concatenates the matches, and takes care of phrases (including inflection using synthesis).private @Nullable RuleMatchPatternRuleMatcher. createRuleMatch(java.util.List<java.lang.Integer> tokenPositions, AnalyzedTokenReadings[] tokens, int firstMatchToken, int lastMatchToken, int firstMarkerMatchToken, int lastMarkerMatchToken, AnalyzedSentence sentence)MatchStateMatch. createState(Synthesizer synthesizer, AnalyzedTokenReadings token)Creates a state used for actually matching a token.MatchStateMatch. createState(Synthesizer synthesizer, AnalyzedTokenReadings[] tokens, int index, int next)Creates a state used for actually matching a token.private voidPatternToken. doCompile(AnalyzedTokenReadings token, Synthesizer synth)private java.lang.StringPatternRuleMatcher. formatMatches(AnalyzedTokenReadings[] tokenReadings, java.util.List<java.lang.Integer> positions, int firstMatchTok, java.lang.String errorMsg, java.util.List<Match> suggestionMatches)Replace back references generated with <match> and \\1 in message using Match class, and take care of skipping.java.util.Map<java.lang.String,java.lang.String>RuleFilterEvaluator. getResolvedArguments(java.lang.String filterArgs, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, java.util.List<java.lang.Integer> tokenPositions)Resolves the backref arguments, e.g.booleanPatternToken. isMatchedByPreviousException(AnalyzedTokenReadings prevToken)Checks whether an exception for a previous token matches all readings of a given token (in case the exception had scope == "previous").booleanPatternTokenMatcher. isMatchedByPreviousException(AnalyzedTokenReadings token)booleanRuleFilter. matches(java.util.Map<java.lang.String,java.lang.String> arguments, AnalyzedTokenReadings[] patternTokens, int firstMatchToken)(package private) voidPatternTokenMatcher. prepareAndGroup(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language)voidPatternTokenMatcher. resolveReference(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language)@Nullable RuleMatchRuleFilterEvaluator. runFilter(java.lang.String filterArgs, RuleMatch ruleMatch, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, java.util.List<java.lang.Integer> tokenPositions)voidMatchState. setToken(AnalyzedTokenReadings token)voidMatchState. setToken(AnalyzedTokenReadings[] tokens, int index, int next)Sets the token to be formatted etc.protected intAbstractPatternRulePerformer. skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher elem, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems)protected booleanAbstractPatternRulePerformer. testAllReadings(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, PatternTokenMatcher prevElement, int tokenNo, int firstMatchToken, int prevSkipNext)Method parameters in org.languagetool.rules.patterns with type arguments of type AnalyzedTokenReadings Modifier and Type Method Description private voidUnifier. addTokenToSequence(java.util.List<AnalyzedTokenReadings> tokenSequence, AnalyzedToken token, int pos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling
Methods in org.languagetool.rules.spelling with parameters of type AnalyzedTokenReadings Modifier and Type Method Description protected booleanSpellingCheckRule. ignoreToken(AnalyzedTokenReadings[] tokens, int idx)Returns true iff the token at the given position should be ignored by the spell checker. -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling.morfologik
Methods in org.languagetool.rules.spelling.morfologik with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private booleanMorfologikSpellerRule. canBeIgnored(AnalyzedTokenReadings[] tokens, int idx, AnalyzedTokenReadings token)protected java.util.List<RuleMatch>MorfologikSpellerRule. getRuleMatches(java.lang.String word, int startPos, AnalyzedSentence sentence, java.util.List<RuleMatch> ruleMatchesSoFar, int idx, AnalyzedTokenReadings[] tokens) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging
Methods in org.languagetool.tagging that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadingsBaseTagger. createNullToken(java.lang.String token, int startPos)AnalyzedTokenReadingsTagger. createNullToken(java.lang.String token, int startPos)Create the AnalyzedToken used for whitespace and other non-words.Methods in org.languagetool.tagging that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description java.util.List<AnalyzedTokenReadings>BaseTagger. tag(java.util.List<java.lang.String> sentenceTokens)java.util.List<AnalyzedTokenReadings>Tagger. tag(java.util.List<java.lang.String> sentenceTokens)Returns a list ofAnalyzedTokens that assigns each term in the sentence some kind of part-of-speech information (not necessarily just one tag). -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation
Methods in org.languagetool.tagging.disambiguation that return AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadingsMultiWordChunker. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, boolean isLast)protected AnalyzedTokenReadingsMultiWordChunker2. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, java.lang.String tag)private AnalyzedTokenReadingsMultiWordChunker. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)private AnalyzedTokenReadingsMultiWordChunker2. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)Methods in org.languagetool.tagging.disambiguation with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private MultiWordChunker2.MultiWordEntryMultiWordChunker2. findMultiwordEntry(AnalyzedTokenReadings[] inputTokens, int startingPosition, java.util.List<MultiWordChunker2.MultiWordEntry> multiwordItems)private booleanMultiWordChunker2. isMatching(AnalyzedTokenReadings[] inputTokens, int startingPosition, MultiWordChunker2.MultiWordEntry multiWordEntry)protected booleanMultiWordChunker2. matches(java.lang.String matchText, AnalyzedTokenReadings inputTokens)private AnalyzedTokenReadingsMultiWordChunker. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, boolean isLast)protected AnalyzedTokenReadingsMultiWordChunker2. prepareNewReading(java.lang.String tokens, java.lang.String tok, AnalyzedTokenReadings token, java.lang.String tag)private AnalyzedTokenReadingsMultiWordChunker. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading)private AnalyzedTokenReadingsMultiWordChunker2. setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation.rules
Methods in org.languagetool.tagging.disambiguation.rules that return AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadings[]DisambiguationPatternRuleReplacer. executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions)Methods in org.languagetool.tagging.disambiguation.rules with parameters of type AnalyzedTokenReadings Modifier and Type Method Description private AnalyzedTokenReadings[]DisambiguationPatternRuleReplacer. executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions)private booleanDisambiguationPatternRuleReplacer. keepDespiteFilter(AnalyzedTokenReadings[] tokens, int[] tokenPositions, int firstMatchToken, int lastMatchToken)protected intDisambiguationPatternRuleReplacer. skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.xx
Methods in org.languagetool.tagging.xx that return AnalyzedTokenReadings Modifier and Type Method Description AnalyzedTokenReadingsDemoTagger. createNullToken(java.lang.String token, int startPos)Methods in org.languagetool.tagging.xx that return types with arguments of type AnalyzedTokenReadings Modifier and Type Method Description java.util.List<AnalyzedTokenReadings>DemoTagger. tag(java.util.List<java.lang.String> sentenceTokens)
-