Uses of Class
org.languagetool.AnalyzedTokenReadings
Packages that use AnalyzedTokenReadings
Package
Description
-
Uses of AnalyzedTokenReadings in org.languagetool
Fields in org.languagetool declared as AnalyzedTokenReadingsModifier and TypeFieldDescriptionprivate final AnalyzedTokenReadings[]AnalyzedSentence.nonBlankPreDisambigTokensprivate final AnalyzedTokenReadings[]AnalyzedSentence.nonBlankTokensprivate final AnalyzedTokenReadings[]AnalyzedSentence.preDisambigTokensprivate final AnalyzedTokenReadings[]AnalyzedSentence.tokensMethods in org.languagetool that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionAnalyzedSentence.getPreDisambigTokens()AnalyzedSentence.getPreDisambigTokensWithoutWhitespace()AnalyzedSentence.getTokens()Returns theAnalyzedTokenReadingsof the analyzed text.AnalyzedSentence.getTokensWithoutWhitespace()Returns theAnalyzedTokenReadingsof the analyzed text, with whitespace tokens removed but with the artificialSENT_STARTtoken included.Methods in org.languagetool that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate @NotNull List<AnalyzedTokenReadings> AnalyzedSentence.getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping) Methods in org.languagetool with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionAnalyzedSentence.getLemmaSet(AnalyzedTokenReadings[] tokens) private @NotNull List<AnalyzedTokenReadings> AnalyzedSentence.getNonBlankReadings(AnalyzedTokenReadings[] tokens, int whCounter, int nonWhCounter, int[] mapping) AnalyzedSentence.getTokenSet(AnalyzedTokenReadings[] tokens) Constructors in org.languagetool with parameters of type AnalyzedTokenReadingsModifierConstructorDescriptionAnalyzedSentence(AnalyzedTokenReadings[] tokens) Creates an AnalyzedSentence from the givenAnalyzedTokenReadings.privateAnalyzedSentence(AnalyzedTokenReadings[] tokens, int[] mapping, AnalyzedTokenReadings[] nonBlankTokens, AnalyzedTokenReadings[] nonBlankPreDisambigTokens) AnalyzedSentence(AnalyzedTokenReadings[] tokens, AnalyzedTokenReadings[] preDisambigTokens) AnalyzedTokenReadings(AnalyzedTokenReadings oldAtr, List<AnalyzedToken> newReadings, String ruleApplied) -
Uses of AnalyzedTokenReadings in org.languagetool.chunking
Method parameters in org.languagetool.chunking with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionvoidChunker.addChunkTags(List<AnalyzedTokenReadings> sentenceTokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.noop
Method parameters in org.languagetool.noop with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionvoidNoopChunker.addChunkTags(List<AnalyzedTokenReadings> tokenReadings) -
Uses of AnalyzedTokenReadings in org.languagetool.rules
Methods in org.languagetool.rules that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate Map<String, AnalyzedTokenReadings> AbstractCompoundRule.getStringToTokenMap(Queue<AnalyzedTokenReadings> prevTokens, List<String> stringsToCheck, List<String> origStringsToCheck) protected abstract @Nullable List<AnalyzedTokenReadings> Methods in org.languagetool.rules with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionAbstractDateCheckFilter.acceptRuleMatch(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) AbstractFutureDateFilter.acceptRuleMatch(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) AbstractNewYearDateFilter.acceptRuleMatch(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) @Nullable RuleMatchDateRangeChecker.acceptRuleMatch(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) PartialPosTagFilter.acceptRuleMatch(RuleMatch match, Map<String, String> args, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) @Nullable RuleMatchShortenedYearRangeChecker.acceptRuleMatch(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) WhitespaceCheckFilter.acceptRuleMatch(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) private voidAbstractCompoundRule.addToQueue(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private voidAbstractSimpleReplaceRule2.addToQueue(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) protected RuleMatchAbstractSimpleReplaceRule.createRuleMatch(AnalyzedTokenReadings tokenReadings, List<String> replacements, AnalyzedSentence sentence) private @Nullable StringUppercaseSentenceStartRule.dutchSpecialCase(String firstToken, String secondToken, AnalyzedTokenReadings[] tokens) private booleanGenericUnpairedBracketsRule.fillSymbolStack(int startPosBase, AnalyzedTokenReadings[] tokens, int i, int j, UnsyncStack<SymbolLocator> symbolStack, AnalyzedSentence sentence) AbstractSimpleReplaceRule.findMatches(AnalyzedTokenReadings tokenReadings, AnalyzedSentence sentence) private booleanGenericUnpairedBracketsRule.getFollowedByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j) private booleanGenericUnpairedBracketsRule.getPrecededByWhitespace(AnalyzedTokenReadings[] tokens, int i, int j) AbstractStyleRepeatedWordRule.getSynonyms(AnalyzedTokenReadings token) get synonyms for a repeated wordprivate static booleanAbstractStyleRepeatedWordRule.hasBreakToken(AnalyzedTokenReadings[] tokens) booleanWordRepeatRule.ignore(AnalyzedTokenReadings[] tokens, int position) Implement this method to returntrueif there's a potential word repetition at the current position that should be ignored, i.e.protected booleanWordRepeatBeginningRule.isAdverb(AnalyzedTokenReadings token) booleanParagraphRepeatBeginningRule.isArticle(AnalyzedTokenReadings token) protected booleanAbstractFillerWordsRule.isException(AnalyzedTokenReadings[] tokens, int num) private static booleanMultipleWhitespaceRule.isFirstWhite(AnalyzedTokenReadings token) protected booleanGenericUnpairedBracketsRule.isNoException(String token, AnalyzedTokenReadings[] tokens, int i, int j, boolean precSpace, boolean follSpace, UnsyncStack<SymbolLocator> symbolStack) Generic method to specify an exception.private static booleanPunctuationMarkAtParagraphEnd.isPunctuationMark(AnalyzedTokenReadings tk) private static booleanPunctuationMarkAtParagraphEnd.isQuotationMark(AnalyzedTokenReadings tk) private static booleanMultipleWhitespaceRule.isRemovableWhite(AnalyzedTokenReadings token) protected booleanAbstractSimpleReplaceRule.isTagged(AnalyzedTokenReadings tokenReadings) This method allows to override which tags will mark token as taggedprivate booleanAbstractStyleRepeatedWordRule.isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens) private booleanAbstractStyleRepeatedWordRule.isTokenInSentence(AnalyzedTokenReadings testToken, AnalyzedTokenReadings[] tokens, int notCheck) protected abstract booleanAbstractStyleRepeatedWordRule.isTokenPair(AnalyzedTokenReadings[] tokens, int n, boolean before) protected abstract booleanAbstractStyleRepeatedWordRule.isTokenToCheck(AnalyzedTokenReadings token) private booleanWhiteSpaceAtBeginOfParagraph.isWhitespaceDel(AnalyzedTokenReadings token) private static booleanCommaWhitespaceRule.isWhitespaceToken(AnalyzedTokenReadings token) private static booleanPunctuationMarkAtParagraphEnd.isWord(AnalyzedTokenReadings tk) private intParagraphRepeatBeginningRule.numCharEqualBeginning(AnalyzedTokenReadings[] lastTokens, AnalyzedTokenReadings[] nextTokens) protected URLAbstractStyleRepeatedWordRule.setURL(AnalyzedTokenReadings token) Method parameters in org.languagetool.rules with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate voidAbstractCompoundRule.addToQueue(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private voidAbstractSimpleReplaceRule2.addToQueue(AnalyzedTokenReadings token, Queue<AnalyzedTokenReadings> prevTokens) private Map<String, AnalyzedTokenReadings> AbstractCompoundRule.getStringToTokenMap(Queue<AnalyzedTokenReadings> prevTokens, List<String> stringsToCheck, List<String> origStringsToCheck) private booleanPartialPosTagFilter.partialTagHasRequiredTag(List<AnalyzedTokenReadings> tags, String requiredTagRegexp, boolean negatePos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.neuralnetwork
Methods in org.languagetool.rules.neuralnetwork with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate @NotNull RuleMatchNeuralNetworkRule.createRuleMatch(AnalyzedTokenReadings token, Suggestion suggestion, float[] y, AnalyzedSentence sentence) private @NotNull String[]NeuralNetworkRule.getContext(AnalyzedTokenReadings[] tokens, int center) private static StringNeuralNetworkRule.safeGetToken(AnalyzedTokenReadings[] arr, int i) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.patterns
Fields in org.languagetool.rules.patterns declared as AnalyzedTokenReadingsModifier and TypeFieldDescriptionprivate AnalyzedTokenReadingsMatchState.formattedTokenprivate AnalyzedTokenReadingsMatchState.matchedTokenprotected AnalyzedTokenReadings[]AbstractPatternRulePerformer.unifiedTokensFields in org.languagetool.rules.patterns with type parameters of type AnalyzedTokenReadingsMethods in org.languagetool.rules.patterns that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionfinal AnalyzedTokenReadingsMatchState.filterReadings()final @Nullable AnalyzedTokenReadings[]Unifier.getFinalUnified()Used for getting a unified sequence in case when simple test methodUnifier.isUnified(AnalyzedToken, Map, boolean)} was used.final @Nullable AnalyzedTokenReadings[]Unifier.getUnifiedTokens()Gets a full sequence of filtered tokens.Methods in org.languagetool.rules.patterns with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionabstract @Nullable RuleMatchRuleFilter.acceptRuleMatch(RuleMatch match, Map<String, String> arguments, int patternTokenPos, AnalyzedTokenReadings[] patternTokens) Returns the original rule match or a modified one, ornullif the rule match is filtered out.final voidUnifier.addNeutralElement(AnalyzedTokenReadings analyzedTokenReadings) Used to add neutral elements (AnalyzedTokenReadingsto the unified sequence.PatternToken.compile(AnalyzedTokenReadings token, Synthesizer synth) Prepare PatternToken for matching by formatting its string token and POS (if the Element is supposed to refer to some other token).private String[]PatternRuleMatcher.concatMatches(int start, int index, int tokenIndex, AnalyzedTokenReadings[] tokens, int nextTokenPos, List<Match> suggestionMatches) Concatenates the matches, and takes care of phrases (including inflection using synthesis).private @Nullable RuleMatchPatternRuleMatcher.createRuleMatch(List<Integer> tokenPositions, AnalyzedTokenReadings[] tokens, int firstMatchToken, int lastMatchToken, int firstMarkerMatchToken, int lastMarkerMatchToken, AnalyzedSentence sentence) Match.createState(Synthesizer synthesizer, AnalyzedTokenReadings token) Creates a state used for actually matching a token.Match.createState(Synthesizer synthesizer, AnalyzedTokenReadings[] tokens, int index, int next) Creates a state used for actually matching a token.private voidPatternToken.doCompile(AnalyzedTokenReadings token, Synthesizer synth) private StringPatternRuleMatcher.formatMatches(AnalyzedTokenReadings[] tokenReadings, List<Integer> positions, int firstMatchTok, String errorMsg, List<Match> suggestionMatches) Replace back references generated with <match> and \\1 in message using Match class, and take care of skipping.RuleFilterEvaluator.getResolvedArguments(String filterArgs, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, List<Integer> tokenPositions) Resolves the backref arguments, e.g.booleanPatternToken.isMatchedByPreviousException(AnalyzedTokenReadings prevToken) Checks whether an exception for a previous token matches all readings of a given token (in case the exception had scope == "previous").booleanPatternTokenMatcher.isMatchedByPreviousException(AnalyzedTokenReadings token) booleanRuleFilter.matches(Map<String, String> arguments, AnalyzedTokenReadings[] patternTokens, int firstMatchToken) (package private) voidPatternTokenMatcher.prepareAndGroup(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language) voidPatternTokenMatcher.resolveReference(int firstMatchToken, AnalyzedTokenReadings[] tokens, Language language) @Nullable RuleMatchRuleFilterEvaluator.runFilter(String filterArgs, RuleMatch ruleMatch, AnalyzedTokenReadings[] patternTokens, int patternTokenPos, List<Integer> tokenPositions) voidMatchState.setToken(AnalyzedTokenReadings token) final voidMatchState.setToken(AnalyzedTokenReadings[] tokens, int index, int next) Sets the token to be formatted etc.protected intAbstractPatternRulePerformer.skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher elem, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems) protected booleanAbstractPatternRulePerformer.testAllReadings(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, PatternTokenMatcher prevElement, int tokenNo, int firstMatchToken, int prevSkipNext) Method parameters in org.languagetool.rules.patterns with type arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate voidUnifier.addTokenToSequence(List<AnalyzedTokenReadings> tokenSequence, AnalyzedToken token, int pos) -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling
Methods in org.languagetool.rules.spelling with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprotected booleanSpellingCheckRule.ignoreToken(AnalyzedTokenReadings[] tokens, int idx) Returns true iff the token at the given position should be ignored by the spell checker. -
Uses of AnalyzedTokenReadings in org.languagetool.rules.spelling.morfologik
Methods in org.languagetool.rules.spelling.morfologik with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate booleanMorfologikSpellerRule.canBeIgnored(AnalyzedTokenReadings[] tokens, int idx, AnalyzedTokenReadings token) MorfologikSpellerRule.getRuleMatches(String word, int startPos, AnalyzedSentence sentence, List<RuleMatch> ruleMatchesSoFar, int idx, AnalyzedTokenReadings[] tokens) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging
Methods in org.languagetool.tagging that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionfinal AnalyzedTokenReadingsBaseTagger.createNullToken(String token, int startPos) Tagger.createNullToken(String token, int startPos) Create the AnalyzedToken used for whitespace and other non-words.Methods in org.languagetool.tagging that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionReturns a list ofAnalyzedTokens that assigns each term in the sentence some kind of part-of-speech information (not necessarily just one tag). -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation
Methods in org.languagetool.tagging.disambiguation that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadingsMultiWordChunker.prepareNewReading(String tokens, String tok, AnalyzedTokenReadings token, boolean isLast) protected AnalyzedTokenReadingsMultiWordChunker2.prepareNewReading(String tokens, String tok, AnalyzedTokenReadings token, String tag) private AnalyzedTokenReadingsMultiWordChunker.setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) private AnalyzedTokenReadingsMultiWordChunker2.setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) Methods in org.languagetool.tagging.disambiguation with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate MultiWordChunker2.MultiWordEntryMultiWordChunker2.findMultiwordEntry(AnalyzedTokenReadings[] inputTokens, int startingPosition, List<MultiWordChunker2.MultiWordEntry> multiwordItems) private booleanMultiWordChunker2.isMatching(AnalyzedTokenReadings[] inputTokens, int startingPosition, MultiWordChunker2.MultiWordEntry multiWordEntry) protected booleanMultiWordChunker2.matches(String matchText, AnalyzedTokenReadings inputTokens) private AnalyzedTokenReadingsMultiWordChunker.prepareNewReading(String tokens, String tok, AnalyzedTokenReadings token, boolean isLast) protected AnalyzedTokenReadingsMultiWordChunker2.prepareNewReading(String tokens, String tok, AnalyzedTokenReadings token, String tag) private AnalyzedTokenReadingsMultiWordChunker.setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) private AnalyzedTokenReadingsMultiWordChunker2.setAndAnnotate(AnalyzedTokenReadings oldReading, AnalyzedToken newReading) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.disambiguation.rules
Methods in org.languagetool.tagging.disambiguation.rules that return AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadings[]DisambiguationPatternRuleReplacer.executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions) Methods in org.languagetool.tagging.disambiguation.rules with parameters of type AnalyzedTokenReadingsModifier and TypeMethodDescriptionprivate AnalyzedTokenReadings[]DisambiguationPatternRuleReplacer.executeAction(AnalyzedSentence sentence, AnalyzedTokenReadings[] whiteTokens, AnalyzedTokenReadings[] unifiedTokens, int firstMatchToken, int lastMatchToken, int matchingTokens, int[] tokenPositions) private booleanDisambiguationPatternRuleReplacer.keepDespiteFilter(AnalyzedTokenReadings[] tokens, int[] tokenPositions, int firstMatchToken, int lastMatchToken) protected intDisambiguationPatternRuleReplacer.skipMaxTokens(AnalyzedTokenReadings[] tokens, PatternTokenMatcher matcher, int firstMatchToken, int prevSkipNext, PatternTokenMatcher prevElement, int m, int remainingElems) -
Uses of AnalyzedTokenReadings in org.languagetool.tagging.xx
Methods in org.languagetool.tagging.xx that return AnalyzedTokenReadingsMethods in org.languagetool.tagging.xx that return types with arguments of type AnalyzedTokenReadingsModifier and TypeMethodDescription