Uses of Interface
com.kohlschutter.boilerpipe.BoilerpipeFilter

Packages that use BoilerpipeFilter

Package	Description
com.kohlschutter.boilerpipe	The Boilerpipe top-level package.
com.kohlschutter.boilerpipe.extractors	Some standard extractors (i.e., completely piped BoilerpipeFilters)
com.kohlschutter.boilerpipe.filters.debug
com.kohlschutter.boilerpipe.filters.english	These BoilerpipeFilters have only been tested on English text.
com.kohlschutter.boilerpipe.filters.heuristics	These BoilerpipeFilters are pure heuristics.
com.kohlschutter.boilerpipe.filters.simple	These BoilerpipeFilters are straight-forward and probably not really specific to English.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe

Subinterfaces of BoilerpipeFilter in com.kohlschutter.boilerpipe

Modifier and Type	Interface	Description
interface	BoilerpipeExtractor	Describes a complete filter pipeline.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe.extractors

Classes in com.kohlschutter.boilerpipe.extractors that implement BoilerpipeFilter

Modifier and Type	Class	Description
final class	ArticleExtractor	A full-text extractor which is tuned towards news articles.
final class	ArticleSentencesExtractor	A full-text extractor which is tuned towards extracting sentences from news articles.
class	CanolaExtractor	A full-text extractor trained on krdwrd Canola .
class	DefaultExtractor	A quite generic full-text extractor.
class	ExtractorBase	The base class of Extractors.
final class	KeepEverythingExtractor	Marks everything as content.
final class	KeepEverythingWithMinKWordsExtractor	A full-text extractor which extracts the largest text component of a page.
final class	LargestContentExtractor	A full-text extractor which extracts the largest text component of a page.
class	NumWordsRulesExtractor	A quite generic full-text extractor solely based upon the number of words per block (the current, the previous and the next block).

Fields in com.kohlschutter.boilerpipe.extractors declared as BoilerpipeFilter

Modifier and Type	Field	Description
static final BoilerpipeFilter	CanolaExtractor.CLASSIFIER	The actual classifier, exposed.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe.filters.debug

Classes in com.kohlschutter.boilerpipe.filters.debug that implement BoilerpipeFilter

Modifier and Type	Class	Description
final class	PrintDebugFilter	Prints debug information about the current state of the TextDocument.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe.filters.english

Classes in com.kohlschutter.boilerpipe.filters.english that implement BoilerpipeFilter

Modifier and Type	Class	Description
class	DensityRulesClassifier	Classifies TextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features", particularly using text densities and link densities.
final class	IgnoreBlocksAfterContentFilter	Marks all blocks as "non-content" that occur after blocks that have been marked DefaultLabels.INDICATES_END_OF_TEXT.
final class	IgnoreBlocksAfterContentFromEndFilter	Marks all blocks as "non-content" that occur after blocks that have been marked DefaultLabels.INDICATES_END_OF_TEXT, and after any content block.
final class	KeepLargestFulltextBlockFilter	Keeps the largest TextBlock only (by the number of words).
final class	MinFulltextWordsFilter	Keeps only those content blocks which contain at least k full-text words (measured by HeuristicFilterBase.getNumFullTextWords(TextBlock)).
class	NumWordsRulesClassifier	Classifies TextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features" (WSDM 2010), particularly using number of words per block and link density per block.
class	TerminatingBlocksFinder	Finds blocks which are potentially indicating the end of an article text and marks them with DefaultLabels.INDICATES_END_OF_TEXT.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe.filters.heuristics

Classes in com.kohlschutter.boilerpipe.filters.heuristics that implement BoilerpipeFilter

Modifier and Type	Class	Description
final class	AddPrecedingLabelsFilter	Adds the labels of the preceding block to the current block, optionally adding a prefix.
class	ArticleMetadataFilter	Tries to find TextBlocks that comprise of "article metadata".
final class	BlockProximityFusion	Fuses adjacent blocks if their distance (in blocks) does not exceed a certain limit.
final class	ContentFusion	Merges two blocks using some heuristics.
final class	DocumentTitleMatchClassifier	Marks TextBlocks which contain parts of the HTML <TITLE> tag, using some heuristics which are quite specific to the news domain.
final class	ExpandTitleToContentFilter	Marks all TextBlocks "content" which are between the headline and the part that has already been marked content, if they are marked DefaultLabels.MIGHT_BE_CONTENT.
final class	KeepLargestBlockFilter	Keeps the largest TextBlock only (by the number of words).
final class	LabelFusion	Fuses adjacent blocks if their labels are equal.
final class	LargeBlockSameTagLevelToContentFilter	Marks all blocks as content that: are on the same tag-level as very likely main content (usually the level of the largest block) have a significant number of words, currently: at least 100
final class	ListAtEndFilter	Marks nested list-item blocks after the end of the main content.
class	SimpleBlockFusionProcessor	Merges two subsequent blocks if their text densities are equal.
final class	TrailingHeadlineToBoilerplateFilter	Marks trailing headlines (TextBlocks that have the label DefaultLabels.HEADING) as boilerplate.

Uses of BoilerpipeFilter in com.kohlschutter.boilerpipe.filters.simple

Classes in com.kohlschutter.boilerpipe.filters.simple that implement BoilerpipeFilter

Modifier and Type	Class	Description
final class	BoilerplateBlockFilter	Removes TextBlocks which have explicitly been marked as "not content".
final class	InvertedFilter	Reverts the "isContent" flag for all TextBlocks
final class	LabelToBoilerplateFilter	Marks all blocks that contain a given label as "boilerplate".
final class	LabelToContentFilter	Marks all blocks that contain a given label as "content".
final class	MarkEverythingBoilerplateFilter	Marks all blocks as boilerplate.
final class	MarkEverythingContentFilter	Marks all blocks as content.
final class	MinClauseWordsFilter	Keeps only blocks that have at least one segment fragment ("clause") with at least k words (default: 5).
final class	MinWordsFilter	Keeps only those content blocks which contain at least k words.
final class	SplitParagraphBlocksFilter	Splits TextBlocks at paragraph boundaries.
class	SurroundingToContentFilter	Marks blocks as "content" if their preceding and following blocks are both already marked "content", and the given TextBlockCondition is met.