Class NumWordsRulesClassifier

java.lang.Object

com.kohlschutter.boilerpipe.filters.english.NumWordsRulesClassifier

All Implemented Interfaces:

BoilerpipeFilter

public class NumWordsRulesClassifier
extends Object
implements BoilerpipeFilter

Classifies TextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features" (WSDM 2010), particularly using number of words per block and link density per block.

Field Summary

Fields

Modifier and Type	Field	Description
static final NumWordsRulesClassifier	INSTANCE

Constructor Summary

Constructors

Constructor	Description
NumWordsRulesClassifier()

Method Summary

Modifier and Type	Method	Description
protected boolean	classify(TextBlock prev, TextBlock curr, TextBlock next)
static NumWordsRulesClassifier	getInstance()	Returns the singleton instance for RulebasedBoilerpipeClassifier.
boolean	process(TextDocument doc)	Processes the given document doc.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

INSTANCE

public static final NumWordsRulesClassifier INSTANCE

Constructor Details

NumWordsRulesClassifier

public NumWordsRulesClassifier()

Method Details

getInstance

public static NumWordsRulesClassifier getInstance()

Returns the singleton instance for RulebasedBoilerpipeClassifier.

process

public boolean process(TextDocument doc)
                throws BoilerpipeProcessingException

Description copied from interface: BoilerpipeFilter

Processes the given document doc.

Specified by:

process in interface BoilerpipeFilter

Parameters:

doc - The TextDocument that is to be processed.

Returns:

true if changes have been made to the TextDocument.

Throws:

BoilerpipeProcessingException

classify

protected boolean classify(TextBlock prev,
 TextBlock curr,
 TextBlock next)