Package com.kohlschutter.boilerpipe.filters.heuristics

Class DocumentTitleMatchClassifier

java.lang.Object

com.kohlschutter.boilerpipe.filters.heuristics.DocumentTitleMatchClassifier

All Implemented Interfaces:

BoilerpipeFilter

public final class DocumentTitleMatchClassifier
extends Object
implements BoilerpipeFilter

Marks TextBlocks which contain parts of the HTML <TITLE> tag, using some heuristics which are quite specific to the news domain.

Field Summary

Fields

Modifier and Type	Field	Description
private static final Pattern	PAT_REMOVE_CHARACTERS
private final Set<String>	potentialTitles

Constructor Summary

Constructors

Constructor	Description
DocumentTitleMatchClassifier(String title)

Method Summary

Modifier and Type	Method	Description
private void	addPotentialTitles(Set<String> potentialTitles, String title, String pattern, int minWords)
private String	getLongestPart(String title, String pattern)
Set<String>	getPotentialTitles()
boolean	process(TextDocument doc)	Processes the given document doc.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

potentialTitles

private final Set<String> potentialTitles

PAT_REMOVE_CHARACTERS

private static final Pattern PAT_REMOVE_CHARACTERS

Constructor Details

DocumentTitleMatchClassifier

public DocumentTitleMatchClassifier(String title)

Method Details

getPotentialTitles

public Set<String> getPotentialTitles()

addPotentialTitles

private void addPotentialTitles(Set<String> potentialTitles,
 String title,
 String pattern,
 int minWords)

getLongestPart

private String getLongestPart(String title,
 String pattern)

process

public boolean process(TextDocument doc)
                throws BoilerpipeProcessingException

Description copied from interface: BoilerpipeFilter

Processes the given document doc.

Specified by:

process in interface BoilerpipeFilter

Parameters:

doc - The TextDocument that is to be processed.

Returns:

true if changes have been made to the TextDocument.

Throws:

BoilerpipeProcessingException