Package com.kohlschutter.boilerpipe.extractors

Class ExtractorBase

java.lang.Object

com.kohlschutter.boilerpipe.extractors.ExtractorBase

All Implemented Interfaces:

BoilerpipeExtractor, BoilerpipeFilter

Direct Known Subclasses:

ArticleExtractor, ArticleSentencesExtractor, CanolaExtractor, DefaultExtractor, KeepEverythingExtractor, KeepEverythingWithMinKWordsExtractor, LargestContentExtractor, NumWordsRulesExtractor

public abstract class ExtractorBase
extends Object
implements BoilerpipeExtractor

The base class of Extractors. Also provides some helper methods to quickly retrieve the text that remained after processing.

Constructor Summary

Constructors

Constructor	Description
ExtractorBase()

Method Summary

Modifier and Type	Method	Description
String	getText(TextDocument doc)	Extracts text from the given TextDocument object.
String	getText(Reader r)	Extracts text from the HTML code available from the given Reader.
String	getText(String html)	Extracts text from the HTML code given as a String.
String	getText(URL url)	Extracts text from the HTML code available from the given URL.
String	getText(InputSource is)	Extracts text from the HTML code available from the given InputSource.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.kohlschutter.boilerpipe.BoilerpipeFilter

process

Constructor Details

ExtractorBase

public ExtractorBase()

Method Details

getText

public String getText(String html)
               throws BoilerpipeProcessingException

Extracts text from the HTML code given as a String.

Specified by:

getText in interface BoilerpipeExtractor

Parameters:

html - The HTML code as a String.

Returns:

The extracted text.

Throws:

BoilerpipeProcessingException

getText

public String getText(InputSource is)
               throws BoilerpipeProcessingException

Extracts text from the HTML code available from the given InputSource.

Specified by:

getText in interface BoilerpipeExtractor

Parameters:

is - The InputSource containing the HTML

Returns:

The extracted text.

Throws:

BoilerpipeProcessingException

getText

public String getText(URL url)
               throws BoilerpipeProcessingException

Extracts text from the HTML code available from the given URL. NOTE: This method is mainly to be used for show case purposes. If you are going to crawl the Web, consider using getText(InputSource) instead.

Parameters:

url - The URL pointing to the HTML code.

Returns:

The extracted text.

Throws:

BoilerpipeProcessingException

getText

public String getText(Reader r)
               throws BoilerpipeProcessingException

Extracts text from the HTML code available from the given Reader.

Specified by:

getText in interface BoilerpipeExtractor

Parameters:

r - The Reader containing the HTML

Returns:

The extracted text.

Throws:

BoilerpipeProcessingException

getText

public String getText(TextDocument doc)
               throws BoilerpipeProcessingException

Extracts text from the given TextDocument object.

Specified by:

getText in interface BoilerpipeExtractor

Parameters:

doc - The TextDocument.

Returns:

The extracted text.

Throws:

BoilerpipeProcessingException