Package com.kohlschutter.boilerpipe.sax

Class BoilerpipeHTMLContentHandler

java.lang.Object

com.kohlschutter.boilerpipe.sax.BoilerpipeHTMLContentHandler

All Implemented Interfaces:

org.xml.sax.ContentHandler

public class BoilerpipeHTMLContentHandler
extends java.lang.Object
implements org.xml.sax.ContentHandler

A simple SAX ContentHandler, used by BoilerpipeSAXInput. Can be used by different parser implementations, e.g. NekoHTML and TagSoup.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	BoilerpipeHTMLContentHandler.Event

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static java.lang.String	ANCHOR_TEXT_END
(package private) static java.lang.String	ANCHOR_TEXT_START
(package private) int	blockTagLevel
private java.util.BitSet	currentContainedTextElements
private boolean	flush
(package private) java.util.LinkedList<java.lang.Integer>	fontSizeStack
(package private) int	inAnchor
(package private) boolean	inAnchorText
(package private) int	inBody
(package private) int	inIgnorableElement
(package private) java.util.LinkedList<java.util.LinkedList<LabelAction>>	labelStacks
private java.lang.String	lastEndTag
private BoilerpipeHTMLContentHandler.Event	lastEvent
private java.lang.String	lastStartTag
private int	offsetBlocks
private static java.util.regex.Pattern	PAT_VALID_WORD_CHARACTER
(package private) boolean	sbLastWasWhitespace
private java.util.Map<java.lang.String,TagAction>	tagActions
(package private) int	tagLevel
private java.util.List<TextBlock>	textBlocks
(package private) java.lang.StringBuilder	textBuffer
private int	textElementIdx
private java.lang.String	title
(package private) java.lang.StringBuilder	tokenBuffer

Constructor Summary

Constructors

Constructor	Description
BoilerpipeHTMLContentHandler()	Constructs a BoilerpipeHTMLContentHandler using the DefaultTagActionMap.
BoilerpipeHTMLContentHandler(TagActionMap tagActions)	Constructs a BoilerpipeHTMLContentHandler using the given TagActionMap.

Method Summary

Modifier and Type	Method	Description
void	addLabelAction(LabelAction la)
protected void	addTextBlock(TextBlock tb)
void	addWhitespaceIfNecessary()
void	characters(char[] ch, int start, int length)
void	endDocument()
void	endElement(java.lang.String uri, java.lang.String localName, java.lang.String qName)
void	endPrefixMapping(java.lang.String prefix)
void	flushBlock()
(package private) java.util.List<TextBlock>	getTextBlocks()
java.lang.String	getTitle()
void	ignorableWhitespace(char[] ch, int start, int length)
private static boolean	isWord(java.lang.String token)
void	processingInstruction(java.lang.String target, java.lang.String data)
void	recycle()	Recycles this instance.
void	setDocumentLocator(org.xml.sax.Locator locator)
void	setTitle(java.lang.String s)
void	skippedEntity(java.lang.String name)
void	startDocument()
void	startElement(java.lang.String uri, java.lang.String localName, java.lang.String qName, org.xml.sax.Attributes atts)
void	startPrefixMapping(java.lang.String prefix, java.lang.String uri)
TextDocument	toTextDocument()	Returns a TextDocument containing the extracted TextBlock s.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

tagActions

private final java.util.Map<java.lang.String,TagAction> tagActions

title

private java.lang.String title

ANCHOR_TEXT_START

static final java.lang.String ANCHOR_TEXT_START

See Also:

Constant Field Values

ANCHOR_TEXT_END

static final java.lang.String ANCHOR_TEXT_END

See Also:

Constant Field Values

tokenBuffer

java.lang.StringBuilder tokenBuffer

textBuffer

java.lang.StringBuilder textBuffer

inBody

int inBody

inAnchor

int inAnchor

inIgnorableElement

int inIgnorableElement

tagLevel

int tagLevel

blockTagLevel

int blockTagLevel

sbLastWasWhitespace

boolean sbLastWasWhitespace

textElementIdx

private int textElementIdx

textBlocks

private final java.util.List<TextBlock> textBlocks

lastStartTag

private java.lang.String lastStartTag

lastEndTag

private java.lang.String lastEndTag

lastEvent

private BoilerpipeHTMLContentHandler.Event lastEvent

offsetBlocks

private int offsetBlocks

currentContainedTextElements

private java.util.BitSet currentContainedTextElements

flush

private boolean flush

inAnchorText

boolean inAnchorText

labelStacks

java.util.LinkedList<java.util.LinkedList<LabelAction>> labelStacks

fontSizeStack

java.util.LinkedList<java.lang.Integer> fontSizeStack

PAT_VALID_WORD_CHARACTER

private static final java.util.regex.Pattern PAT_VALID_WORD_CHARACTER

Constructor Detail

BoilerpipeHTMLContentHandler

public BoilerpipeHTMLContentHandler()

Constructs a BoilerpipeHTMLContentHandler using the DefaultTagActionMap.

BoilerpipeHTMLContentHandler

public BoilerpipeHTMLContentHandler(TagActionMap tagActions)

Constructs a BoilerpipeHTMLContentHandler using the given TagActionMap.

Parameters:

tagActions - The TagActionMap to use, e.g. DefaultTagActionMap.

Method Detail

recycle

public void recycle()

Recycles this instance.

endDocument

public void endDocument()
                 throws org.xml.sax.SAXException

Specified by:

endDocument in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

endPrefixMapping

public void endPrefixMapping(java.lang.String prefix)
                      throws org.xml.sax.SAXException

Specified by:

endPrefixMapping in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

ignorableWhitespace

public void ignorableWhitespace(char[] ch,
                                int start,
                                int length)
                         throws org.xml.sax.SAXException

Specified by:

ignorableWhitespace in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

processingInstruction

public void processingInstruction(java.lang.String target,
                                  java.lang.String data)
                           throws org.xml.sax.SAXException

Specified by:

processingInstruction in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

setDocumentLocator

public void setDocumentLocator(org.xml.sax.Locator locator)

Specified by:

setDocumentLocator in interface org.xml.sax.ContentHandler

skippedEntity

public void skippedEntity(java.lang.String name)
                   throws org.xml.sax.SAXException

Specified by:

skippedEntity in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

startDocument

public void startDocument()
                   throws org.xml.sax.SAXException

Specified by:

startDocument in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

startPrefixMapping

public void startPrefixMapping(java.lang.String prefix,
                               java.lang.String uri)
                        throws org.xml.sax.SAXException

Specified by:

startPrefixMapping in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

startElement

public void startElement(java.lang.String uri,
                         java.lang.String localName,
                         java.lang.String qName,
                         org.xml.sax.Attributes atts)
                  throws org.xml.sax.SAXException

Specified by:

startElement in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

endElement

public void endElement(java.lang.String uri,
                       java.lang.String localName,
                       java.lang.String qName)
                throws org.xml.sax.SAXException

Specified by:

endElement in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

characters

public void characters(char[] ch,
                       int start,
                       int length)
                throws org.xml.sax.SAXException

Specified by:

characters in interface org.xml.sax.ContentHandler

Throws:

org.xml.sax.SAXException

getTextBlocks

java.util.List<TextBlock> getTextBlocks()

flushBlock

public void flushBlock()

addTextBlock

protected void addTextBlock(TextBlock tb)

isWord

private static boolean isWord(java.lang.String token)

getTitle

public java.lang.String getTitle()

setTitle

public void setTitle(java.lang.String s)

toTextDocument

public TextDocument toTextDocument()

Returns a TextDocument containing the extracted TextBlock s. NOTE: Only call this after parsing.

Returns:

The TextDocument

addWhitespaceIfNecessary

public void addWhitespaceIfNecessary()

addLabelAction

public void addLabelAction(LabelAction la)
                    throws java.lang.IllegalStateException

Throws:

java.lang.IllegalStateException