Package edu.berkeley.nlp.lm.io

Class FirstPassCallback<V extends LongRepresentable<V>>

java.lang.Object

edu.berkeley.nlp.lm.io.FirstPassCallback<V>

Type Parameters:

V - Value type

All Implemented Interfaces:

ArpaLmReaderCallback<V>, LmReaderCallback<V>, NgramOrderedLmReaderCallback<V>

public final class FirstPassCallback<V extends LongRepresentable<V>>
extends java.lang.Object
implements ArpaLmReaderCallback<V>

Reader callback which adds n-grams to an NgramMap

Author:

adampauls

Constructor Summary

Constructors

Constructor	Description
FirstPassCallback(boolean reverse)

Method Summary

Modifier and Type	Method	Description
void	call(int[] ngram, int startPos, int endPos, V v, java.lang.String words)	Called for each n-gram
void	cleanup()	Called once all reading is done.
long[]	getNumNgramsForEachOrder()
LongArray[]	getNumNgramsForEachWord()
LongToIntHashMap	getValueCounter()
void	handleNgramOrderFinished(int order)	Called when all n-grams of a given order are finished
void	handleNgramOrderStarted(int order)	Called when n-grams of a given order are started
void	initWithLengths(java.util.List<java.lang.Long> numNGrams)	Called initially with a list of how many n-grams will appear for each order.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FirstPassCallback

public FirstPassCallback(boolean reverse)

Method Detail

call

public void call(int[] ngram,
                 int startPos,
                 int endPos,
                 V v,
                 java.lang.String words)

Description copied from interface: LmReaderCallback

Called for each n-gram

Specified by:

call in interface LmReaderCallback<V extends LongRepresentable<V>>

Parameters:

ngram - The integer representation of the words as given by the provided WordIndexer

v - The value of the n-gram

words - The string representation of the n-gram (space separated)

handleNgramOrderFinished

public void handleNgramOrderFinished(int order)

Description copied from interface: NgramOrderedLmReaderCallback

Called when all n-grams of a given order are finished

Specified by:

handleNgramOrderFinished in interface NgramOrderedLmReaderCallback<V extends LongRepresentable<V>>

cleanup

public void cleanup()

Description copied from interface: LmReaderCallback

Called once all reading is done.

Specified by:

cleanup in interface LmReaderCallback<V extends LongRepresentable<V>>

getValueCounter

public LongToIntHashMap getValueCounter()

initWithLengths

public void initWithLengths(java.util.List<java.lang.Long> numNGrams)

Description copied from interface: ArpaLmReaderCallback

Called initially with a list of how many n-grams will appear for each order.

Specified by:

initWithLengths in interface ArpaLmReaderCallback<V extends LongRepresentable<V>>

Parameters:

numNGrams - maps n-gram orders to number of n-grams (i.e. numNGrams.get(0) is the number of unigrams)

getNumNgramsForEachWord

public LongArray[] getNumNgramsForEachWord()

getNumNgramsForEachOrder

public long[] getNumNgramsForEachOrder()

handleNgramOrderStarted

public void handleNgramOrderStarted(int order)

Description copied from interface: NgramOrderedLmReaderCallback

Called when n-grams of a given order are started

Specified by:

handleNgramOrderStarted in interface NgramOrderedLmReaderCallback<V extends LongRepresentable<V>>