Class AbstractBatchedColumnProcessor<T extends Context>

java.lang.Object
com.univocity.parsers.common.processor.core.AbstractBatchedColumnProcessor<T>
All Implemented Interfaces:
Processor<T>
Direct Known Subclasses:
BatchedColumnProcessor
public abstract class AbstractBatchedColumnProcessor<T extends Context> extends Object implements Processor<T>
A Processor implementation that stores values of columns in batches. Use this implementation in favor of AbstractColumnProcessor when processing large inputs to avoid running out of memory. Values parsed in each row will be split into columns of Strings. Each column has its own list of values.

During the execution of the process, the batchProcessed(int) method will be invoked after a given number of rows has been processed.

The user can access the lists with values parsed for all columns using the methods getColumnValuesAsList(), getColumnValuesAsMapOfIndexes() and getColumnValuesAsMapOfNames().

After batchProcessed(int) is invoked, all values will be discarded and the next batch of column values will be accumulated. This process will repeat until there's no more rows in the input.

Author:
Univocity Software Pty Ltd - parsers@univocity.com
See Also:

  • Constructor Details

    • AbstractBatchedColumnProcessor

      public AbstractBatchedColumnProcessor(int rowsPerBatch)
      Constructs a batched column processor configured to invoke the batchesProcessed method after a given number of rows has been processed.
      Parameters:
      rowsPerBatch - the number of rows to process in each batch.

  • Method Details

    • processStarted

      public void processStarted(T context)
      Description copied from interface: Processor
      This method will by invoked by the parser once, when it is ready to start processing the input.
      Specified by:
      processStarted in interface Processor<T extends Context>
      Parameters:
      context - A contextual object with information and controls over the current state of the parsing process

    • rowProcessed

      public void rowProcessed(String[] row, T context)
      Description copied from interface: Processor
      Invoked by the parser after all values of a valid record have been processed.
      Specified by:
      rowProcessed in interface Processor<T extends Context>
      Parameters:
      row - the data extracted by the parser for an individual record. Note that:
      context - A contextual object with information and controls over the current state of the parsing process

    • processEnded

      public void processEnded(T context)
      Description copied from interface: Processor
      This method will by invoked by the parser once, after the parsing process stopped and all resources were closed.

      It will always be called by the parser: in case of errors, if the end of the input us reached, or if the user stopped the process manually using Context.stop().

      Specified by:
      processEnded in interface Processor<T extends Context>
      Parameters:
      context - A contextual object with information and controls over the state of the parsing process

    • getHeaders

      public final String[] getHeaders()

    • getColumnValuesAsList

      public final List<List<String>> getColumnValuesAsList()

    • putColumnValuesInMapOfNames

      public final void putColumnValuesInMapOfNames(Map<String, List<String>> map)

    • putColumnValuesInMapOfIndexes

      public final void putColumnValuesInMapOfIndexes(Map<Integer, List<String>> map)

    • getColumnValuesAsMapOfNames

      public final Map<String, List<String>> getColumnValuesAsMapOfNames()

    • getColumnValuesAsMapOfIndexes

      public final Map<Integer, List<String>> getColumnValuesAsMapOfIndexes()

    • getColumn

      public List<String> getColumn(String columnName)

    • getColumn

      public List<String> getColumn(int columnIndex)

    • getRowsPerBatch

      public int getRowsPerBatch()

    • getBatchesProcessed

      public int getBatchesProcessed()

    • batchProcessed

      public abstract void batchProcessed(int rowsInThisBatch)