Package org.apache.manifoldcf.crawler.connectors.rss

Class DataCache

  • public class DataCache
extends java.lang.Object
    This class is a cache of a specific URL's data. It's fetched early and kept, so that (1) an accurate data length can be found, and (2) we can compute a version checksum.

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      protected static class  DataCache.DocumentData
      This class represents everything we need to know about a document that's getting passed from the getDocumentVersions() phase to the processDocuments() phase.

    • Constructor Summary

      Constructors 
      Constructor Description
      DataCache()
      Constructor.

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      long addData​(org.apache.manifoldcf.crawler.interfaces.IProcessActivity activities, java.lang.String documentIdentifier, java.lang.String contentType, java.io.InputStream dataStream)
      Add binary data entry into the cache.
      void deleteData​(java.lang.String documentIdentifier)
      Delete specified item of data.
      java.lang.String getContentType​(java.lang.String documentIdentifier)
      Get the content type.
      java.io.InputStream getData​(java.lang.String documentIdentifier)
      Fetch binary data entry from the cache.
      long getDataLength​(java.lang.String documentIdentifier)
      Fetch binary data length.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • DataCache

        public DataCache()
        Constructor.

    • Method Detail

      • addData

        public long addData​(org.apache.manifoldcf.crawler.interfaces.IProcessActivity activities,
                    java.lang.String documentIdentifier,
                    java.lang.String contentType,
                    java.io.InputStream dataStream)
             throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
                    org.apache.manifoldcf.agents.interfaces.ServiceInterruption
        Add binary data entry into the cache. Does NOT close the input stream when done!
        Parameters:
        documentIdentifier - is the document identifier (url).
        contentType - is the content type for the data.
        dataStream - is the data stream.
        Returns:
        the checksum value.
        Throws:
        org.apache.manifoldcf.core.interfaces.ManifoldCFException
        org.apache.manifoldcf.agents.interfaces.ServiceInterruption

      • getDataLength

        public long getDataLength​(java.lang.String documentIdentifier)
                   throws org.apache.manifoldcf.core.interfaces.ManifoldCFException
        Fetch binary data length.
        Parameters:
        documentIdentifier - is the document identifier.
        Returns:
        the length.
        Throws:
        org.apache.manifoldcf.core.interfaces.ManifoldCFException

      • getData

        public java.io.InputStream getData​(java.lang.String documentIdentifier)
                            throws org.apache.manifoldcf.core.interfaces.ManifoldCFException
        Fetch binary data entry from the cache.
        Parameters:
        documentIdentifier - is the document identifier (url).
        Returns:
        a binary data stream.
        Throws:
        org.apache.manifoldcf.core.interfaces.ManifoldCFException

      • getContentType

        public java.lang.String getContentType​(java.lang.String documentIdentifier)
        Get the content type.
        Parameters:
        documentIdentifier - is the document identifier.
        Returns:
        the content type, or null if there is none.

      • deleteData

        public void deleteData​(java.lang.String documentIdentifier)
        Delete specified item of data.
        Parameters:
        documentIdentifier - is the document identifier (url).