org.apache.manifoldcf.crawler.connectors.rss

Class DataCache

java.lang.Object

org.apache.manifoldcf.crawler.connectors.rss.DataCache

public class DataCache
extends java.lang.Object

This class is a cache of a specific URL's data. It's fetched early and kept, so that (1) an accurate data length can be found, and (2) we can compute a version checksum.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	DataCache.DocumentData This class represents everything we need to know about a document that's getting passed from the getDocumentVersions() phase to the processDocuments() phase.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	_rcsid
protected java.util.Map<java.lang.String,DataCache.DocumentData>	cacheData

Constructor Summary

Constructors

Constructor and Description
DataCache() Constructor.

Method Summary

Modifier and Type	Method and Description
long	addData(org.apache.manifoldcf.crawler.interfaces.IProcessActivity activities, java.lang.String documentIdentifier, java.lang.String contentType, java.io.InputStream dataStream) Add binary data entry into the cache.
void	deleteData(java.lang.String documentIdentifier) Delete specified item of data.
java.lang.String	getContentType(java.lang.String documentIdentifier) Get the content type.
java.io.InputStream	getData(java.lang.String documentIdentifier) Fetch binary data entry from the cache.
long	getDataLength(java.lang.String documentIdentifier) Fetch binary data length.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_rcsid

public static final java.lang.String _rcsid

See Also:

Constant Field Values

cacheData

protected java.util.Map<java.lang.String,DataCache.DocumentData> cacheData

Constructor Detail

DataCache

public DataCache()

Constructor.

Method Detail

addData

public long addData(org.apache.manifoldcf.crawler.interfaces.IProcessActivity activities,
                    java.lang.String documentIdentifier,
                    java.lang.String contentType,
                    java.io.InputStream dataStream)
             throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
                    org.apache.manifoldcf.agents.interfaces.ServiceInterruption

Add binary data entry into the cache. Does NOT close the input stream when done!

Parameters:

documentIdentifier - is the document identifier (url).

contentType - is the content type for the data.

dataStream - is the data stream.

Returns:

the checksum value.

Throws:

org.apache.manifoldcf.core.interfaces.ManifoldCFException

org.apache.manifoldcf.agents.interfaces.ServiceInterruption

getDataLength

public long getDataLength(java.lang.String documentIdentifier)
                   throws org.apache.manifoldcf.core.interfaces.ManifoldCFException

Fetch binary data length.

Parameters:

documentIdentifier - is the document identifier.

Returns:

the length.

Throws:

org.apache.manifoldcf.core.interfaces.ManifoldCFException

getData

public java.io.InputStream getData(java.lang.String documentIdentifier)
                            throws org.apache.manifoldcf.core.interfaces.ManifoldCFException

Fetch binary data entry from the cache.

Parameters:

documentIdentifier - is the document identifier (url).

Returns:

a binary data stream.

Throws:

org.apache.manifoldcf.core.interfaces.ManifoldCFException

getContentType

public java.lang.String getContentType(java.lang.String documentIdentifier)

Get the content type.

Parameters:

documentIdentifier - is the document identifier.

Returns:

the content type, or null if there is none.

deleteData

public void deleteData(java.lang.String documentIdentifier)

Delete specified item of data.

Parameters:

documentIdentifier - is the document identifier (url).