Class AbstractSearchIndex

java.lang.Object

org.eclipse.rdf4j.sail.lucene.AbstractSearchIndex

All Implemented Interfaces:

SearchIndex

Direct Known Subclasses:

AbstractLuceneIndex

public abstract class AbstractSearchIndex
extends Object
implements SearchIndex

Field Summary

Fields

Modifier and Type	Field	Description
private Set<String>	indexedLangs
private Map<IRI,Set<IRI>>	indexedTypeMapping
private final org.slf4j.Logger	logger
protected int	maxDocs
private static final Set<String>	REJECTED_DATATYPES
private final ValueFactory	vf
protected Set<String>	wktFields

Constructor Summary

Constructors

Constructor	Description
AbstractSearchIndex()

Method Summary

Modifier and Type	Method	Description
boolean	accept(Literal literal)	Returns whether the provided literal is accepted by the LuceneIndex to be indexed.
protected abstract void	addDocument(SearchDocument doc)
final void	addDocuments(Resource subject, List<Statement> statements)	Add a complete Lucene Document based on these statements.
private void	addProperty(String field, String value, SearchDocument document)
private void	addProperty(Statement statement, SearchDocument document)	check if the passed statement should be added (is it indexed? is it stored?) and add it as predicate to the passed document.
final void	addRemoveStatements(Collection<Statement> added, Collection<Statement> removed)	Add many statements at the same time, remove many statements at the same time.
final void	addStatement(Statement statement)	Indexes the specified Statement.
protected abstract SearchDocument	copyDocument(SearchDocument doc)
private boolean	copyDocument(SearchDocument newDocument, SearchDocument document, Map<String, Set<String>> removedProperties)	Creates a copy of the old document; updating the retrieved Document instance works ok for stored properties but indexed data gets lost when doing an IndexWriter.updateDocument with it.
private static int	countPropertyValues(SearchDocument document)
protected abstract void	deleteDocument(SearchDocument doc)
final Collection<BindingSet>	evaluate(SearchQueryEvaluator evaluator)
private Iterable<? extends DocumentDistance>	evaluateQuery(DistanceQuerySpec query)
private Iterable<? extends DocumentResult>	evaluateQuery(GeoRelationQuerySpec query)
private Iterable<? extends DocumentScore>	evaluateQuery(QuerySpec query)	Evaluates one Lucene Query.
private BindingSetCollection	generateBindingSets(DistanceQuerySpec query, Iterable<? extends DocumentDistance> hits)
private BindingSetCollection	generateBindingSets(GeoRelationQuerySpec query, Iterable<? extends DocumentResult> hits)
private BindingSetCollection	generateBindingSets(QuerySpec query, Iterable<? extends DocumentScore> hits)	This method generates bindings from the given result of a Lucene query.
protected abstract Iterable<? extends DocumentDistance>	geoQuery(IRI geoProperty, org.locationtech.spatial4j.shape.Point p, IRI units, double distance, String distanceVar, Var context)
protected abstract Iterable<? extends DocumentResult>	geoRelationQuery(String relation, IRI geoProperty, String wkt, Var context)
protected abstract SearchDocument	getDocument(String id)
protected abstract Iterable<? extends SearchDocument>	getDocuments(String resourceId)
Map<IRI,Set<IRI>>	getIndexedTypeMapping()
protected Resource	getResource(SearchDocument document)	Returns the Resource corresponding with the specified Document.
protected abstract org.locationtech.spatial4j.context.SpatialContext	getSpatialContext(String property)
private static String	getUnitSymbol(IRI units)
void	initialize(Properties parameters)
boolean	isGeoField(String fieldName)	Returns true if the given property contains a geometry.
boolean	isIndexedTypeStatement(Statement statement)	Returns true if the given statement is a type statement of the right type, see LuceneSail.INDEXEDTYPES to use.
boolean	isTypeFilteringEnabled()	is the LuceneSail.INDEXEDTYPES parameter set for this index.
boolean	isTypeStatement(Statement statement)	Returns true if the given statement is a type statement, see LuceneSail.INDEXEDTYPES to use.
protected abstract BulkUpdater	newBulkUpdate()
protected abstract SearchDocument	newDocument(String id, String resourceId, String context)
protected Object	parseLuceneQueryShape(String property, String value)
protected org.locationtech.spatial4j.shape.Shape	parseQueryPoint(String property, String value)
protected org.locationtech.spatial4j.shape.Shape	parseQueryShape(String property, String value)
protected abstract Iterable<? extends DocumentScore>	query(Resource subject, QuerySpec param)
final void	removeStatement(Statement statement)	Removes the specified Statement from the indexes.This should be called from within a begin-commit-rollback
protected abstract void	updateDocument(SearchDocument doc)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface SearchIndex

begin, clear, clearContexts, commit, rollback, shutDown

Field Details

logger

private final org.slf4j.Logger logger

vf

private final ValueFactory vf

REJECTED_DATATYPES

private static final Set<String> REJECTED_DATATYPES

maxDocs

protected int maxDocs

wktFields

protected Set<String> wktFields

indexedLangs

private Set<String> indexedLangs

indexedTypeMapping

private Map<IRI,Set<IRI>> indexedTypeMapping

Constructor Details

AbstractSearchIndex

public AbstractSearchIndex()

Method Details

initialize

public void initialize(Properties parameters)
                throws Exception

Specified by:

initialize in interface SearchIndex

Throws:

Exception

getSpatialContext

protected abstract org.locationtech.spatial4j.context.SpatialContext getSpatialContext(String property)

accept

public boolean accept(Literal literal)

Returns whether the provided literal is accepted by the LuceneIndex to be indexed. It for instance does not make much since to index xsd:float.

Specified by:

accept in interface SearchIndex

Parameters:

literal - the literal to be accepted

Returns:

true if the given literal will be indexed by this LuceneIndex

isGeoField

public boolean isGeoField(String fieldName)

Description copied from interface: SearchIndex

Returns true if the given property contains a geometry.

Specified by:

isGeoField in interface SearchIndex

Parameters:

fieldName -

Returns:

boolean

isTypeStatement

public boolean isTypeStatement(Statement statement)

Description copied from interface: SearchIndex

Returns true if the given statement is a type statement, see LuceneSail.INDEXEDTYPES to use. This method should return false if SearchIndex.isTypeFilteringEnabled() returns false.

Specified by:

isTypeStatement in interface SearchIndex

Parameters:

statement - statement

Returns:

boolean

isTypeFilteringEnabled

public boolean isTypeFilteringEnabled()

Description copied from interface: SearchIndex

is the LuceneSail.INDEXEDTYPES parameter set for this index.

Specified by:

isTypeFilteringEnabled in interface SearchIndex

Returns:

boolean

isIndexedTypeStatement

public boolean isIndexedTypeStatement(Statement statement)

Description copied from interface: SearchIndex

Returns true if the given statement is a type statement of the right type, see LuceneSail.INDEXEDTYPES to use. This method should return false if SearchIndex.isTypeFilteringEnabled() returns false.

Specified by:

isIndexedTypeStatement in interface SearchIndex

Parameters:

statement - statement

Returns:

boolean

getIndexedTypeMapping

public Map<IRI,Set<IRI>> getIndexedTypeMapping()

Specified by:

getIndexedTypeMapping in interface SearchIndex

Returns:

the accepted types for a particular predicate map (predicate -> [objects])

addStatement

public final void addStatement(Statement statement)
                        throws IOException

Indexes the specified Statement.

Specified by:

addStatement in interface SearchIndex

Parameters:

statement -

Throws:

IOException

removeStatement

public final void removeStatement(Statement statement)
                           throws IOException

Description copied from interface: SearchIndex

Removes the specified Statement from the indexes.This should be called from within a begin-commit-rollback

block.

Specified by:

removeStatement in interface SearchIndex

Parameters:

statement -

Throws:

IOException

addRemoveStatements

public final void addRemoveStatements(Collection<Statement> added,
 Collection<Statement> removed)
                               throws IOException

Add many statements at the same time, remove many statements at the same time. Ordering by resource has to be done inside this method. The passed added/removed sets are disjunct, no statement can be in both

Specified by:

addRemoveStatements in interface SearchIndex

Parameters:

added - all added statements, can have multiple subjects

removed - all removed statements, can have multiple subjects

Throws:

IOException

copyDocument

private boolean copyDocument(SearchDocument newDocument,
 SearchDocument document,
 Map<String, Set<String>> removedProperties)

Creates a copy of the old document; updating the retrieved Document instance works ok for stored properties but indexed data gets lost when doing an IndexWriter.updateDocument with it.

countPropertyValues

private static int countPropertyValues(SearchDocument document)

addDocuments

public final void addDocuments(Resource subject,
 List<Statement> statements)
                        throws IOException

Add a complete Lucene Document based on these statements. Do not search for an existing document with the same subject id. (assume the existing document was deleted)

Specified by:

addDocuments in interface SearchIndex

Parameters:

subject -

statements - the statements that make up the resource

Throws:

IOException

addProperty

private void addProperty(Statement statement,
 SearchDocument document)

check if the passed statement should be added (is it indexed? is it stored?) and add it as predicate to the passed document. No checks whether the predicate was already there.

Parameters:

statement - the statement to add

document - the document to add to

addProperty

private void addProperty(String field,
 String value,
 SearchDocument document)

evaluate

public final Collection<BindingSet> evaluate(SearchQueryEvaluator evaluator)
                                      throws SailException

Specified by:

evaluate in interface SearchIndex

Throws:

SailException

evaluateQuery

private Iterable<? extends DocumentScore> evaluateQuery(QuerySpec query)

Evaluates one Lucene Query. It distinguishes between two cases, the one where no subject is given and the one were it is given.

Parameters:

query - the Lucene query to evaluate

Returns:

QueryResult consisting of hits and highlighter

generateBindingSets

private BindingSetCollection generateBindingSets(QuerySpec query,
 Iterable<? extends DocumentScore> hits)
                                          throws SailException

This method generates bindings from the given result of a Lucene query.

Parameters:

query - the Lucene query

Returns:

a LinkedHashSet containing generated bindings

Throws:

SailException

evaluateQuery

private Iterable<? extends DocumentDistance> evaluateQuery(DistanceQuerySpec query)

getUnitSymbol

private static String getUnitSymbol(IRI units)

generateBindingSets

private BindingSetCollection generateBindingSets(DistanceQuerySpec query,
 Iterable<? extends DocumentDistance> hits)
                                          throws SailException

Throws:

SailException

evaluateQuery

private Iterable<? extends DocumentResult> evaluateQuery(GeoRelationQuerySpec query)

generateBindingSets

private BindingSetCollection generateBindingSets(GeoRelationQuerySpec query,
 Iterable<? extends DocumentResult> hits)
                                          throws SailException

Throws:

SailException

parseLuceneQueryShape

protected Object parseLuceneQueryShape(String property,
 String value)
                                throws ParseException,
IOException

Throws:

ParseException

IOException

parseQueryShape

protected org.locationtech.spatial4j.shape.Shape parseQueryShape(String property,
 String value)
                                                          throws ParseException

Throws:

ParseException

parseQueryPoint

protected org.locationtech.spatial4j.shape.Shape parseQueryPoint(String property,
 String value)
                                                          throws ParseException

Throws:

ParseException

getResource

protected Resource getResource(SearchDocument document)

Returns the Resource corresponding with the specified Document.

getDocument

protected abstract SearchDocument getDocument(String id)
                                       throws IOException

Throws:

IOException

getDocuments

protected abstract Iterable<? extends SearchDocument> getDocuments(String resourceId)
                                                            throws IOException

Throws:

IOException

newDocument

protected abstract SearchDocument newDocument(String id,
 String resourceId,
 String context)

copyDocument

protected abstract SearchDocument copyDocument(SearchDocument doc)

addDocument

protected abstract void addDocument(SearchDocument doc)
                             throws IOException

Throws:

IOException

updateDocument

protected abstract void updateDocument(SearchDocument doc)
                                throws IOException

Throws:

IOException

deleteDocument

protected abstract void deleteDocument(SearchDocument doc)
                                throws IOException

Throws:

IOException

query

protected abstract Iterable<? extends DocumentScore> query(Resource subject,
 QuerySpec param)
                                                    throws MalformedQueryException,
IOException

Throws:

MalformedQueryException

IOException

geoQuery

protected abstract Iterable<? extends DocumentDistance> geoQuery(IRI geoProperty,
 org.locationtech.spatial4j.shape.Point p,
 IRI units,
 double distance,
 String distanceVar,
 Var context)
                                                          throws MalformedQueryException,
IOException

Throws:

MalformedQueryException

IOException

geoRelationQuery

protected abstract Iterable<? extends DocumentResult> geoRelationQuery(String relation,
 IRI geoProperty,
 String wkt,
 Var context)
                                                                throws MalformedQueryException,
IOException

Throws:

MalformedQueryException

IOException

newBulkUpdate

protected abstract BulkUpdater newBulkUpdate()