org.apache.streams.elasticsearch.processor

Class PercolateTagProcessor

java.lang.Object

org.apache.streams.elasticsearch.processor.PercolateTagProcessor

All Implemented Interfaces:

Serializable, StreamsOperation, StreamsProcessor

public class PercolateTagProcessor
extends Object
implements StreamsProcessor

References: Some helpful references to help Purpose URL ------------- ---------------------------------------------------------------- [Status Codes] http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html [Test Cases] http://greenbytes.de/tech/tc/httpredirects/ [t.co behavior] https://dev.twitter.com/docs/tco-redirection-behavior

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PercolateTagProcessor.FilterLevel
static class	PercolateTagProcessor.PercolateQueryBuilder

Field Summary

Fields

Modifier and Type	Field and Description
protected Queue<StreamsDatum>	inQueue
protected Queue<StreamsDatum>	outQueue
static String	STREAMS_ID
static String	TAGS_EXTENSION
protected String	usePercolateField

Constructor Summary

Constructors

Constructor and Description
PercolateTagProcessor(ElasticsearchWriterConfiguration config)
PercolateTagProcessor(ElasticsearchWriterConfiguration config, String defaultPercolateField)

Method Summary

Modifier and Type	Method and Description
void	addPercolateRule(PercolateTagProcessor.PercolateQueryBuilder builder, String index)
protected void	appendMatches(com.fasterxml.jackson.databind.node.ArrayNode tagArray, Activity activity)
void	cleanUp()
void	createIndexIfMissing(String indexName) createIndexIfMissing.
boolean	deleteOldQueries(String index) delete old queries.
Set<String>	getActivePercolateTags(String index) get active percolate tags.
ElasticsearchConfiguration	getConfig()
String	getId()
ElasticsearchClientManager	getManager()
Queue<StreamsDatum>	getProcessorOutputQueue()
int	numOfPercolateRules()
void	prepare(Object configuration)
List<StreamsDatum>	process(StreamsDatum entry)
boolean	removeOldTags(Set<String> ids, String index) Attempt to removeOldTags.
void	setConfig(ElasticsearchWriterConfiguration config)
void	setManager(ElasticsearchClientManager manager)
boolean	writePercolateRules()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STREAMS_ID

public static final String STREAMS_ID

See Also:

Constant Field Values

inQueue

protected Queue<StreamsDatum> inQueue

outQueue

protected Queue<StreamsDatum> outQueue

TAGS_EXTENSION

public static final String TAGS_EXTENSION

See Also:

Constant Field Values

usePercolateField

protected String usePercolateField

Constructor Detail

PercolateTagProcessor

public PercolateTagProcessor(ElasticsearchWriterConfiguration config)

PercolateTagProcessor

public PercolateTagProcessor(ElasticsearchWriterConfiguration config,
                             String defaultPercolateField)

Method Detail

getManager

public ElasticsearchClientManager getManager()

setManager

public void setManager(ElasticsearchClientManager manager)

getConfig

public ElasticsearchConfiguration getConfig()

setConfig

public void setConfig(ElasticsearchWriterConfiguration config)

getProcessorOutputQueue

public Queue<StreamsDatum> getProcessorOutputQueue()

getId

public String getId()

Specified by:

getId in interface StreamsOperation

process

public List<StreamsDatum> process(StreamsDatum entry)

Specified by:

process in interface StreamsProcessor

appendMatches

protected void appendMatches(com.fasterxml.jackson.databind.node.ArrayNode tagArray,
                             Activity activity)

prepare

public void prepare(Object configuration)

Specified by:

prepare in interface StreamsOperation

cleanUp

public void cleanUp()

Specified by:

cleanUp in interface StreamsOperation

numOfPercolateRules

public int numOfPercolateRules()

createIndexIfMissing

public void createIndexIfMissing(String indexName)

createIndexIfMissing.

Parameters:

indexName - indexName

addPercolateRule

public void addPercolateRule(PercolateTagProcessor.PercolateQueryBuilder builder,
                             String index)

writePercolateRules

public boolean writePercolateRules()

Returns:

returns true if all rules were addded. False indicates one or more rules have failed.

removeOldTags

public boolean removeOldTags(Set<String> ids,
                             String index)

Attempt to removeOldTags.

Parameters:

ids - ids

index - index

Returns:

Returns true if all of the old tags were removed. False indicates one or more tags were not removed.

getActivePercolateTags

public Set<String> getActivePercolateTags(String index)

get active percolate tags.

Parameters:

index - index

Returns:

result

deleteOldQueries

public boolean deleteOldQueries(String index)

delete old queries.

Parameters:

index - index

Returns:

result