Package org.apache.tika.pipes.emitter.kafka

Class KafkaEmitter

java.lang.Object
org.apache.tika.pipes.emitter.AbstractEmitter
org.apache.tika.pipes.emitter.kafka.KafkaEmitter
All Implemented Interfaces:
Initializable, Emitter
public class KafkaEmitter extends AbstractEmitter implements Initializable
Emits the now-parsed documents into a specified Apache Kafka topic.

  • Constructor Details

    • KafkaEmitter

      public KafkaEmitter()

  • Method Details

    • setBootstrapServers

      @Field public void setBootstrapServers(String bootstrapServers)

    • setAcks

      @Field public void setAcks(String acks)

    • setLingerMs

      @Field public void setLingerMs(int lingerMs)

    • setBatchSize

      public void setBatchSize(int batchSize)

    • setBufferMemory

      @Field public void setBufferMemory(int bufferMemory)

    • setClientId

      @Field public void setClientId(String clientId)

    • setCompressionType

      @Field public void setCompressionType(String compressionType)

    • setConnectionsMaxIdleMs

      @Field public void setConnectionsMaxIdleMs(int connectionsMaxIdleMs)

    • setDeliveryTimeoutMs

      @Field public void setDeliveryTimeoutMs(int deliveryTimeoutMs)

    • setEnableIdempotence

      @Field public void setEnableIdempotence(boolean enableIdempotence)

    • setInterceptorClasses

      @Field public void setInterceptorClasses(String interceptorClasses)

    • setMaxBlockMs

      @Field public void setMaxBlockMs(int maxBlockMs)

    • setMaxInFlightRequestsPerConnection

      @Field public void setMaxInFlightRequestsPerConnection(int maxInFlightRequestsPerConnection)

    • setMaxRequestSize

      @Field public void setMaxRequestSize(int maxRequestSize)

    • setMetadataMaxAgeMs

      @Field public void setMetadataMaxAgeMs(int metadataMaxAgeMs)

    • setRequestTimeoutMs

      @Field public void setRequestTimeoutMs(int requestTimeoutMs)

    • setRetries

      @Field public void setRetries(int retries)

    • setRetryBackoffMs

      @Field public void setRetryBackoffMs(int retryBackoffMs)

    • setTransactionTimeoutMs

      @Field public void setTransactionTimeoutMs(int transactionTimeoutMs)

    • setTransactionalId

      @Field public void setTransactionalId(String transactionalId)

    • setKeySerializer

      @Field public void setKeySerializer(String keySerializer)

    • setValueSerializer

      @Field public void setValueSerializer(String valueSerializer)

    • setTopic

      @Field public void setTopic(String topic)

    • emit

      public void emit(String emitKey, List<Metadata> metadataList) throws IOException, TikaEmitterException
      Specified by:
      emit in interface Emitter
      Throws:
      IOException
      TikaEmitterException

    • initialize

      public void initialize(Map<String,Param> params) throws TikaConfigException
      Specified by:
      initialize in interface Initializable
      Parameters:
      params - params to use for initialization
      Throws:
      TikaConfigException

    • checkInitialization

      public void checkInitialization(InitializableProblemHandler problemHandler) throws TikaConfigException
      Specified by:
      checkInitialization in interface Initializable
      Parameters:
      problemHandler - if there is a problem and no custom initializableProblemHandler has been configured via Initializable parameters, this is called to respond.
      Throws:
      TikaConfigException