org.apache.hadoop.hive.llap.io.decode

Class EncodedDataConsumer<BatchKey,BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

java.lang.Object

org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer<BatchKey,BatchType>

All Implemented Interfaces:

ConsumerFeedback<ColumnVectorBatch>, ReadPipeline, Consumer<BatchType>

Direct Known Subclasses:

OrcEncodedDataConsumer

public abstract class EncodedDataConsumer<BatchKey,BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>
extends Object
implements Consumer<BatchType>, ReadPipeline

Field Summary

Fields

Modifier and Type	Field and Description
protected FixedSizedObjectPool<ColumnVectorBatch>	cvbPool

Constructor Summary

Constructors

Constructor and Description
EncodedDataConsumer(Consumer<ColumnVectorBatch> consumer, int colCount, LlapDaemonIOMetrics ioMetrics)

Method Summary

Modifier and Type	Method and Description
void	consumeData(BatchType data) Some data has been produced.
protected abstract void	decodeBatch(BatchType batch, Consumer<ColumnVectorBatch> downstreamConsumer)
Callable<Void>	getReadCallable()
void	init(ConsumerFeedback<BatchType> upstreamFeedback, Callable<Void> readCallable)
void	pause() Pause data production.
void	returnData(ColumnVectorBatch data) Returns processed data back to producer; necessary if e.g.
void	setDone() No more data will be produced; done
void	setError(Throwable t) No more data will be produced; error during production
void	stop() Stop data production, the external operation has been cancelled.
void	unpause() Unpause data production.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.llap.io.decode.ReadPipeline

getIncludedColumns, getSchemaEvolution

Field Detail

cvbPool

protected final FixedSizedObjectPool<ColumnVectorBatch> cvbPool

Constructor Detail

EncodedDataConsumer

public EncodedDataConsumer(Consumer<ColumnVectorBatch> consumer,
                           int colCount,
                           LlapDaemonIOMetrics ioMetrics)

Method Detail

init

public void init(ConsumerFeedback<BatchType> upstreamFeedback,
                 Callable<Void> readCallable)

getReadCallable

public Callable<Void> getReadCallable()

Specified by:

getReadCallable in interface ReadPipeline

consumeData

public void consumeData(BatchType data)

Description copied from interface: Consumer

Some data has been produced.

Specified by:

consumeData in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

decodeBatch

protected abstract void decodeBatch(BatchType batch,
                                    Consumer<ColumnVectorBatch> downstreamConsumer)

setDone

public void setDone()

Description copied from interface: Consumer

No more data will be produced; done

Specified by:

setDone in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

setError

public void setError(Throwable t)

Description copied from interface: Consumer

No more data will be produced; error during production

Specified by:

setError in interface Consumer<BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>>

returnData

public void returnData(ColumnVectorBatch data)

Description copied from interface: ConsumerFeedback

Returns processed data back to producer; necessary if e.g. data is locked in cache.

Specified by:

returnData in interface ConsumerFeedback<ColumnVectorBatch>

stop

public void stop()

Description copied from interface: ConsumerFeedback

Stop data production, the external operation has been cancelled.

Specified by:

stop in interface ConsumerFeedback<ColumnVectorBatch>

pause

public void pause()

Description copied from interface: ConsumerFeedback

Pause data production.

Specified by:

pause in interface ConsumerFeedback<ColumnVectorBatch>

unpause

public void unpause()

Description copied from interface: ConsumerFeedback

Unpause data production.

Specified by:

unpause in interface ConsumerFeedback<ColumnVectorBatch>