Package | Description |
---|---|
org.apache.hadoop.hive.llap.io.decode | |
org.apache.hadoop.hive.ql.io.orc.encoded |
Modifier and Type | Class and Description |
---|---|
class |
EncodedDataConsumer<BatchKey,BatchType extends org.apache.hadoop.hive.common.io.encoded.EncodedColumnBatch<BatchKey>> |
class |
OrcEncodedDataConsumer |
Modifier and Type | Method and Description |
---|---|
ReadPipeline |
OrcColumnVectorProducer.createReadPipeline(Consumer<ColumnVectorBatch> consumer,
org.apache.hadoop.mapred.FileSplit split,
List<Integer> columnIds,
org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg,
String[] columnNames,
QueryFragmentCounters counters,
org.apache.orc.TypeDescription readerSchema,
org.apache.hadoop.mapred.InputFormat<?,?> unused0,
Deserializer unused1,
org.apache.hadoop.mapred.Reporter reporter,
org.apache.hadoop.mapred.JobConf job,
Map<org.apache.hadoop.fs.Path,PartitionDesc> unused2) |
ReadPipeline |
ColumnVectorProducer.createReadPipeline(Consumer<ColumnVectorBatch> consumer,
org.apache.hadoop.mapred.FileSplit split,
List<Integer> columnIds,
org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg,
String[] columnNames,
QueryFragmentCounters counters,
org.apache.orc.TypeDescription readerSchema,
org.apache.hadoop.mapred.InputFormat<?,?> sourceInputFormat,
Deserializer sourceSerDe,
org.apache.hadoop.mapred.Reporter reporter,
org.apache.hadoop.mapred.JobConf job,
Map<org.apache.hadoop.fs.Path,PartitionDesc> parts) |
ReadPipeline |
GenericColumnVectorProducer.createReadPipeline(Consumer<ColumnVectorBatch> consumer,
org.apache.hadoop.mapred.FileSplit split,
List<Integer> columnIds,
org.apache.hadoop.hive.ql.io.sarg.SearchArgument sarg,
String[] columnNames,
QueryFragmentCounters counters,
org.apache.orc.TypeDescription schema,
org.apache.hadoop.mapred.InputFormat<?,?> sourceInputFormat,
Deserializer sourceSerDe,
org.apache.hadoop.mapred.Reporter reporter,
org.apache.hadoop.mapred.JobConf job,
Map<org.apache.hadoop.fs.Path,PartitionDesc> parts) |
protected abstract void |
EncodedDataConsumer.decodeBatch(BatchType batch,
Consumer<ColumnVectorBatch> downstreamConsumer) |
protected void |
OrcEncodedDataConsumer.decodeBatch(Reader.OrcEncodedColumnBatch batch,
Consumer<ColumnVectorBatch> downstreamConsumer) |
Constructor and Description |
---|
EncodedDataConsumer(Consumer<ColumnVectorBatch> consumer,
int colCount,
LlapDaemonIOMetrics ioMetrics) |
OrcEncodedDataConsumer(Consumer<ColumnVectorBatch> consumer,
int colCount,
boolean skipCorrupt,
QueryFragmentCounters counters,
LlapDaemonIOMetrics ioMetrics) |
Modifier and Type | Method and Description |
---|---|
void |
EncodedReader.readEncodedColumns(int stripeIx,
org.apache.orc.StripeInformation stripe,
org.apache.orc.OrcProto.RowIndex[] index,
List<org.apache.orc.OrcProto.ColumnEncoding> encodings,
List<org.apache.orc.OrcProto.Stream> streams,
boolean[] included,
boolean[][] colRgs,
Consumer<Reader.OrcEncodedColumnBatch> consumer)
Reads encoded data from ORC file.
|
Copyright © 2021 The Apache Software Foundation. All rights reserved.