public class ParquetRecordReaderBase extends Object
Modifier and Type | Field and Description |
---|---|
protected org.apache.hadoop.fs.Path |
file |
protected List<org.apache.parquet.hadoop.metadata.BlockMetaData> |
filtedBlocks |
protected org.apache.hadoop.mapred.JobConf |
jobConf |
static org.slf4j.Logger |
LOG |
protected ProjectionPusher |
projectionPusher |
protected org.apache.parquet.hadoop.ParquetFileReader |
reader |
protected int |
schemaSize |
protected SerDeStats |
serDeStats |
protected boolean |
skipTimestampConversion |
Constructor and Description |
---|
ParquetRecordReaderBase() |
Modifier and Type | Method and Description |
---|---|
List<org.apache.parquet.hadoop.metadata.BlockMetaData> |
getFiltedBlocks() |
protected org.apache.parquet.hadoop.ParquetInputSplit |
getSplit(org.apache.hadoop.mapred.InputSplit oldSplit,
org.apache.hadoop.mapred.JobConf conf)
gets a ParquetInputSplit corresponding to a split given by Hive
|
SerDeStats |
getStats() |
org.apache.parquet.filter2.compat.FilterCompat.Filter |
setFilter(org.apache.hadoop.mapred.JobConf conf,
org.apache.parquet.schema.MessageType schema) |
public static final org.slf4j.Logger LOG
protected org.apache.hadoop.fs.Path file
protected ProjectionPusher projectionPusher
protected boolean skipTimestampConversion
protected SerDeStats serDeStats
protected org.apache.hadoop.mapred.JobConf jobConf
protected int schemaSize
protected List<org.apache.parquet.hadoop.metadata.BlockMetaData> filtedBlocks
protected org.apache.parquet.hadoop.ParquetFileReader reader
protected org.apache.parquet.hadoop.ParquetInputSplit getSplit(org.apache.hadoop.mapred.InputSplit oldSplit, org.apache.hadoop.mapred.JobConf conf) throws IOException
oldSplit
- The split given by Hiveconf
- The JobConf of the Hive jobIOException
- if the config cannot be enhanced or if the footer cannot be read from the filepublic org.apache.parquet.filter2.compat.FilterCompat.Filter setFilter(org.apache.hadoop.mapred.JobConf conf, org.apache.parquet.schema.MessageType schema)
public List<org.apache.parquet.hadoop.metadata.BlockMetaData> getFiltedBlocks()
public SerDeStats getStats()
Copyright © 2022 The Apache Software Foundation. All rights reserved.