Package | Description |
---|---|
org.apache.hadoop.hive.llap.io.decode | |
org.apache.hadoop.hive.ql.io.orc |
The Optimized Row Columnar (ORC) File Format.
|
org.apache.orc | |
org.apache.orc.impl |
Modifier and Type | Method and Description |
---|---|
TypeDescription |
ReadPipeline.getFileSchema() |
TypeDescription |
OrcEncodedDataConsumer.getFileSchema() |
Modifier and Type | Method and Description |
---|---|
static TypeDescription |
OrcInputFormat.convertTypeInfo(TypeInfo info) |
static TypeDescription |
OrcInputFormat.getDesiredRowTypeDescr(org.apache.hadoop.conf.Configuration conf,
boolean isAcidRead,
int dataColumns)
Generate the desired schema for reading the file.
|
Modifier and Type | Method and Description |
---|---|
static ArrayList<TypeDescription> |
OrcInputFormat.typeDescriptionsFromHiveTypeProperty(String hiveTypeProperty,
int maxColumns)
Convert a Hive type property string that contains separated type names into a list of
TypeDescription objects.
|
Modifier and Type | Method and Description |
---|---|
OrcFile.WriterOptions |
OrcFile.WriterOptions.setSchema(TypeDescription schema)
Set the schema for the file.
|
Modifier and Type | Method and Description |
---|---|
TypeDescription |
TypeDescription.addField(String field,
TypeDescription fieldType)
Add a field to a struct type as it is built.
|
TypeDescription |
TypeDescription.addUnionChild(TypeDescription child)
Add a child to a union type.
|
TypeDescription |
TypeDescription.clone() |
static TypeDescription |
OrcUtils.convertTypeFromProtobuf(List<OrcProto.Type> types,
int rootColumn)
Translate the given rootColumn from the list of types to a TypeDescription.
|
static TypeDescription |
TypeDescription.createBinary() |
static TypeDescription |
TypeDescription.createBoolean() |
static TypeDescription |
TypeDescription.createByte() |
static TypeDescription |
TypeDescription.createChar() |
static TypeDescription |
TypeDescription.createDate() |
static TypeDescription |
TypeDescription.createDecimal() |
static TypeDescription |
TypeDescription.createDouble() |
static TypeDescription |
TypeDescription.createFloat() |
static TypeDescription |
TypeDescription.createInt() |
static TypeDescription |
TypeDescription.createList(TypeDescription childType) |
static TypeDescription |
TypeDescription.createLong() |
static TypeDescription |
TypeDescription.createMap(TypeDescription keyType,
TypeDescription valueType) |
static TypeDescription |
TypeDescription.createShort() |
static TypeDescription |
TypeDescription.createString() |
static TypeDescription |
TypeDescription.createStruct() |
static TypeDescription |
TypeDescription.createTimestamp() |
static TypeDescription |
TypeDescription.createUnion() |
static TypeDescription |
TypeDescription.createVarchar() |
TypeDescription |
Writer.getSchema()
Get the schema for this writer
|
TypeDescription |
Reader.getSchema()
Get the type of rows in this ORC file.
|
TypeDescription |
Reader.Options.getSchema() |
TypeDescription |
OrcFile.WriterOptions.getSchema() |
TypeDescription |
TypeDescription.withMaxLength(int maxLength)
Set the maximum length for char and varchar types.
|
TypeDescription |
TypeDescription.withPrecision(int precision)
For decimal types, set the precision.
|
TypeDescription |
TypeDescription.withScale(int scale)
For decimal types, set the scale.
|
Modifier and Type | Method and Description |
---|---|
List<TypeDescription> |
TypeDescription.getChildren()
Get the subtypes of this type.
|
Modifier and Type | Method and Description |
---|---|
TypeDescription |
TypeDescription.addField(String field,
TypeDescription fieldType)
Add a field to a struct type as it is built.
|
TypeDescription |
TypeDescription.addUnionChild(TypeDescription child)
Add a child to a union type.
|
static void |
OrcUtils.appendOrcTypesRebuildSubtypes(List<OrcProto.Type> result,
TypeDescription typeDescr)
NOTE: This method ignores the subtype numbers in the TypeDescription rebuilds the subtype
numbers based on the length of the result list being appended.
|
int |
TypeDescription.compareTo(TypeDescription other) |
static TypeDescription |
TypeDescription.createList(TypeDescription childType) |
static TypeDescription |
TypeDescription.createMap(TypeDescription keyType,
TypeDescription valueType) |
static List<OrcProto.Type> |
OrcUtils.getOrcTypes(TypeDescription typeDescr) |
static boolean[] |
OrcUtils.includeColumns(String selectedColumns,
TypeDescription schema)
Returns selected columns as a boolean array with true value set for specified column names.
|
Reader.Options |
Reader.Options.schema(TypeDescription schema)
Set the schema on read type description.
|
OrcFile.WriterOptions |
OrcFile.WriterOptions.setSchema(TypeDescription schema)
Set the schema for the file.
|
Modifier and Type | Field and Description |
---|---|
protected TypeDescription |
RecordReaderImpl.schema |
Modifier and Type | Method and Description |
---|---|
static TypeDescription |
SchemaEvolution.createEventSchema(TypeDescription typeDescr) |
TypeDescription |
SchemaEvolution.getFileType(int id)
Get the file type by reader type id.
|
TypeDescription |
SchemaEvolution.getFileType(TypeDescription readerType) |
TypeDescription |
SchemaEvolution.getReaderSchema() |
TypeDescription |
WriterImpl.getSchema() |
TypeDescription |
ReaderImpl.getSchema() |
Modifier and Type | Method and Description |
---|---|
protected void |
ConvertTreeReaderFactory.ConvertTreeReader.assignStringGroupVectorEntry(BytesColumnVector bytesColVector,
int elementNum,
TypeDescription readerType,
byte[] bytes) |
protected void |
ConvertTreeReaderFactory.ConvertTreeReader.assignStringGroupVectorEntry(BytesColumnVector bytesColVector,
int elementNum,
TypeDescription readerType,
byte[] bytes,
int start,
int length) |
static boolean |
ConvertTreeReaderFactory.canConvert(TypeDescription fileType,
TypeDescription readerType) |
protected void |
ConvertTreeReaderFactory.ConvertTreeReader.convertStringGroupVectorElement(BytesColumnVector bytesColVector,
int elementNum,
TypeDescription readerType) |
static ColumnStatisticsImpl |
ColumnStatisticsImpl.create(TypeDescription schema) |
static TreeReaderFactory.TreeReader |
ConvertTreeReaderFactory.createConvertTreeReader(TypeDescription readerType,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt)
(Rules from Hive's PrimitiveObjectInspectorUtils conversion)
To BOOLEAN, BYTE, SHORT, INT, LONG:
Convert from (BOOLEAN, BYTE, SHORT, INT, LONG) with down cast if necessary.
|
static TypeDescription |
SchemaEvolution.createEventSchema(TypeDescription typeDescr) |
static TreeReaderFactory.TreeReader |
TreeReaderFactory.createTreeReader(TypeDescription readerType,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt) |
void |
ConvertTreeReaderFactory.ConvertTreeReader.downCastAnyInteger(LongColumnVector longColVector,
int elementNum,
long inputLong,
TypeDescription readerType) |
void |
ConvertTreeReaderFactory.ConvertTreeReader.downCastAnyInteger(LongColumnVector longColVector,
int elementNum,
TypeDescription readerType) |
TypeDescription |
SchemaEvolution.getFileType(TypeDescription readerType) |
protected TreeReaderFactory.TreeReader |
ConvertTreeReaderFactory.ConvertTreeReader.getStringGroupTreeReader(int columnId,
TypeDescription fileType) |
protected boolean |
ConvertTreeReaderFactory.ConvertTreeReader.integerDownCastNeeded(TypeDescription fileType,
TypeDescription readerType) |
Constructor and Description |
---|
ListTreeReader(int fileColumn,
TypeDescription readerSchema,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt) |
MapTreeReader(int fileColumn,
TypeDescription readerSchema,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt) |
SchemaEvolution(TypeDescription fileSchema,
boolean[] includedCols) |
SchemaEvolution(TypeDescription fileSchema,
TypeDescription readerSchema,
boolean[] includeCols) |
StructTreeReader(int columnId,
TypeDescription readerSchema,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt) |
UnionTreeReader(int fileColumn,
TypeDescription readerSchema,
SchemaEvolution evolution,
boolean[] included,
boolean skipCorrupt) |
Copyright © 2016 The Apache Software Foundation. All rights reserved.