org.apache.hadoop.hive.ql.exec.vector

Class VectorizedBatchUtil

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.VectorizedBatchUtil

public class VectorizedBatchUtil
extends Object

Constructor Summary

Constructors

Constructor and Description
VectorizedBatchUtil()

Method Summary

Methods

Modifier and Type	Method and Description
static void	acidAddRowToBatch(Object row, StructObjectInspector oi, int rowIndex, VectorizedRowBatch batch, VectorizedRowBatchCtx context, org.apache.hadoop.io.DataOutputBuffer buffer) Iterates thru all the columns in a given row and populates the batch from a given offset
static void	addProjectedRowToBatchFrom(Object row, StructObjectInspector oi, int rowIndex, VectorizedRowBatch batch, org.apache.hadoop.io.DataOutputBuffer buffer) Add only the projected column of a regular row to the specified vectorized row batch
static void	addRowToBatch(Object row, StructObjectInspector oi, int rowIndex, VectorizedRowBatch batch, org.apache.hadoop.io.DataOutputBuffer buffer) Iterates through all columns in a given row and populates the batch
static void	addRowToBatchFrom(Object row, StructObjectInspector oi, int rowIndex, int colOffset, VectorizedRowBatch batch, org.apache.hadoop.io.DataOutputBuffer buffer) Iterates thru all the columns in a given row and populates the batch from a given offset
static VectorizedRowBatch	constructVectorizedRowBatch(StructObjectInspector oi) Create VectorizedRowBatch from ObjectInspector
static VectorizedRowBatch	constructVectorizedRowBatch(StructObjectInspector keyInspector, StructObjectInspector valueInspector) Create VectorizedRowBatch from key and value object inspectors
static StandardStructObjectInspector	convertToStandardStructObjectInspector(StructObjectInspector structObjectInspector)
static void	debugDisplayBatch(VectorizedRowBatch batch, String prefix)
static void	debugDisplayOneRow(VectorizedRowBatch batch, int index, String prefix)
static String	displayBytes(byte[] bytes, int start, int length)
static VectorizedRowBatch	makeLike(VectorizedRowBatch batch) Make a new (scratch) batch, which is exactly "like" the batch provided, except that it's empty
static PrimitiveTypeInfo[]	primitiveTypeInfosFromStructObjectInspector(StructObjectInspector structObjectInspector)
static PrimitiveTypeInfo[]	primitiveTypeInfosFromTypeNames(String[] typeNames)
static void	setBatchSize(VectorizedRowBatch batch, int size) Reduce the batch size for a vectorized row batch
static void	setNoNullFields(VectorizedRowBatch batch) Iterates thru all the column vectors and sets noNull to specified value.
static void	setNullColIsNullValue(ColumnVector cv, int rowIndex) Sets the IsNull value for ColumnVector at specified index
static void	setRepeatingColumn(VectorizedRowBatch batch, int column) Iterates thru all the column vectors and sets repeating to specified column.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VectorizedBatchUtil

public VectorizedBatchUtil()

Method Detail

setNullColIsNullValue

public static void setNullColIsNullValue(ColumnVector cv,
                         int rowIndex)

Sets the IsNull value for ColumnVector at specified index

Parameters:

cv -

rowIndex -

setNoNullFields

public static void setNoNullFields(VectorizedRowBatch batch)

Iterates thru all the column vectors and sets noNull to specified value.

Parameters:

batch - Batch on which noNull is set

setRepeatingColumn

public static void setRepeatingColumn(VectorizedRowBatch batch,
                      int column)

Iterates thru all the column vectors and sets repeating to specified column.

setBatchSize

public static void setBatchSize(VectorizedRowBatch batch,
                int size)

Reduce the batch size for a vectorized row batch

constructVectorizedRowBatch

public static VectorizedRowBatch constructVectorizedRowBatch(StructObjectInspector oi)
                                                      throws HiveException

Create VectorizedRowBatch from ObjectInspector

Parameters:

oi -

Returns:

Throws:

HiveException

constructVectorizedRowBatch

public static VectorizedRowBatch constructVectorizedRowBatch(StructObjectInspector keyInspector,
                                             StructObjectInspector valueInspector)
                                                      throws HiveException

Create VectorizedRowBatch from key and value object inspectors

Parameters:

keyInspector -

valueInspector -

Returns:

VectorizedRowBatch

Throws:

HiveException

addRowToBatch

public static void addRowToBatch(Object row,
                 StructObjectInspector oi,
                 int rowIndex,
                 VectorizedRowBatch batch,
                 org.apache.hadoop.io.DataOutputBuffer buffer)
                          throws HiveException

Iterates through all columns in a given row and populates the batch

Parameters:

row -

oi -

rowIndex -

batch -

buffer -

Throws:

HiveException

addRowToBatchFrom

public static void addRowToBatchFrom(Object row,
                     StructObjectInspector oi,
                     int rowIndex,
                     int colOffset,
                     VectorizedRowBatch batch,
                     org.apache.hadoop.io.DataOutputBuffer buffer)
                              throws HiveException

Iterates thru all the columns in a given row and populates the batch from a given offset

Parameters:

row - Deserialized row object

oi - Object insepector for that row

rowIndex - index to which the row should be added to batch

colOffset - offset from where the column begins

batch - Vectorized batch to which the row is added at rowIndex

Throws:

HiveException

addProjectedRowToBatchFrom

public static void addProjectedRowToBatchFrom(Object row,
                              StructObjectInspector oi,
                              int rowIndex,
                              VectorizedRowBatch batch,
                              org.apache.hadoop.io.DataOutputBuffer buffer)
                                       throws HiveException

Add only the projected column of a regular row to the specified vectorized row batch

Parameters:

row - the regular row

oi - object inspector for the row

rowIndex - the offset to add in the batch

batch - vectorized row batch

buffer - data output buffer

Throws:

HiveException

acidAddRowToBatch

public static void acidAddRowToBatch(Object row,
                     StructObjectInspector oi,
                     int rowIndex,
                     VectorizedRowBatch batch,
                     VectorizedRowBatchCtx context,
                     org.apache.hadoop.io.DataOutputBuffer buffer)
                              throws HiveException

Iterates thru all the columns in a given row and populates the batch from a given offset

Parameters:

row - Deserialized row object

oi - Object insepector for that row

rowIndex - index to which the row should be added to batch

batch - Vectorized batch to which the row is added at rowIndex

context - context object for this vectorized batch

buffer -

Throws:

HiveException

convertToStandardStructObjectInspector

public static StandardStructObjectInspector convertToStandardStructObjectInspector(StructObjectInspector structObjectInspector)
                                                                            throws HiveException

Throws:

HiveException

primitiveTypeInfosFromStructObjectInspector

public static PrimitiveTypeInfo[] primitiveTypeInfosFromStructObjectInspector(StructObjectInspector structObjectInspector)
                                                                       throws HiveException

Throws:

HiveException

primitiveTypeInfosFromTypeNames

public static PrimitiveTypeInfo[] primitiveTypeInfosFromTypeNames(String[] typeNames)
                                                           throws HiveException

Throws:

HiveException

makeLike

public static VectorizedRowBatch makeLike(VectorizedRowBatch batch)
                                   throws HiveException

Make a new (scratch) batch, which is exactly "like" the batch provided, except that it's empty

Parameters:

batch - the batch to imitate

Returns:

the new batch

Throws:

HiveException

displayBytes

public static String displayBytes(byte[] bytes,
                  int start,
                  int length)

debugDisplayOneRow

public static void debugDisplayOneRow(VectorizedRowBatch batch,
                      int index,
                      String prefix)

debugDisplayBatch

public static void debugDisplayBatch(VectorizedRowBatch batch,
                     String prefix)
                              throws HiveException

Throws:

HiveException