org.apache.hadoop.hive.ql.exec.vector

Class VectorizedColumnarSerDe

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe

org.apache.hadoop.hive.ql.exec.vector.VectorizedColumnarSerDe

All Implemented Interfaces:

VectorizedSerde, Deserializer, SerDe, Serializer

public class VectorizedColumnarSerDe
extends ColumnarSerDe
implements VectorizedSerde

VectorizedColumnarSerDe is used by Vectorized query execution engine for columnar based storage supported by RCFile.

Field Summary

Fields inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe

LOG, serdeParams

Fields inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

cachedObjectInspector, lastOperationDeserialize, lastOperationSerialize, serializedSize, stats

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configErrors

Constructor Summary

Constructors

Constructor and Description
VectorizedColumnarSerDe()

Method Summary

Methods

Modifier and Type	Method and Description
Object	deserialize(org.apache.hadoop.io.Writable blob) Deserialize an object out of a Writable blob.
void	deserializeVector(Object rowBlob, int rowsInBlob, VectorizedRowBatch reuseBatch) Deserializes the rowBlob into Vectorized row batch
ObjectInspector	getObjectInspector() Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).
SerDeStats	getSerDeStats() Returns statistics collected when serializing
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass() Returns the Writable class that would be returned by the serialize method.
org.apache.hadoop.io.Writable	serialize(Object obj, ObjectInspector objInspector) Serialize a row of data.
org.apache.hadoop.io.Writable	serializeVector(VectorizedRowBatch vrg, ObjectInspector objInspector) Serialize a vectorized row batch

Methods inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe

initialize, toString

Methods inherited from class org.apache.hadoop.hive.serde2.columnar.ColumnarSerDeBase

initialize

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getConfigurationErrors, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorizedColumnarSerDe

public VectorizedColumnarSerDe()
                        throws SerDeException

Throws:

SerDeException

Method Detail

serializeVector

public org.apache.hadoop.io.Writable serializeVector(VectorizedRowBatch vrg,
                                            ObjectInspector objInspector)
                                              throws SerDeException

Serialize a vectorized row batch

Specified by:

serializeVector in interface VectorizedSerde

Parameters:

vrg - Vectorized row batch to serialize

objInspector - The ObjectInspector for the row object

Returns:

The serialized Writable object

Throws:

SerDeException

See Also:

Serializer.serialize(Object, ObjectInspector)

getSerDeStats

public SerDeStats getSerDeStats()

Description copied from class: AbstractSerDe

Returns statistics collected when serializing

Specified by:

getSerDeStats in interface Deserializer

Specified by:

getSerDeStats in interface Serializer

Overrides:

getSerDeStats in class ColumnarSerDeBase

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Description copied from class: AbstractSerDe

Returns the Writable class that would be returned by the serialize method. This is used to initialize SequenceFile header.

Specified by:

getSerializedClass in interface Serializer

Overrides:

getSerializedClass in class ColumnarSerDeBase

deserialize

public Object deserialize(org.apache.hadoop.io.Writable blob)
                   throws SerDeException

Description copied from class: AbstractSerDe

Deserialize an object out of a Writable blob. In most cases, the return value of this function will be constant since the function will reuse the returned object. If the client wants to keep a copy of the object, the client needs to clone the returned value by calling ObjectInspectorUtils.getStandardObject().

Specified by:

deserialize in interface Deserializer

Overrides:

deserialize in class ColumnarSerDeBase

Parameters:

blob - The Writable object containing a serialized object

Returns:

A Java object representing the contents in the blob.

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Description copied from class: AbstractSerDe

Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).

Specified by:

getObjectInspector in interface Deserializer

Overrides:

getObjectInspector in class ColumnarSerDeBase

Throws:

SerDeException

serialize

public org.apache.hadoop.io.Writable serialize(Object obj,
                                      ObjectInspector objInspector)
                                        throws SerDeException

Description copied from class: ColumnarSerDe

Serialize a row of data.

Specified by:

serialize in interface Serializer

Overrides:

serialize in class ColumnarSerDe

Parameters:

obj - The row object

objInspector - The ObjectInspector for the row object

Returns:

The serialized Writable object

Throws:

SerDeException

See Also:

SerDe#serialize(Object, ObjectInspector)

deserializeVector

public void deserializeVector(Object rowBlob,
                     int rowsInBlob,
                     VectorizedRowBatch reuseBatch)
                       throws SerDeException

Deserializes the rowBlob into Vectorized row batch

Specified by:

deserializeVector in interface VectorizedSerde

Parameters:

rowBlob - rowBlob row batch to deserialize

rowsInBlob - Total number of rows in rowBlob to deserialize

reuseBatch - VectorizedRowBatch to which the rows should be serialized *

Throws:

SerDeException