org.apache.hadoop.hive.accumulo.serde

Class AccumuloRowSerializer

java.lang.Object

org.apache.hadoop.hive.accumulo.serde.AccumuloRowSerializer

public class AccumuloRowSerializer
extends Object

Serializes a Struct to an Accumulo row as per the definition provided by the ColumnMappings

Constructor Summary

Constructors

Constructor and Description
AccumuloRowSerializer(int primaryKeyOffset, LazySerDeParameters serDeParams, List<ColumnMapping> mappings, org.apache.accumulo.core.security.ColumnVisibility visibility, AccumuloRowIdFactory rowIdFactory)

Method Summary

Methods

Modifier and Type	Method and Description
protected byte[]	getSerializedValue(ObjectInspector fieldObjectInspector, Object value, ByteStream.Output output, ColumnMapping mapping) Compute the serialized value from the given element and object inspectors.
protected org.apache.accumulo.core.security.ColumnVisibility	getVisibility()
org.apache.accumulo.core.data.Mutation	serialize(Object obj, ObjectInspector objInspector)
protected void	serializeColumnMapping(HiveAccumuloColumnMapping columnMapping, ObjectInspector fieldObjectInspector, Object value, org.apache.accumulo.core.data.Mutation mutation)
protected void	serializeColumnMapping(HiveAccumuloMapColumnMapping columnMapping, ObjectInspector fieldObjectInspector, Object value, org.apache.accumulo.core.data.Mutation mutation) Serialize the Hive Map into an Accumulo row
protected byte[]	serializeRowId(Object rowId, StructField rowIdField, ColumnMapping rowIdMapping) Serialize an Accumulo rowid
protected void	writeBinary(ByteStream.Output output, Object value, PrimitiveObjectInspector inspector)
protected void	writeSerializedPrimitive(PrimitiveObjectInspector objectInspector, ByteStream.Output output, Object value, ColumnEncoding encoding) Serialize the given primitive to the given output buffer, using the provided encoding mechanism.
protected void	writeString(ByteStream.Output output, Object value, PrimitiveObjectInspector inspector)
protected void	writeWithLevel(ObjectInspector oi, Object value, ByteStream.Output output, ColumnMapping mapping, int level) Recursively serialize an Object using its ObjectInspector, respecting the separators defined by the LazySerDeParameters.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AccumuloRowSerializer

public AccumuloRowSerializer(int primaryKeyOffset,
                     LazySerDeParameters serDeParams,
                     List<ColumnMapping> mappings,
                     org.apache.accumulo.core.security.ColumnVisibility visibility,
                     AccumuloRowIdFactory rowIdFactory)

Method Detail

serialize

public org.apache.accumulo.core.data.Mutation serialize(Object obj,
                                               ObjectInspector objInspector)
                                                 throws SerDeException,
                                                        IOException

Throws:

SerDeException

IOException

serializeColumnMapping

protected void serializeColumnMapping(HiveAccumuloColumnMapping columnMapping,
                          ObjectInspector fieldObjectInspector,
                          Object value,
                          org.apache.accumulo.core.data.Mutation mutation)
                               throws IOException

Throws:

IOException

serializeColumnMapping

protected void serializeColumnMapping(HiveAccumuloMapColumnMapping columnMapping,
                          ObjectInspector fieldObjectInspector,
                          Object value,
                          org.apache.accumulo.core.data.Mutation mutation)
                               throws IOException

Serialize the Hive Map into an Accumulo row

Throws:

IOException

serializeRowId

protected byte[] serializeRowId(Object rowId,
                    StructField rowIdField,
                    ColumnMapping rowIdMapping)
                         throws IOException

Serialize an Accumulo rowid

Throws:

IOException

getSerializedValue

protected byte[] getSerializedValue(ObjectInspector fieldObjectInspector,
                        Object value,
                        ByteStream.Output output,
                        ColumnMapping mapping)
                             throws IOException

Compute the serialized value from the given element and object inspectors. Based on the Hive types, represented through the ObjectInspectors for the whole object and column within the object, serialize the object appropriately.

Parameters:

fieldObjectInspector - ObjectInspector for the column value being serialized

value - The Object itself being serialized

output - A temporary buffer to reduce object creation

Returns:

The serialized bytes from the provided value.

Throws:

IOException - An error occurred when performing IO to serialize the data

writeWithLevel

protected void writeWithLevel(ObjectInspector oi,
                  Object value,
                  ByteStream.Output output,
                  ColumnMapping mapping,
                  int level)
                       throws IOException

Recursively serialize an Object using its ObjectInspector, respecting the separators defined by the LazySerDeParameters.

Parameters:

oi - ObjectInspector for the current object

value - The current object

output - A buffer output is written to

mapping - The mapping for this Hive column

level - The current level/offset for the SerDe separator

Throws:

IOException

writeSerializedPrimitive

protected void writeSerializedPrimitive(PrimitiveObjectInspector objectInspector,
                            ByteStream.Output output,
                            Object value,
                            ColumnEncoding encoding)
                                 throws IOException

Serialize the given primitive to the given output buffer, using the provided encoding mechanism.

Parameters:

objectInspector - The PrimitiveObjectInspector for this Object

output - A buffer to write the serialized value to

value - The Object being serialized

encoding - The means in which the Object should be serialized

Throws:

IOException

writeBinary

protected void writeBinary(ByteStream.Output output,
               Object value,
               PrimitiveObjectInspector inspector)
                    throws IOException

Throws:

IOException

writeString

protected void writeString(ByteStream.Output output,
               Object value,
               PrimitiveObjectInspector inspector)
                    throws IOException

Throws:

IOException

getVisibility

protected org.apache.accumulo.core.security.ColumnVisibility getVisibility()