org.apache.hive.hcatalog.streaming

Class StrictJsonWriter

java.lang.Object

org.apache.hive.hcatalog.streaming.AbstractRecordWriter

org.apache.hive.hcatalog.streaming.StrictJsonWriter

All Implemented Interfaces:

RecordWriter

public class StrictJsonWriter
extends AbstractRecordWriter

Streaming Writer handles utf8 encoded Json (Strict syntax). Uses org.apache.hive.hcatalog.data.JsonSerDe to process Json input

Field Summary

Fields inherited from class org.apache.hive.hcatalog.streaming.AbstractRecordWriter

bucketIds, totalBuckets

Constructor Summary

Constructors

Constructor and Description
StrictJsonWriter(HiveEndPoint endPoint) Deprecated. As of release 1.3/2.1. Replaced by StrictJsonWriter(HiveEndPoint, HiveConf, StreamingConnection)
StrictJsonWriter(HiveEndPoint endPoint, HiveConf conf) Deprecated. As of release 1.3/2.1. Replaced by StrictJsonWriter(HiveEndPoint, HiveConf, StreamingConnection)
StrictJsonWriter(HiveEndPoint endPoint, HiveConf conf, StreamingConnection conn)
StrictJsonWriter(HiveEndPoint endPoint, StreamingConnection conn)

Method Summary

Modifier and Type	Method and Description
Object	encode(byte[] utf8StrRecord) Encode a record as an Object that Hive can read with the ObjectInspector associated with the serde returned by AbstractRecordWriter.getSerde().
protected ObjectInspector[]	getBucketObjectInspectors()
protected StructField[]	getBucketStructFields()
protected HCatRecordObjectInspector	getRecordObjectInspector()
SerDe	getSerde() Get the SerDe for the Objects created by AbstractRecordWriter.encode(byte[]).
void	write(long transactionId, byte[] record) Writes using a hive RecordUpdater

Methods inherited from class org.apache.hive.hcatalog.streaming.AbstractRecordWriter

clear, closeBatch, flush, getBucket, getObjectInspectorsForBucketedCols, newBatch

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint)
                 throws ConnectionError,
                        SerializationError,
                        StreamingException

Deprecated. As of release 1.3/2.1. Replaced by StrictJsonWriter(HiveEndPoint, HiveConf, StreamingConnection)

Throws:

ConnectionError

SerializationError

StreamingException

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint,
                        HiveConf conf)
                 throws StreamingException

Deprecated. As of release 1.3/2.1. Replaced by StrictJsonWriter(HiveEndPoint, HiveConf, StreamingConnection)

Throws:

StreamingException

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint,
                        StreamingConnection conn)
                 throws ConnectionError,
                        SerializationError,
                        StreamingException

Parameters:

endPoint - the end point to write to

Throws:

ConnectionError

SerializationError

StreamingException

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint,
                        HiveConf conf,
                        StreamingConnection conn)
                 throws ConnectionError,
                        SerializationError,
                        StreamingException

Parameters:

endPoint - the end point to write to

conf - a Hive conf object. Should be null if not using advanced Hive settings.

conn - connection this Writer is to be used with

Throws:

ConnectionError

SerializationError

StreamingException

Method Detail

getSerde

public SerDe getSerde()

Description copied from class: AbstractRecordWriter

Get the SerDe for the Objects created by AbstractRecordWriter.encode(byte[]). This is public so that test frameworks can use it.

Specified by:

getSerde in class AbstractRecordWriter

Returns:

serde

getRecordObjectInspector

protected HCatRecordObjectInspector getRecordObjectInspector()

Specified by:

getRecordObjectInspector in class AbstractRecordWriter

getBucketStructFields

protected StructField[] getBucketStructFields()

Specified by:

getBucketStructFields in class AbstractRecordWriter

getBucketObjectInspectors

protected ObjectInspector[] getBucketObjectInspectors()

Specified by:

getBucketObjectInspectors in class AbstractRecordWriter

write

public void write(long transactionId,
                  byte[] record)
           throws StreamingIOFailure,
                  SerializationError

Description copied from interface: RecordWriter

Writes using a hive RecordUpdater

Parameters:

transactionId - the ID of the Txn in which the write occurs

record - the record to be written

Throws:

StreamingIOFailure

SerializationError

encode

public Object encode(byte[] utf8StrRecord)
              throws SerializationError

Description copied from class: AbstractRecordWriter

Encode a record as an Object that Hive can read with the ObjectInspector associated with the serde returned by AbstractRecordWriter.getSerde(). This is public so that test frameworks can use it.

Specified by:

encode in class AbstractRecordWriter

Parameters:

utf8StrRecord - record to be deserialized

Returns:

deserialized record as an Object

Throws:

SerializationError