org.apache.hive.hcatalog.streaming

Class StrictJsonWriter

java.lang.Object

org.apache.hive.hcatalog.streaming.StrictJsonWriter

All Implemented Interfaces:

RecordWriter

public class StrictJsonWriter
extends Object

Streaming Writer handles utf8 encoded Json (Strict syntax). Uses org.apache.hive.hcatalog.data.JsonSerDe to process Json input

Constructor Summary

Constructors

Constructor and Description
StrictJsonWriter(HiveEndPoint endPoint)
StrictJsonWriter(HiveEndPoint endPoint, HiveConf conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	clear() Clear bufferred writes.
void	closeBatch() Close the RecordUpdater.
void	flush() Flush records from buffer.
void	newBatch(Long minTxnId, Long maxTxnID) Creates a new record updater for the new batch
void	write(long transactionId, byte[] record) Writes using a hive RecordUpdater

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint)
                 throws ConnectionError,
                        SerializationError,
                        StreamingException

Parameters:

endPoint - the end point to write to

Throws:

ConnectionError

SerializationError

StreamingException

StrictJsonWriter

public StrictJsonWriter(HiveEndPoint endPoint,
                HiveConf conf)
                 throws ConnectionError,
                        SerializationError,
                        StreamingException

Parameters:

endPoint - the end point to write to

conf - a Hive conf object. Should be null if not using advanced Hive settings.

Throws:

ConnectionError

SerializationError

StreamingException

Method Detail

write

public void write(long transactionId,
         byte[] record)
           throws StreamingIOFailure,
                  SerializationError

Description copied from interface: RecordWriter

Writes using a hive RecordUpdater

Parameters:

transactionId - the ID of the Txn in which the write occurs

record - the record to be written

Throws:

StreamingIOFailure

SerializationError

flush

public void flush()
           throws StreamingIOFailure

Description copied from interface: RecordWriter

Flush records from buffer. Invoked by TransactionBatch.commit()

Specified by:

flush in interface RecordWriter

Throws:

StreamingIOFailure

clear

public void clear()
           throws StreamingIOFailure

Description copied from interface: RecordWriter

Clear bufferred writes. Invoked by TransactionBatch.abort()

Specified by:

clear in interface RecordWriter

Throws:

StreamingIOFailure

newBatch

public void newBatch(Long minTxnId,
            Long maxTxnID)
              throws StreamingIOFailure,
                     SerializationError

Creates a new record updater for the new batch

Specified by:

newBatch in interface RecordWriter

Parameters:

minTxnId - smallest Txnid in the batch

maxTxnID - largest Txnid in the batch

Throws:

StreamingIOFailure - if failed to create record updater

SerializationError

closeBatch

public void closeBatch()
                throws StreamingIOFailure

Description copied from interface: RecordWriter

Close the RecordUpdater. Invoked by TransactionBatch.close()

Specified by:

closeBatch in interface RecordWriter

Throws:

StreamingIOFailure