public class LlapArrowRecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable> extends Object implements org.apache.hadoop.mapred.RecordWriter<K,V>
ArrowStreamWriter
.
The byte stream will be formatted according to the Arrow Streaming format.
Because ArrowStreamWriter is bound to a VectorSchemaRoot
when it is created,
calls to the write(Writable, Writable)
method only serve as a signal that
a new batch has been loaded to the associated VectorSchemaRoot.
Payload data for writing is indirectly made available by reference:
ArrowStreamWriter -> VectorSchemaRoot -> ListModifier and Type | Field and Description |
---|---|
static org.slf4j.Logger |
LOG |
Constructor and Description |
---|
LlapArrowRecordWriter(WritableByteChannel out) |
Modifier and Type | Method and Description |
---|---|
void |
close(org.apache.hadoop.mapred.Reporter reporter) |
void |
write(K key,
V value) |
public LlapArrowRecordWriter(WritableByteChannel out)
public void close(org.apache.hadoop.mapred.Reporter reporter) throws IOException
close
in interface org.apache.hadoop.mapred.RecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
IOException
public void write(K key, V value) throws IOException
write
in interface org.apache.hadoop.mapred.RecordWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
IOException
Copyright © 2022 The Apache Software Foundation. All rights reserved.