org.apache.hadoop.hive.ql.io

Class HiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader<K,V>

org.apache.hadoop.hive.ql.io.HiveRecordReader<K,V>

All Implemented Interfaces:

org.apache.hadoop.mapred.RecordReader<K,V>

public class HiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
extends HiveContextAwareRecordReader<K,V>

HiveRecordReader is a simple wrapper on RecordReader. It allows us to stop reading the data when some global flag ExecMapper.getDone() is set.

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader

isSorted, jobConf, recordReader

Constructor Summary

Constructors

Constructor and Description
HiveRecordReader(org.apache.hadoop.mapred.RecordReader recordReader)
HiveRecordReader(org.apache.hadoop.mapred.RecordReader recordReader, org.apache.hadoop.mapred.JobConf conf)

Method Summary

Methods

Modifier and Type	Method and Description
K	createKey()
V	createValue()
void	doClose() Close this InputSplit to future operations.
boolean	doNext(K key, V value)
long	getPos()
float	getProgress()

Methods inherited from class org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader

close, foundAllTargets, getIOContext, initIOContext, initIOContext, initIOContextSortedProps, next, setRecordReader, updateIOContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveRecordReader

public HiveRecordReader(org.apache.hadoop.mapred.RecordReader recordReader)
                 throws IOException

Throws:

IOException

HiveRecordReader

public HiveRecordReader(org.apache.hadoop.mapred.RecordReader recordReader,
                org.apache.hadoop.mapred.JobConf conf)
                 throws IOException

Throws:

IOException

Method Detail

doClose

public void doClose()
             throws IOException

Description copied from class: HiveContextAwareRecordReader

Close this InputSplit to future operations.

Specified by:

doClose in class HiveContextAwareRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Throws:

IOException

createKey

public K createKey()

createValue

public V createValue()

getPos

public long getPos()
            throws IOException

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException

Specified by:

getProgress in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Overrides:

getProgress in class HiveContextAwareRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Throws:

IOException

doNext

public boolean doNext(K key,
             V value)
               throws IOException

Overrides:

doNext in class HiveContextAwareRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Throws:

IOException