org.apache.hadoop.hive.ql.exec.tez

Class RecordProcessor

java.lang.Object

org.apache.hadoop.hive.ql.exec.tez.RecordProcessor

Direct Known Subclasses:

MapRecordProcessor, MergeFileRecordProcessor, ReduceRecordProcessor

public abstract class RecordProcessor
extends Object

Process input from tez LogicalInput and write output It has different subclasses for map and reduce processing

Field Summary

Fields

Modifier and Type	Field and Description
protected String	CLASS_NAME
protected Map<String,org.apache.tez.runtime.api.LogicalInput>	inputs
protected boolean	isLogInfoEnabled
protected boolean	isLogTraceEnabled
protected org.apache.hadoop.mapred.JobConf	jconf
static org.apache.commons.logging.Log	l4j
protected Map<String,org.apache.hadoop.mapred.OutputCollector>	outMap
protected Map<String,org.apache.tez.runtime.api.LogicalOutput>	outputs
protected PerfLogger	perfLogger
protected org.apache.tez.runtime.api.ProcessorContext	processorContext
protected org.apache.tez.mapreduce.processor.MRTaskReporter	reporter

Constructor Summary

Constructors

Constructor and Description
RecordProcessor(org.apache.hadoop.mapred.JobConf jConf, org.apache.tez.runtime.api.ProcessorContext processorContext)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	createOutputMap()
List<BaseWork>	getMergeWorkList(org.apache.hadoop.mapred.JobConf jconf, String key, String queryId, ObjectCache cache, List<String> cacheKeys)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jconf

protected final org.apache.hadoop.mapred.JobConf jconf

inputs

protected Map<String,org.apache.tez.runtime.api.LogicalInput> inputs

outputs

protected Map<String,org.apache.tez.runtime.api.LogicalOutput> outputs

outMap

protected Map<String,org.apache.hadoop.mapred.OutputCollector> outMap

processorContext

protected final org.apache.tez.runtime.api.ProcessorContext processorContext

l4j

public static final org.apache.commons.logging.Log l4j

isLogInfoEnabled

protected boolean isLogInfoEnabled

isLogTraceEnabled

protected boolean isLogTraceEnabled

reporter

protected org.apache.tez.mapreduce.processor.MRTaskReporter reporter

perfLogger

protected PerfLogger perfLogger

CLASS_NAME

protected String CLASS_NAME

Constructor Detail

RecordProcessor

public RecordProcessor(org.apache.hadoop.mapred.JobConf jConf,
               org.apache.tez.runtime.api.ProcessorContext processorContext)

Method Detail

createOutputMap

protected void createOutputMap()

getMergeWorkList

public List<BaseWork> getMergeWorkList(org.apache.hadoop.mapred.JobConf jconf,
                              String key,
                              String queryId,
                              ObjectCache cache,
                              List<String> cacheKeys)
                                throws HiveException

Throws:

HiveException