org.apache.hadoop.hive.ql.exec.mr

Class ExecMapper

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

org.apache.hadoop.hive.ql.exec.mr.ExecMapper

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper

public class ExecMapper
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Mapper

ExecMapper is the generic Map class for Hive. Together with ExecReducer it is the bridge between the map-reduce framework and the Hive operator pipeline at execution time. It's main responsibilities are: - Load and setup the operator pipeline from XML - Run the pipeline by transforming key value pairs to records and forwarding them to the operators - Stop execution when the "limit" is reached - Catch and handle errors during execution of the operators.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ExecMapper.ReportStats reportStats.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.commons.logging.Log	l4j

Constructor Summary

Constructors

Constructor and Description
ExecMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
void	configure(org.apache.hadoop.mapred.JobConf job)
static boolean	getDone()
boolean	isAbort()
void	map(Object key, Object value, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter)
void	setAbort(boolean abort)
static void	setDone(boolean done)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

l4j

public static final org.apache.commons.logging.Log l4j

Constructor Detail

ExecMapper

public ExecMapper()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf job)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class org.apache.hadoop.mapred.MapReduceBase

map

public void map(Object key,
       Object value,
       org.apache.hadoop.mapred.OutputCollector output,
       org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper

Throws:

IOException

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.hadoop.mapred.MapReduceBase

getDone

public static boolean getDone()

isAbort

public boolean isAbort()

setAbort

public void setAbort(boolean abort)

setDone

public static void setDone(boolean done)