org.apache.hive.hcatalog.templeton.tool

Class LaunchMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hive.hcatalog.templeton.tool.LaunchMapper

All Implemented Interfaces:

JobSubmissionConstants

@InterfaceAudience.Private
public class LaunchMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
implements JobSubmissionConstants

Note that this class is used in a different JVM than WebHCat server. Thus it should not call any classes not available on every node in the cluster (outside webhcat jar). TempletonControllerJob#run() calls Job.setJarByClass(LaunchMapper.class) which causes webhcat jar to be shipped to target node, but not it's transitive closure. Long term we need to clean up this separation and create a separate jar to ship so that the dependencies are clear. (This used to be an inner class of TempletonControllerJob)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Nested classes/interfaces inherited from interface org.apache.hive.hcatalog.templeton.tool.JobSubmissionConstants

JobSubmissionConstants.PigConstants, JobSubmissionConstants.Sqoop

Field Summary

Fields inherited from interface org.apache.hive.hcatalog.templeton.tool.JobSubmissionConstants

COPY_NAME, ENABLE_JOB_RECONNECT, ENABLE_LOG, EXIT_FNAME, HADOOP_CLASSPATH, HADOOP_CLASSPATH_EXTRAS, JAR_ARGS_NAME, JOB_TYPE, KEEP_ALIVE_MSEC, MAPREDUCE_JOB_TAGS, MAPREDUCE_JOB_TAGS_ARG_PLACEHOLDER, OVERRIDE_CLASSPATH, POLL_JOBPROGRESS_MSEC, STATUSDIR_NAME, STDERR_FNAME, STDOUT_FNAME, TEMPLETON_JOB_LAUNCH_TIME_NAME, TOKEN_FILE_ARG_PLACEHOLDER, TOKEN_FILE_ARG_PLACEHOLDER_TEZ, WATCHER_TIMEOUT_SECS

Constructor Summary

Constructors

Constructor and Description
LaunchMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	run(org.apache.hadoop.mapreduce.Mapper.Context context)
protected Process	startJob(org.apache.hadoop.conf.Configuration conf, String jobId, String user, String overrideClasspath)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, map, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LaunchMapper

public LaunchMapper()

Method Detail

startJob

protected Process startJob(org.apache.hadoop.conf.Configuration conf,
               String jobId,
               String user,
               String overrideClasspath)
                    throws IOException,
                           InterruptedException

Throws:

IOException

InterruptedException

run

public void run(org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException,
                InterruptedException

Overrides:

run in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException