org.apache.hadoop.hive.shims

Class MiniSparkOnYARNCluster

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.service.CompositeService

org.apache.hadoop.yarn.server.MiniYARNCluster

org.apache.hadoop.hive.shims.MiniSparkOnYARNCluster

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.service.Service

public class MiniSparkOnYARNCluster
extends org.apache.hadoop.yarn.server.MiniYARNCluster

This should be a very thin wrapper of MiniYARNCluster, which helps to build a embedded YARN cluster for Spark.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.service.CompositeService

org.apache.hadoop.service.CompositeService.CompositeServiceShutdownHook

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields inherited from class org.apache.hadoop.service.CompositeService

STOP_ONLY_STARTED_SERVICES

Constructor Summary

Constructors

Constructor and Description
MiniSparkOnYARNCluster(String testName)
MiniSparkOnYARNCluster(String testName, int numResourceManagers, int numNodeManagers)
MiniSparkOnYARNCluster(String testName, int numResourceManagers, int numNodeManagers, int numLocalDirs, int numLogDirs)

Method Summary

Methods inherited from class org.apache.hadoop.yarn.server.MiniYARNCluster

createResourceManager, getActiveRMIndex, getApplicationHistoryServer, getHostname, getNodeManager, getNumOfResourceManager, getResourceManager, getResourceManager, getTestWorkDir, restartResourceManager, serviceInit, stopResourceManager, waitForNodeManagersToConnect

Methods inherited from class org.apache.hadoop.service.CompositeService

addIfService, addService, getServices, removeService, serviceStart, serviceStop

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

MiniSparkOnYARNCluster

public MiniSparkOnYARNCluster(String testName)

MiniSparkOnYARNCluster

public MiniSparkOnYARNCluster(String testName,
                      int numResourceManagers,
                      int numNodeManagers)

MiniSparkOnYARNCluster

public MiniSparkOnYARNCluster(String testName,
                      int numResourceManagers,
                      int numNodeManagers,
                      int numLocalDirs,
                      int numLogDirs)