AppConfig (Hive 1.2.2 API)

java.lang.Object
- org.apache.hadoop.conf.Configuration
- - org.apache.hive.hcatalog.templeton.AppConfig

All Implemented Interfaces:

Iterable<Map.Entry<String,String>>, org.apache.hadoop.io.Writable
```
public class AppConfig
extends org.apache.hadoop.conf.Configuration
```
The configuration for Templeton. This merges the normal Hadoop configuration with the Templeton specific variables. The Templeton configuration variables are described in templeton-default.xml The Templeton specific configuration is split into two layers 1. webhcat-default.xml - All the configuration variables that Templeton needs. These are the defaults that ship with the app and should only be changed be the app developers. 2. webhcat-site.xml - The (possibly empty) configuration that the system administrator can set variables for their Hadoop cluster. The configuration files are loaded in this order with later files overriding earlier ones. To find the configuration files, we first attempt to load a file from the CLASSPATH and then look in the directory specified in the TEMPLETON_HOME environment variable. In addition the configuration files may access the special env variable env for all environment variables. For example, the hadoop executable could be specified using:
```
      ${env.HADOOP_PREFIX}/bin/hadoop
```

Nested Class Summary
- Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration
  org.apache.hadoop.conf.Configuration.DeprecationDelta, org.apache.hadoop.conf.Configuration.IntegerRanges

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`CALLBACK_INTERVAL_NAME`
`static String`	`CALLBACK_RETRY_NAME`
`static String`	`ENABLE_JOB_RECONNECT_DEFAULT`
`static String`	`EXEC_ENCODING_NAME`
`static String`	`EXEC_ENVS_NAME`
`static String`	`EXEC_MAX_BYTES_NAME`
`static String`	`EXEC_MAX_PROCS_NAME`
`static String`	`EXEC_TIMEOUT_NAME`
`static String`	`HADOOP_CHILD_JAVA_OPTS`
`static String`	`HADOOP_CONF_DIR`
`static String[]`	`HADOOP_CONF_FILENAMES`
`static String`	`HADOOP_END_INTERVAL_NAME`
`static String`	`HADOOP_END_RETRY_NAME`
`static String`	`HADOOP_END_URL_NAME`
`static String`	`HADOOP_MAP_MEMORY_MB`
`static String`	`HADOOP_MR_AM_JAVA_OPTS`
`static String`	`HADOOP_MR_AM_MEMORY_MB`
`static String`	`HADOOP_NAME`
`static String[]`	`HADOOP_PREFIX_VARS`
`static String`	`HADOOP_QUEUE_NAME`
`static String`	`HADOOP_SPECULATIVE_NAME`
`static String`	`HCAT_HOME_PATH` see webhcat-default.xml
`static String`	`HCAT_NAME`
`static String`	`HIVE_ARCHIVE_NAME`
`static String`	`HIVE_EXTRA_FILES` comma-separated list of artifacts to add to HADOOP_CLASSPATH evn var in LaunchMapper before launching Hive command
`static String`	`HIVE_HOME_PATH` see webhcat-default.xml
`static String`	`HIVE_PATH_NAME`
`static String`	`HIVE_PROPS_NAME` is a comma separated list of name=value pairs; In case some value is itself a comma-separated list, the comma needs to be escaped with `StringUtils.ESCAPE_CHAR`.
`static String`	`KERBEROS_KEYTAB`
`static String`	`KERBEROS_PRINCIPAL`
`static String`	`KERBEROS_SECRET`
`static String`	`LIB_JARS_NAME`
`static String`	`MAPPER_MEMORY_MB`
`static String`	`MR_AM_MEMORY_MB`
`static String`	`OVERRIDE_JARS_ENABLED`
`static String`	`OVERRIDE_JARS_NAME`
`static String`	`PIG_ARCHIVE_NAME`
`static String`	`PIG_PATH_NAME`
`static String`	`PORT`
`static String`	`PYTHON_NAME`
`static String`	`SQOOP_ARCHIVE_NAME`
`static String`	`SQOOP_HOME_PATH`
`static String`	`SQOOP_PATH_NAME`
`static String`	`STREAMING_JAR_NAME`
`static String[]`	`TEMPLETON_CONF_FILENAMES`
`static String`	`TEMPLETON_CONTROLLER_MR_AM_JAVA_OPTS`
`static String`	`TEMPLETON_CONTROLLER_MR_CHILD_OPTS`
`static String`	`TEMPLETON_HOME_VAR`
`static String`	`UNIT_TEST_MODE`
`static String`	`WEBHCAT_CONF_DIR`

Constructor Summary

Constructors
Constructor and Description

AppConfig()

Constructors
Constructor and Description
`AppConfig()`

Method Summary

Methods
Modifier and Type	Method and Description
`String`	`amMemoryMb()`
`String`	`clusterHadoop()`
`String`	`clusterHcat()`
`String`	`clusterPython()`
`String`	`controllerAMChildOpts()`
`String`	`controllerMRChildOpts()`
`String`	`enableJobReconnectDefault()`
`String`	`getHadoopConfDir()`
`static String`	`getTempletonDir()`
`static String`	`getWebhcatConfDir()`
`String`	`hadoopQueueName()`
`String`	`hiveArchive()`
`String`	`hivePath()`
`Collection<String>`	`hiveProps()`
`String`	`kerberosKeytab()`
`String`	`kerberosPrincipal()`
`String`	`kerberosSecret()`
`String`	`libJars()`
`String`	`mapperMemoryMb()`
`String[]`	`overrideJars()`
`String`	`overrideJarsString()`
`String`	`pigArchive()`
`String`	`pigPath()`
`String`	`sqoopArchive()`
`String`	`sqoopHome()`
`String`	`sqoopPath()`
`void`	`startCleanup()`
`String`	`streamingJar()`
`long`	`zkCleanupInterval()`
`String`	`zkHosts()`
`long`	`zkMaxAge()`
`int`	`zkSessionTimeout()`

Methods inherited from class org.apache.hadoop.conf.Configuration
addDefaultResource, addDeprecation, addDeprecation, addDeprecation, addDeprecation, addDeprecations, addResource, addResource, addResource, addResource, addResource, addResource, clear, dumpConfiguration, dumpDeprecatedKeys, get, get, getBoolean, getClass, getClass, getClassByName, getClassByNameOrNull, getClasses, getClassLoader, getConfResourceAsInputStream, getConfResourceAsReader, getDouble, getEnum, getFile, getFinalParameters, getFloat, getInstances, getInt, getInts, getLocalPath, getLong, getLongBytes, getPassword, getPasswordFromConfig, getPasswordFromCredentialProviders, getPattern, getPropertySources, getProps, getRange, getRaw, getResource, getSocketAddr, getSocketAddr, getStringCollection, getStrings, getStrings, getTimeDuration, getTrimmed, getTrimmed, getTrimmedStringCollection, getTrimmedStrings, getTrimmedStrings, getValByRegex, hasWarnedDeprecation, isDeprecated, iterator, main, readFields, reloadConfiguration, set, set, setBoolean, setBooleanIfUnset, setClass, setClassLoader, setDeprecatedProperties, setDouble, setEnum, setFloat, setIfUnset, setInt, setLong, setPattern, setQuietMode, setSocketAddr, setStrings, setTimeDuration, size, toString, unset, updateConnectAddr, updateConnectAddr, write, writeXml, writeXml

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail
- HADOOP_CONF_FILENAMES
```
public static final String[] HADOOP_CONF_FILENAMES
```
- HADOOP_PREFIX_VARS
```
public static final String[] HADOOP_PREFIX_VARS
```
- TEMPLETON_HOME_VAR
```
public static final String TEMPLETON_HOME_VAR
```
  See Also:
  Constant Field Values
- WEBHCAT_CONF_DIR
```
public static final String WEBHCAT_CONF_DIR
```
  See Also:
  Constant Field Values
- TEMPLETON_CONF_FILENAMES
```
public static final String[] TEMPLETON_CONF_FILENAMES
```
- PORT
```
public static final String PORT
```
  See Also:
  Constant Field Values
- EXEC_ENCODING_NAME
```
public static final String EXEC_ENCODING_NAME
```
  See Also:
  Constant Field Values
- EXEC_ENVS_NAME
```
public static final String EXEC_ENVS_NAME
```
  See Also:
  Constant Field Values
- EXEC_MAX_BYTES_NAME
```
public static final String EXEC_MAX_BYTES_NAME
```
  See Also:
  Constant Field Values
- EXEC_MAX_PROCS_NAME
```
public static final String EXEC_MAX_PROCS_NAME
```
  See Also:
  Constant Field Values
- EXEC_TIMEOUT_NAME
```
public static final String EXEC_TIMEOUT_NAME
```
  See Also:
  Constant Field Values
- HADOOP_QUEUE_NAME
```
public static final String HADOOP_QUEUE_NAME
```
  See Also:
  Constant Field Values
- ENABLE_JOB_RECONNECT_DEFAULT
```
public static final String ENABLE_JOB_RECONNECT_DEFAULT
```
  See Also:
  Constant Field Values
- HADOOP_NAME
```
public static final String HADOOP_NAME
```
  See Also:
  Constant Field Values
- HADOOP_CONF_DIR
```
public static final String HADOOP_CONF_DIR
```
  See Also:
  Constant Field Values
- HCAT_NAME
```
public static final String HCAT_NAME
```
  See Also:
  Constant Field Values
- PYTHON_NAME
```
public static final String PYTHON_NAME
```
  See Also:
  Constant Field Values
- HIVE_ARCHIVE_NAME
```
public static final String HIVE_ARCHIVE_NAME
```
  See Also:
  Constant Field Values
- HIVE_PATH_NAME
```
public static final String HIVE_PATH_NAME
```
  See Also:
  Constant Field Values
- MAPPER_MEMORY_MB
```
public static final String MAPPER_MEMORY_MB
```
  See Also:
  Constant Field Values
- MR_AM_MEMORY_MB
```
public static final String MR_AM_MEMORY_MB
```
  See Also:
  Constant Field Values
- HIVE_HOME_PATH
```
public static final String HIVE_HOME_PATH
```
  see webhcat-default.xml
  
  See Also:
  Constant Field Values
- HCAT_HOME_PATH
```
public static final String HCAT_HOME_PATH
```
  see webhcat-default.xml
  
  See Also:
  Constant Field Values
- HIVE_PROPS_NAME
```
public static final String HIVE_PROPS_NAME
```
  is a comma separated list of name=value pairs; In case some value is itself a comma-separated list, the comma needs to be escaped with StringUtils.ESCAPE_CHAR. See other usage of escape/unescape methods in StringUtils in webhcat.
  
  See Also:
  Constant Field Values
- SQOOP_ARCHIVE_NAME
```
public static final String SQOOP_ARCHIVE_NAME
```
  See Also:
  Constant Field Values
- SQOOP_PATH_NAME
```
public static final String SQOOP_PATH_NAME
```
  See Also:
  Constant Field Values
- SQOOP_HOME_PATH
```
public static final String SQOOP_HOME_PATH
```
  See Also:
  Constant Field Values
- LIB_JARS_NAME
```
public static final String LIB_JARS_NAME
```
  See Also:
  Constant Field Values
- PIG_ARCHIVE_NAME
```
public static final String PIG_ARCHIVE_NAME
```
  See Also:
  Constant Field Values
- PIG_PATH_NAME
```
public static final String PIG_PATH_NAME
```
  See Also:
  Constant Field Values
- STREAMING_JAR_NAME
```
public static final String STREAMING_JAR_NAME
```
  See Also:
  Constant Field Values
- OVERRIDE_JARS_NAME
```
public static final String OVERRIDE_JARS_NAME
```
  See Also:
  Constant Field Values
- OVERRIDE_JARS_ENABLED
```
public static final String OVERRIDE_JARS_ENABLED
```
  See Also:
  Constant Field Values
- TEMPLETON_CONTROLLER_MR_CHILD_OPTS
```
public static final String TEMPLETON_CONTROLLER_MR_CHILD_OPTS
```
  See Also:
  Constant Field Values
- TEMPLETON_CONTROLLER_MR_AM_JAVA_OPTS
```
public static final String TEMPLETON_CONTROLLER_MR_AM_JAVA_OPTS
```
  See Also:
  Constant Field Values
- KERBEROS_SECRET
```
public static final String KERBEROS_SECRET
```
  See Also:
  Constant Field Values
- KERBEROS_PRINCIPAL
```
public static final String KERBEROS_PRINCIPAL
```
  See Also:
  Constant Field Values
- KERBEROS_KEYTAB
```
public static final String KERBEROS_KEYTAB
```
  See Also:
  Constant Field Values
- CALLBACK_INTERVAL_NAME
```
public static final String CALLBACK_INTERVAL_NAME
```
  See Also:
  Constant Field Values
- CALLBACK_RETRY_NAME
```
public static final String CALLBACK_RETRY_NAME
```
  See Also:
  Constant Field Values
- HADOOP_END_INTERVAL_NAME
```
public static final String HADOOP_END_INTERVAL_NAME
```
  See Also:
  Constant Field Values
- HADOOP_END_RETRY_NAME
```
public static final String HADOOP_END_RETRY_NAME
```
  See Also:
  Constant Field Values
- HADOOP_END_URL_NAME
```
public static final String HADOOP_END_URL_NAME
```
  See Also:
  Constant Field Values
- HADOOP_SPECULATIVE_NAME
```
public static final String HADOOP_SPECULATIVE_NAME
```
  See Also:
  Constant Field Values
- HADOOP_CHILD_JAVA_OPTS
```
public static final String HADOOP_CHILD_JAVA_OPTS
```
  See Also:
  Constant Field Values
- HADOOP_MAP_MEMORY_MB
```
public static final String HADOOP_MAP_MEMORY_MB
```
  See Also:
  Constant Field Values
- HADOOP_MR_AM_JAVA_OPTS
```
public static final String HADOOP_MR_AM_JAVA_OPTS
```
  See Also:
  Constant Field Values
- HADOOP_MR_AM_MEMORY_MB
```
public static final String HADOOP_MR_AM_MEMORY_MB
```
  See Also:
  Constant Field Values
- UNIT_TEST_MODE
```
public static final String UNIT_TEST_MODE
```
  See Also:
  Constant Field Values
- HIVE_EXTRA_FILES
```
public static final String HIVE_EXTRA_FILES
```
  comma-separated list of artifacts to add to HADOOP_CLASSPATH evn var in LaunchMapper before launching Hive command
  
  See Also:
  Constant Field Values

Constructor Detail
- AppConfig
```
public AppConfig()
```

Method Detail

startCleanup
```
public void startCleanup()
```

getHadoopConfDir
```
public String getHadoopConfDir()
```

getTempletonDir

public static String getTempletonDir()

getWebhcatConfDir

public static String getWebhcatConfDir()

libJars
```
public String libJars()
```

hadoopQueueName
```
public String hadoopQueueName()
```

enableJobReconnectDefault

public String enableJobReconnectDefault()

clusterHadoop
```
public String clusterHadoop()
```

clusterHcat
```
public String clusterHcat()
```

clusterPython
```
public String clusterPython()
```

pigPath
```
public String pigPath()
```

pigArchive
```
public String pigArchive()
```

hivePath
```
public String hivePath()
```

hiveArchive
```
public String hiveArchive()
```

sqoopPath
```
public String sqoopPath()
```

sqoopArchive
```
public String sqoopArchive()
```

sqoopHome
```
public String sqoopHome()
```

streamingJar
```
public String streamingJar()
```

kerberosSecret
```
public String kerberosSecret()
```

kerberosPrincipal
```
public String kerberosPrincipal()
```

kerberosKeytab
```
public String kerberosKeytab()
```

controllerMRChildOpts
```
public String controllerMRChildOpts()
```

controllerAMChildOpts
```
public String controllerAMChildOpts()
```

mapperMemoryMb
```
public String mapperMemoryMb()
```

amMemoryMb
```
public String amMemoryMb()
```

hiveProps
```
public Collection<String> hiveProps()
```
See Also:
HIVE_PROPS_NAME

overrideJars
```
public String[] overrideJars()
```

overrideJarsString
```
public String overrideJarsString()
```

zkCleanupInterval
```
public long zkCleanupInterval()
```

zkMaxAge
```
public long zkMaxAge()
```

zkHosts
```
public String zkHosts()
```

zkSessionTimeout
```
public int zkSessionTimeout()
```

Class AppConfig

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration

Field Summary

Constructor Summary

Method Summary

Methods inherited from class org.apache.hadoop.conf.Configuration

Methods inherited from class java.lang.Object

Field Detail

HADOOP_CONF_FILENAMES

HADOOP_PREFIX_VARS

TEMPLETON_HOME_VAR

WEBHCAT_CONF_DIR

TEMPLETON_CONF_FILENAMES

PORT

EXEC_ENCODING_NAME

EXEC_ENVS_NAME

EXEC_MAX_BYTES_NAME

EXEC_MAX_PROCS_NAME

EXEC_TIMEOUT_NAME

HADOOP_QUEUE_NAME

ENABLE_JOB_RECONNECT_DEFAULT

HADOOP_NAME

HADOOP_CONF_DIR

HCAT_NAME

PYTHON_NAME

HIVE_ARCHIVE_NAME

HIVE_PATH_NAME

MAPPER_MEMORY_MB

MR_AM_MEMORY_MB

HIVE_HOME_PATH

HCAT_HOME_PATH

HIVE_PROPS_NAME

SQOOP_ARCHIVE_NAME

SQOOP_PATH_NAME

SQOOP_HOME_PATH

LIB_JARS_NAME

PIG_ARCHIVE_NAME

PIG_PATH_NAME

STREAMING_JAR_NAME

OVERRIDE_JARS_NAME

OVERRIDE_JARS_ENABLED

TEMPLETON_CONTROLLER_MR_CHILD_OPTS

TEMPLETON_CONTROLLER_MR_AM_JAVA_OPTS

KERBEROS_SECRET

KERBEROS_PRINCIPAL

KERBEROS_KEYTAB

CALLBACK_INTERVAL_NAME

CALLBACK_RETRY_NAME

HADOOP_END_INTERVAL_NAME

HADOOP_END_RETRY_NAME

HADOOP_END_URL_NAME

HADOOP_SPECULATIVE_NAME

HADOOP_CHILD_JAVA_OPTS

HADOOP_MAP_MEMORY_MB

HADOOP_MR_AM_JAVA_OPTS

HADOOP_MR_AM_MEMORY_MB

UNIT_TEST_MODE

HIVE_EXTRA_FILES

Constructor Detail

AppConfig

Method Detail

startCleanup

getHadoopConfDir

getTempletonDir

getWebhcatConfDir

libJars

hadoopQueueName

enableJobReconnectDefault

clusterHadoop

clusterHcat

clusterPython

pigPath

pigArchive

hivePath

hiveArchive

sqoopPath

sqoopArchive

sqoopHome

streamingJar