HCatConstants (Hive 1.2.2 API)

java.lang.Object
- org.apache.hive.hcatalog.common.HCatConstants

public final class HCatConstants
extends Object

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`CONF_LABEL_HCAT_MESSAGE_FACTORY_IMPL_PREFIX`
`static String`	`CONF_LABEL_HCAT_MESSAGE_FORMAT`
`static String`	`CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY`
`static String`	`DEFAULT_MESSAGE_FACTORY_IMPL`
`static String`	`HCAT_ADD_PARTITION_EVENT`
`static String`	`HCAT_ALTER_PARTITION_EVENT`
`static String`	`HCAT_ALTER_TABLE_EVENT`
`static String`	`HCAT_APPEND_LIMIT` hcat.append.limit allows a hcat user to specify a custom append limit.
`static String`	`HCAT_CREATE_DATABASE_EVENT`
`static String`	`HCAT_CREATE_DB_NAME`
`static String`	`HCAT_CREATE_TABLE_EVENT`
`static String`	`HCAT_CREATE_TBL_NAME`
`static String`	`HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER` "hcat.data.convert.boolean.to.integer" (default: false).
`static boolean`	`HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT`
`static String`	`HCAT_DATA_TINY_SMALL_INT_PROMOTION` "hcat.data.tiny.small.int.promotion" (default: false).
`static boolean`	`HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT`
`static String`	`HCAT_DEFAULT_TOPIC_PREFIX`
`static String`	`HCAT_DESIRED_PARTITION_NUM_SPLITS` The desired number of input splits produced for each partition.
`static String`	`HCAT_DROP_DATABASE_EVENT`
`static String`	`HCAT_DROP_PARTITION_EVENT`
`static String`	`HCAT_DROP_TABLE_EVENT`
`static String`	`HCAT_DYNAMIC_CUSTOM_PATTERN`
`static String`	`HCAT_DYNAMIC_PTN_JOBID`
`static String`	`HCAT_EVENT`
`static String`	`HCAT_GROUP`
`static String`	`HCAT_HIVE_CLIENT_DISABLE_CACHE`
`static String`	`HCAT_HIVE_CLIENT_EXPIRY_TIME`
`static int`	`HCAT_INPUT_BAD_RECORD_MIN_DEFAULT`
`static String`	`HCAT_INPUT_BAD_RECORD_MIN_KEY` "hcat.input.bad.record.min" (default: 2).
`static float`	`HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT`
`static String`	`HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY` "hcat.input.bad.record.threshold" (default: 9.999999747378752E-5f).
`static String`	`HCAT_INSERT_EVENT`
`static boolean`	`HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED`
`static String`	`HCAT_KEY_BASE`
`static String`	`HCAT_KEY_HIVE_CONF`
`static String`	`HCAT_KEY_JOB_INFO`
`static String`	`HCAT_KEY_OUTPUT_BASE`
`static String`	`HCAT_KEY_OUTPUT_INFO`
`static String`	`HCAT_KEY_OUTPUT_SCHEMA`
`static String`	`HCAT_KEY_TOKEN_SIGNATURE`
`static String`	`HCAT_MESSAGE_FORMAT`
`static String`	`HCAT_MESSAGE_VERSION`
`static String`	`HCAT_METASTORE_PRINCIPAL`
`static String`	`HCAT_METASTORE_URI`
`static String`	`HCAT_MSG_CLEAN_FREQ`
`static String`	`HCAT_MSG_EXPIRY_DURATION`
`static String`	`HCAT_MSGBUS_TOPIC_NAME`
`static String`	`HCAT_MSGBUS_TOPIC_NAMING_POLICY`
`static String`	`HCAT_MSGBUS_TOPIC_PREFIX`
`static String`	`HCAT_OUTPUT_ID_HASH`
`static String`	`HCAT_PARTITION_DONE_EVENT`
`static String`	`HCAT_PERMS`
`static String`	`HCAT_PIG_ARGS_DELIMIT`
`static String`	`HCAT_PIG_ARGS_DELIMIT_DEFAULT`
`static String`	`HCAT_PIG_INNER_FIELD_NAME`
`static String`	`HCAT_PIG_INNER_FIELD_NAME_DEFAULT`
`static String`	`HCAT_PIG_INNER_TUPLE_NAME`
`static String`	`HCAT_PIG_INNER_TUPLE_NAME_DEFAULT`
`static String`	`HCAT_PIG_LOADER`
`static String`	`HCAT_PIG_LOADER_ARGS`
`static String`	`HCAT_PIG_LOADER_LOCATION_SET`
`static String`	`HCAT_PIG_STORAGE_CLASS`
`static String`	`HCAT_PIG_STORER`
`static String`	`HCAT_PIG_STORER_ARGS`
`static String`	`HCAT_PIG_STORER_EXTERNAL_LOCATION` "hcat.pig.storer.external.location" (default: null) When the property is set in the UDFContext of the org.apache.hive.hcatalog.pig.HCatStorer, HCatStorer writes to the location it specifies instead of the default HCatalog location format.
`static String`	`HCAT_PIG_STORER_LOCATION_SET`
`static String`	`HCAT_TABLE_SCHEMA`
`static String`	`HIVE_RCFILE_IF_CLASS`
`static String`	`HIVE_RCFILE_OF_CLASS`
`static String[]`	`OUTPUT_CONFS_TO_SAVE`
`static String`	`SEQUENCEFILE_INPUT`
`static String`	`SEQUENCEFILE_OUTPUT`
`static String`	`SYSENV_HADOOP_TOKEN_FILE_LOCATION`

Method Summary
- Methods inherited from class java.lang.Object
  clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - HIVE_RCFILE_IF_CLASS
```
public static final String HIVE_RCFILE_IF_CLASS
```
    See Also:
    Constant Field Values
  - HIVE_RCFILE_OF_CLASS
```
public static final String HIVE_RCFILE_OF_CLASS
```
    See Also:
    Constant Field Values
  - SEQUENCEFILE_INPUT
```
public static final String SEQUENCEFILE_INPUT
```
  - SEQUENCEFILE_OUTPUT
```
public static final String SEQUENCEFILE_OUTPUT
```
  - HCAT_PIG_STORAGE_CLASS
```
public static final String HCAT_PIG_STORAGE_CLASS
```
    See Also:
    Constant Field Values
  - HCAT_PIG_LOADER
```
public static final String HCAT_PIG_LOADER
```
    See Also:
    Constant Field Values
  - HCAT_PIG_LOADER_LOCATION_SET
```
public static final String HCAT_PIG_LOADER_LOCATION_SET
```
    See Also:
    Constant Field Values
  - HCAT_PIG_LOADER_ARGS
```
public static final String HCAT_PIG_LOADER_ARGS
```
    See Also:
    Constant Field Values
  - HCAT_PIG_STORER
```
public static final String HCAT_PIG_STORER
```
    See Also:
    Constant Field Values
  - HCAT_PIG_STORER_ARGS
```
public static final String HCAT_PIG_STORER_ARGS
```
    See Also:
    Constant Field Values
  - HCAT_PIG_ARGS_DELIMIT
```
public static final String HCAT_PIG_ARGS_DELIMIT
```
    See Also:
    Constant Field Values
  - HCAT_PIG_ARGS_DELIMIT_DEFAULT
```
public static final String HCAT_PIG_ARGS_DELIMIT_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_PIG_STORER_LOCATION_SET
```
public static final String HCAT_PIG_STORER_LOCATION_SET
```
    See Also:
    Constant Field Values
  - HCAT_PIG_INNER_TUPLE_NAME
```
public static final String HCAT_PIG_INNER_TUPLE_NAME
```
    See Also:
    Constant Field Values
  - HCAT_PIG_INNER_TUPLE_NAME_DEFAULT
```
public static final String HCAT_PIG_INNER_TUPLE_NAME_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_PIG_INNER_FIELD_NAME
```
public static final String HCAT_PIG_INNER_FIELD_NAME
```
    See Also:
    Constant Field Values
  - HCAT_PIG_INNER_FIELD_NAME_DEFAULT
```
public static final String HCAT_PIG_INNER_FIELD_NAME_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_PIG_STORER_EXTERNAL_LOCATION
```
public static final String HCAT_PIG_STORER_EXTERNAL_LOCATION
```
    "hcat.pig.storer.external.location" (default: null) When the property is set in the UDFContext of the org.apache.hive.hcatalog.pig.HCatStorer, HCatStorer writes to the location it specifies instead of the default HCatalog location format. An example can be found in org.apache.hive.hcatalog.pig.HCatStorerWrapper.
    
    See Also:
    Constant Field Values
  - HCAT_KEY_BASE
```
public static final String HCAT_KEY_BASE
```
    See Also:
    Constant Field Values
  - HCAT_KEY_OUTPUT_SCHEMA
```
public static final String HCAT_KEY_OUTPUT_SCHEMA
```
    See Also:
    Constant Field Values
  - HCAT_KEY_JOB_INFO
```
public static final String HCAT_KEY_JOB_INFO
```
    See Also:
    Constant Field Values
  - HCAT_HIVE_CLIENT_EXPIRY_TIME
```
public static final String HCAT_HIVE_CLIENT_EXPIRY_TIME
```
    See Also:
    Constant Field Values
  - HCAT_HIVE_CLIENT_DISABLE_CACHE
```
public static final String HCAT_HIVE_CLIENT_DISABLE_CACHE
```
    See Also:
    Constant Field Values
  - HCAT_TABLE_SCHEMA
```
public static final String HCAT_TABLE_SCHEMA
```
    See Also:
    Constant Field Values
  - HCAT_METASTORE_URI
```
public static final String HCAT_METASTORE_URI
```
  - HCAT_PERMS
```
public static final String HCAT_PERMS
```
    See Also:
    Constant Field Values
  - HCAT_GROUP
```
public static final String HCAT_GROUP
```
    See Also:
    Constant Field Values
  - HCAT_CREATE_TBL_NAME
```
public static final String HCAT_CREATE_TBL_NAME
```
    See Also:
    Constant Field Values
  - HCAT_CREATE_DB_NAME
```
public static final String HCAT_CREATE_DB_NAME
```
    See Also:
    Constant Field Values
  - HCAT_METASTORE_PRINCIPAL
```
public static final String HCAT_METASTORE_PRINCIPAL
```
  - HCAT_DESIRED_PARTITION_NUM_SPLITS
```
public static final String HCAT_DESIRED_PARTITION_NUM_SPLITS
```
    The desired number of input splits produced for each partition. When the input files are large and few, we want to split them into many splits, so as to increase the parallelizm of loading the splits. Try also two other parameters, mapred.min.split.size and mapred.max.split.size for hadoop 1.x, or mapreduce.input.fileinputformat.split.minsize and mapreduce.input.fileinputformat.split.maxsize in hadoop 2.x to control the number of input splits.
    
    See Also:
    Constant Field Values
  - HCAT_APPEND_LIMIT
```
public static final String HCAT_APPEND_LIMIT
```
    hcat.append.limit allows a hcat user to specify a custom append limit. By default, while appending to an existing directory, hcat will attempt to avoid naming clashes and try to append _a_NNN where NNN is a number to the desired filename to avoid clashes. However, by default, it only tries for NNN from 0 to 999 before giving up. This can cause an issue for some tables with an extraordinarily large number of files. Ideally, this should be fixed by the user changing their usage pattern and doing some manner of compaction, but in the meanwhile, until they can, setting this parameter can be used to bump that limit.
    
    See Also:
    Constant Field Values
  - HCAT_KEY_OUTPUT_BASE
```
public static final String HCAT_KEY_OUTPUT_BASE
```
    See Also:
    Constant Field Values
  - HCAT_KEY_OUTPUT_INFO
```
public static final String HCAT_KEY_OUTPUT_INFO
```
    See Also:
    Constant Field Values
  - HCAT_KEY_HIVE_CONF
```
public static final String HCAT_KEY_HIVE_CONF
```
    See Also:
    Constant Field Values
  - HCAT_KEY_TOKEN_SIGNATURE
```
public static final String HCAT_KEY_TOKEN_SIGNATURE
```
    See Also:
    Constant Field Values
  - OUTPUT_CONFS_TO_SAVE
```
public static final String[] OUTPUT_CONFS_TO_SAVE
```
  - HCAT_MSG_CLEAN_FREQ
```
public static final String HCAT_MSG_CLEAN_FREQ
```
    See Also:
    Constant Field Values
  - HCAT_MSG_EXPIRY_DURATION
```
public static final String HCAT_MSG_EXPIRY_DURATION
```
    See Also:
    Constant Field Values
  - HCAT_MSGBUS_TOPIC_NAME
```
public static final String HCAT_MSGBUS_TOPIC_NAME
```
    See Also:
    Constant Field Values
  - HCAT_MSGBUS_TOPIC_NAMING_POLICY
```
public static final String HCAT_MSGBUS_TOPIC_NAMING_POLICY
```
    See Also:
    Constant Field Values
  - HCAT_MSGBUS_TOPIC_PREFIX
```
public static final String HCAT_MSGBUS_TOPIC_PREFIX
```
    See Also:
    Constant Field Values
  - HCAT_OUTPUT_ID_HASH
```
public static final String HCAT_OUTPUT_ID_HASH
```
    See Also:
    Constant Field Values
  - HCAT_DYNAMIC_PTN_JOBID
```
public static final String HCAT_DYNAMIC_PTN_JOBID
```
    See Also:
    Constant Field Values
  - HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED
```
public static final boolean HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED
```
    See Also:
    Constant Field Values
  - HCAT_DYNAMIC_CUSTOM_PATTERN
```
public static final String HCAT_DYNAMIC_CUSTOM_PATTERN
```
    See Also:
    Constant Field Values
  - HCAT_DEFAULT_TOPIC_PREFIX
```
public static final String HCAT_DEFAULT_TOPIC_PREFIX
```
    See Also:
    Constant Field Values
  - HCAT_EVENT
```
public static final String HCAT_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_ADD_PARTITION_EVENT
```
public static final String HCAT_ADD_PARTITION_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_DROP_PARTITION_EVENT
```
public static final String HCAT_DROP_PARTITION_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_ALTER_PARTITION_EVENT
```
public static final String HCAT_ALTER_PARTITION_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_PARTITION_DONE_EVENT
```
public static final String HCAT_PARTITION_DONE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_CREATE_TABLE_EVENT
```
public static final String HCAT_CREATE_TABLE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_ALTER_TABLE_EVENT
```
public static final String HCAT_ALTER_TABLE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_DROP_TABLE_EVENT
```
public static final String HCAT_DROP_TABLE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_CREATE_DATABASE_EVENT
```
public static final String HCAT_CREATE_DATABASE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_DROP_DATABASE_EVENT
```
public static final String HCAT_DROP_DATABASE_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_INSERT_EVENT
```
public static final String HCAT_INSERT_EVENT
```
    See Also:
    Constant Field Values
  - HCAT_MESSAGE_VERSION
```
public static final String HCAT_MESSAGE_VERSION
```
    See Also:
    Constant Field Values
  - HCAT_MESSAGE_FORMAT
```
public static final String HCAT_MESSAGE_FORMAT
```
    See Also:
    Constant Field Values
  - CONF_LABEL_HCAT_MESSAGE_FACTORY_IMPL_PREFIX
```
public static final String CONF_LABEL_HCAT_MESSAGE_FACTORY_IMPL_PREFIX
```
    See Also:
    Constant Field Values
  - CONF_LABEL_HCAT_MESSAGE_FORMAT
```
public static final String CONF_LABEL_HCAT_MESSAGE_FORMAT
```
    See Also:
    Constant Field Values
  - DEFAULT_MESSAGE_FACTORY_IMPL
```
public static final String DEFAULT_MESSAGE_FACTORY_IMPL
```
    See Also:
    Constant Field Values
  - SYSENV_HADOOP_TOKEN_FILE_LOCATION
```
public static final String SYSENV_HADOOP_TOKEN_FILE_LOCATION
```
    See Also:
    Constant Field Values
  - CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY
```
public static final String CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY
```
    See Also:
    Constant Field Values
  - HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER
```
public static final String HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER
```
    "hcat.data.convert.boolean.to.integer" (default: false). Pig < 0.10.0 does not have boolean support, and scripts written for pre-boolean Pig versions will not expect boolean values when upgrading Pig. For integration the option is offered to convert boolean fields to integers by setting this Hadoop configuration key.
    
    See Also:
    Constant Field Values
  - HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT
```
public static final boolean HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_DATA_TINY_SMALL_INT_PROMOTION
```
public static final String HCAT_DATA_TINY_SMALL_INT_PROMOTION
```
    "hcat.data.tiny.small.int.promotion" (default: false). Hive tables support tinyint and smallint columns, while not all processing frameworks support these types (Pig only has integer for example). Enable this property to promote tinyint and smallint columns to integer at runtime. Note that writes to tinyint and smallint columns enforce bounds checking and jobs will fail if attempting to write values outside the column bounds.
    
    See Also:
    Constant Field Values
  - HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT
```
public static final boolean HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY
```
public static final String HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY
```
    "hcat.input.bad.record.threshold" (default: 9.999999747378752E-5f). Threshold for the ratio of bad records that will be silently skipped without causing a task failure. This is useful when processing large data sets with corrupt records, when its acceptable to skip some bad records.
    
    See Also:
    Constant Field Values
  - HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT
```
public static final float HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT
```
    See Also:
    Constant Field Values
  - HCAT_INPUT_BAD_RECORD_MIN_KEY
```
public static final String HCAT_INPUT_BAD_RECORD_MIN_KEY
```
    "hcat.input.bad.record.min" (default: 2). Number of bad records that will be accepted before applying "hcat.input.bad.record.threshold". This is necessary to prevent an initial bad record from causing a task failure.
    
    See Also:
    Constant Field Values
  - HCAT_INPUT_BAD_RECORD_MIN_DEFAULT
```
public static final int HCAT_INPUT_BAD_RECORD_MIN_DEFAULT
```
    See Also:
    Constant Field Values

Class HCatConstants

Field Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

HIVE_RCFILE_IF_CLASS

HIVE_RCFILE_OF_CLASS

SEQUENCEFILE_INPUT

SEQUENCEFILE_OUTPUT

HCAT_PIG_STORAGE_CLASS

HCAT_PIG_LOADER

HCAT_PIG_LOADER_LOCATION_SET

HCAT_PIG_LOADER_ARGS

HCAT_PIG_STORER

HCAT_PIG_STORER_ARGS

HCAT_PIG_ARGS_DELIMIT

HCAT_PIG_ARGS_DELIMIT_DEFAULT

HCAT_PIG_STORER_LOCATION_SET

HCAT_PIG_INNER_TUPLE_NAME

HCAT_PIG_INNER_TUPLE_NAME_DEFAULT

HCAT_PIG_INNER_FIELD_NAME

HCAT_PIG_INNER_FIELD_NAME_DEFAULT

HCAT_PIG_STORER_EXTERNAL_LOCATION

HCAT_KEY_BASE

HCAT_KEY_OUTPUT_SCHEMA

HCAT_KEY_JOB_INFO

HCAT_HIVE_CLIENT_EXPIRY_TIME

HCAT_HIVE_CLIENT_DISABLE_CACHE

HCAT_TABLE_SCHEMA

HCAT_METASTORE_URI

HCAT_PERMS

HCAT_GROUP

HCAT_CREATE_TBL_NAME

HCAT_CREATE_DB_NAME

HCAT_METASTORE_PRINCIPAL

HCAT_DESIRED_PARTITION_NUM_SPLITS

HCAT_APPEND_LIMIT

HCAT_KEY_OUTPUT_BASE

HCAT_KEY_OUTPUT_INFO

HCAT_KEY_HIVE_CONF

HCAT_KEY_TOKEN_SIGNATURE

OUTPUT_CONFS_TO_SAVE

HCAT_MSG_CLEAN_FREQ

HCAT_MSG_EXPIRY_DURATION

HCAT_MSGBUS_TOPIC_NAME

HCAT_MSGBUS_TOPIC_NAMING_POLICY

HCAT_MSGBUS_TOPIC_PREFIX

HCAT_OUTPUT_ID_HASH

HCAT_DYNAMIC_PTN_JOBID

HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED

HCAT_DYNAMIC_CUSTOM_PATTERN

HCAT_DEFAULT_TOPIC_PREFIX

HCAT_EVENT

HCAT_ADD_PARTITION_EVENT

HCAT_DROP_PARTITION_EVENT

HCAT_ALTER_PARTITION_EVENT

HCAT_PARTITION_DONE_EVENT

HCAT_CREATE_TABLE_EVENT

HCAT_ALTER_TABLE_EVENT

HCAT_DROP_TABLE_EVENT

HCAT_CREATE_DATABASE_EVENT

HCAT_DROP_DATABASE_EVENT

HCAT_INSERT_EVENT

HCAT_MESSAGE_VERSION

HCAT_MESSAGE_FORMAT

CONF_LABEL_HCAT_MESSAGE_FACTORY_IMPL_PREFIX

CONF_LABEL_HCAT_MESSAGE_FORMAT

DEFAULT_MESSAGE_FACTORY_IMPL

SYSENV_HADOOP_TOKEN_FILE_LOCATION

CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY

HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER

HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT

HCAT_DATA_TINY_SMALL_INT_PROMOTION

HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT

HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY

HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT

HCAT_INPUT_BAD_RECORD_MIN_KEY

HCAT_INPUT_BAD_RECORD_MIN_DEFAULT