org.apache.hadoop.hive.ql.index

Class TableBasedIndexHandler

java.lang.Object

org.apache.hadoop.hive.ql.index.AbstractIndexHandler

org.apache.hadoop.hive.ql.index.TableBasedIndexHandler

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, HiveIndexHandler

Direct Known Subclasses:

BitmapIndexHandler, CompactIndexHandler

public abstract class TableBasedIndexHandler
extends AbstractIndexHandler

Index handler for indexes that use tables to store indexes.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.conf.Configuration	configuration

Constructor Summary

Constructors

Constructor and Description
TableBasedIndexHandler()

Method Summary

Methods

Modifier and Type	Method and Description
List<Task<?>>	generateIndexBuildTaskList(Table baseTbl, Index index, List<Partition> indexTblPartitions, List<Partition> baseTblPartitions, Table indexTbl, Set<ReadEntity> inputs, Set<WriteEntity> outputs) Requests that the handler generate a plan for building the index; the plan should read the base table and write out the index representation.
org.apache.hadoop.conf.Configuration	getConf()
protected Task<?>	getIndexBuilderMapRedTask(Set<ReadEntity> inputs, Set<WriteEntity> outputs, Index index, boolean partitioned, PartitionDesc indexTblPartDesc, String indexTableName, PartitionDesc baseTablePartDesc, String baseTableName, String dbName)
protected Task<?>	getIndexBuilderMapRedTask(Set<ReadEntity> inputs, Set<WriteEntity> outputs, List<FieldSchema> indexField, boolean partitioned, PartitionDesc indexTblPartDesc, String indexTableName, PartitionDesc baseTablePartDesc, String baseTableName, String dbName)
protected List<String>	getPartKVPairStringArray(LinkedHashMap<String,String> partSpec)
void	setConf(org.apache.hadoop.conf.Configuration conf)
protected void	setStatsDir(HiveConf builderConf)
boolean	usesIndexTable() Determines whether this handler implements indexes by creating an index table.

Methods inherited from class org.apache.hadoop.hive.ql.index.AbstractIndexHandler

checkQuerySize, generateIndexQuery, getColumnNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.ql.index.HiveIndexHandler

analyzeIndexDefinition, generateIndexQuery

Field Detail

configuration

protected org.apache.hadoop.conf.Configuration configuration

Constructor Detail

TableBasedIndexHandler

public TableBasedIndexHandler()

Method Detail

generateIndexBuildTaskList

public List<Task<?>> generateIndexBuildTaskList(Table baseTbl,
                                       Index index,
                                       List<Partition> indexTblPartitions,
                                       List<Partition> baseTblPartitions,
                                       Table indexTbl,
                                       Set<ReadEntity> inputs,
                                       Set<WriteEntity> outputs)
                                         throws HiveException

Description copied from interface: HiveIndexHandler

Requests that the handler generate a plan for building the index; the plan should read the base table and write out the index representation.

Parameters:

baseTbl - the definition of the table being indexed

index - the definition of the index

baseTblPartitions - list of base table partitions with each element mirrors to the corresponding one in indexTblPartitions

indexTbl - the definition of the index table, or null if usesIndexTable() returns null

inputs - inputs for hooks, supplemental outputs going along with the return value

outputs - outputs for hooks, supplemental outputs going along with the return value

Returns:

list of tasks to be executed in parallel for building the index

Throws:

HiveException - if plan generation fails

getIndexBuilderMapRedTask

protected Task<?> getIndexBuilderMapRedTask(Set<ReadEntity> inputs,
                                Set<WriteEntity> outputs,
                                Index index,
                                boolean partitioned,
                                PartitionDesc indexTblPartDesc,
                                String indexTableName,
                                PartitionDesc baseTablePartDesc,
                                String baseTableName,
                                String dbName)
                                     throws HiveException

Throws:

HiveException

getIndexBuilderMapRedTask

protected Task<?> getIndexBuilderMapRedTask(Set<ReadEntity> inputs,
                                Set<WriteEntity> outputs,
                                List<FieldSchema> indexField,
                                boolean partitioned,
                                PartitionDesc indexTblPartDesc,
                                String indexTableName,
                                PartitionDesc baseTablePartDesc,
                                String baseTableName,
                                String dbName)
                                     throws HiveException

Throws:

HiveException

setStatsDir

protected void setStatsDir(HiveConf builderConf)

getPartKVPairStringArray

protected List<String> getPartKVPairStringArray(LinkedHashMap<String,String> partSpec)

usesIndexTable

public boolean usesIndexTable()

Description copied from interface: HiveIndexHandler

Determines whether this handler implements indexes by creating an index table.

Returns:

true if index creation implies creation of an index table in Hive; false if the index representation is not stored in a Hive table

getConf

public org.apache.hadoop.conf.Configuration getConf()

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)