org.apache.hadoop.hive.ql.exec.persistence

Class HybridHashTableConf

java.lang.Object

org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableConf

public class HybridHashTableConf
extends Object

This conf class is a wrapper of a list of HybridHashTableContainers and some common info shared among them, which is used in n-way join (multiple small tables are involved).

Constructor Summary

Constructors

Constructor and Description
HybridHashTableConf()

Method Summary

Methods

Modifier and Type	Method and Description
boolean	doSpillOnCreation(int partitionId) Check if a partition should be spilled directly on creation
List<HybridHashTableContainer>	getLoadedContainerList()
int	getNextSpillPartition()
int	getNumberOfPartitions()
void	setNextSpillPartition(int nextSpillPartition)
void	setNumberOfPartitions(int numberOfPartitions)
long	spill() Spill one in-memory partition from tail for all previously loaded HybridHashTableContainers.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HybridHashTableConf

public HybridHashTableConf()

Method Detail

getNumberOfPartitions

public int getNumberOfPartitions()

setNumberOfPartitions

public void setNumberOfPartitions(int numberOfPartitions)

getNextSpillPartition

public int getNextSpillPartition()

setNextSpillPartition

public void setNextSpillPartition(int nextSpillPartition)

getLoadedContainerList

public List<HybridHashTableContainer> getLoadedContainerList()

spill

public long spill()
           throws IOException

Spill one in-memory partition from tail for all previously loaded HybridHashTableContainers. Also mark that partition number as spill-on-creation for future created containers.

Returns:

amount of memory freed; 0 if only one last partition is in memory for each container

Throws:

IOException

doSpillOnCreation

public boolean doSpillOnCreation(int partitionId)

Check if a partition should be spilled directly on creation

Parameters:

partitionId - the partition to create

Returns:

true if it should be spilled directly, false otherwise