org.apache.hadoop.hive.accumulo

Class HiveAccumuloHelper

java.lang.Object

org.apache.hadoop.hive.accumulo.HiveAccumuloHelper

public class HiveAccumuloHelper
extends Object

Helper class to hold common methods across the InputFormat, OutputFormat and StorageHandler.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.hadoop.io.Text	ACCUMULO_SERVICE

Constructor Summary

Constructors

Constructor and Description
HiveAccumuloHelper()

Method Summary

Methods

Modifier and Type	Method and Description
void	addTokenFromUserToJobConf(org.apache.hadoop.security.UserGroupInformation user, org.apache.hadoop.mapred.JobConf jobConf) Extract the appropriate Token for Accumulo from the provided user and add it to the JobConf's credentials.
Object	getClientConfiguration(String zookeepers, String instanceName, boolean useSasl) Construct a ClientConfiguration instance in a backwards-compatible way.
org.apache.accumulo.core.client.security.tokens.AuthenticationToken	getDelegationToken(org.apache.accumulo.core.client.Connector conn) Obtain a DelegationToken from Accumulo in a backwards compatible manner.
org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.TokenIdentifier>	getHadoopToken(org.apache.accumulo.core.client.security.tokens.AuthenticationToken delegationToken)
void	mergeTokenIntoJobConf(org.apache.hadoop.mapred.JobConf jobConf, org.apache.hadoop.security.token.Token<?> accumuloToken) Merge the provided Token into the JobConf.
void	setZooKeeperInstance(org.apache.hadoop.mapred.JobConf jobConf, Class<?> inputOrOutputFormatClass, String zookeepers, String instanceName, boolean useSasl) Wrapper around setZooKeeperInstance(Configuration, ClientConfiguration) which only exists in 1.6.0 and newer.
org.apache.accumulo.core.client.security.tokens.AuthenticationToken	unwrapAuthenticationToken(org.apache.hadoop.mapred.JobConf jobConf, org.apache.accumulo.core.client.security.tokens.AuthenticationToken token) Wrapper around ConfiguratorBase.unwrapAuthenticationToken which only exists in 1.7.0 and new.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ACCUMULO_SERVICE

public static final org.apache.hadoop.io.Text ACCUMULO_SERVICE

Constructor Detail

HiveAccumuloHelper

public HiveAccumuloHelper()

Method Detail

addTokenFromUserToJobConf

public void addTokenFromUserToJobConf(org.apache.hadoop.security.UserGroupInformation user,
                             org.apache.hadoop.mapred.JobConf jobConf)
                               throws IOException

Extract the appropriate Token for Accumulo from the provided user and add it to the JobConf's credentials.

Parameters:

user - User containing tokens

jobConf - The configuration for the job

Throws:

IOException - If the correct token is not found or the Token fails to be merged with the configuration

mergeTokenIntoJobConf

public void mergeTokenIntoJobConf(org.apache.hadoop.mapred.JobConf jobConf,
                         org.apache.hadoop.security.token.Token<?> accumuloToken)
                           throws IOException

Merge the provided Token into the JobConf.

Parameters:

jobConf - JobConf to merge token into

accumuloToken - The Token

Throws:

IOException - If the merging fails

getDelegationToken

public org.apache.accumulo.core.client.security.tokens.AuthenticationToken getDelegationToken(org.apache.accumulo.core.client.Connector conn)
                                                                                       throws IOException

Obtain a DelegationToken from Accumulo in a backwards compatible manner.

Parameters:

conn - The Accumulo connector

Returns:

The DelegationToken instance

Throws:

IOException - If the token cannot be obtained

getHadoopToken

public org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.TokenIdentifier> getHadoopToken(org.apache.accumulo.core.client.security.tokens.AuthenticationToken delegationToken)
                                                                                                                  throws IOException

Throws:

IOException

getClientConfiguration

public Object getClientConfiguration(String zookeepers,
                            String instanceName,
                            boolean useSasl)
                              throws IOException

Construct a ClientConfiguration instance in a backwards-compatible way. Allows us to support Accumulo 1.5

Parameters:

zookeepers - ZooKeeper hosts

instanceName - Instance name

useSasl - Is SASL enabled

Returns:

A ClientConfiguration instance

Throws:

IOException - If the instance fails to be created

setZooKeeperInstance

public void setZooKeeperInstance(org.apache.hadoop.mapred.JobConf jobConf,
                        Class<?> inputOrOutputFormatClass,
                        String zookeepers,
                        String instanceName,
                        boolean useSasl)
                          throws IOException

Wrapper around setZooKeeperInstance(Configuration, ClientConfiguration) which only exists in 1.6.0 and newer. Support backwards compat.

Parameters:

jobConf - The JobConf

inputOrOutputFormatClass - The InputFormat or OutputFormat class

zookeepers - ZooKeeper hosts

instanceName - Accumulo instance name

useSasl - Is SASL enabled

Throws:

IOException - When invocation of the method fails

unwrapAuthenticationToken

public org.apache.accumulo.core.client.security.tokens.AuthenticationToken unwrapAuthenticationToken(org.apache.hadoop.mapred.JobConf jobConf,
                                                                                            org.apache.accumulo.core.client.security.tokens.AuthenticationToken token)
                                                                                              throws IOException

Wrapper around ConfiguratorBase.unwrapAuthenticationToken which only exists in 1.7.0 and new. Uses reflection to not break compat.

Parameters:

jobConf - JobConf object

token - The DelegationTokenStub instance

Returns:

A DelegationTokenImpl created from the Token in the Job's credentials

Throws:

IOException - If the token fails to be unwrapped