org.apache.hive.hcatalog.api.repl

Class ReplicationUtils

java.lang.Object

org.apache.hive.hcatalog.api.repl.ReplicationUtils

public class ReplicationUtils
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static String	REPL_STATE_ID

Method Summary

Methods

Modifier and Type	Method and Description
static Command	deserializeCommand(String s) Command implements Writable, but that's not terribly easy to use compared to String, even if it plugs in easily into the rest of Hadoop.
static long	getLastReplicationId(HCatDatabase db) Gets the last known replication state of this db.
static long	getLastReplicationId(HCatPartition ptn, HCatTable parentTable) Gets the last known replication state of the provided partition.
static long	getLastReplicationId(HCatTable tbl) Gets the last known replication state of the provided table.
static String	getUniqueKey(long eventId, String db, String table, Map<String,String> ptnDesc) Used to generate a unique key for a combination of given event id, dbname, tablename and partition keyvalues.
static String	mapIfMapAvailable(String s, com.google.common.base.Function<String,String> mapping) Return a mapping from a given map function if available, and the key itself if not.
static String	partitionDescriptor(Map<String,String> ptnDesc)
static String	serializeCommand(Command command) Command implements Writable, but that's not terribly easy to use compared to String, even if it plugs in easily into the rest of Hadoop.
static String	toStringWordCharsOnly(String s) Return alphanumeric(and '_') chars only of a string, lowercased

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

REPL_STATE_ID

public static final String REPL_STATE_ID

Method Detail

getLastReplicationId

public static long getLastReplicationId(HCatDatabase db)

Gets the last known replication state of this db. This is applicable only if it is the destination of a replication and has had data replicated into it via imports previously. Defaults to 0.

getLastReplicationId

public static long getLastReplicationId(HCatTable tbl)

Gets the last known replication state of the provided table. This is applicable only if it is the destination of a replication and has had data replicated into it via imports previously. Defaults to 0.

getLastReplicationId

public static long getLastReplicationId(HCatPartition ptn,
                        @Nullable
                        HCatTable parentTable)

Gets the last known replication state of the provided partition. This is applicable only if it is the destination of a replication and has had data replicated into it via imports previously. If that is not available, but parent table is provided, defaults to parent table's replication state. If that is also unknown, defaults to 0.

getUniqueKey

public static String getUniqueKey(long eventId,
                  String db,
                  String table,
                  Map<String,String> ptnDesc)

Used to generate a unique key for a combination of given event id, dbname, tablename and partition keyvalues. This is used to feed in a name for creating staging directories for exports and imports. This should be idempotent given the same values, i.e. hashcode-like, but at the same time, be guaranteed to be different for every possible partition, while being "readable-ish". Basically, we concat the alphanumberic versions of all of the above, along with a hashcode of the db, tablename and ptn key-value pairs

toStringWordCharsOnly

public static String toStringWordCharsOnly(String s)

Return alphanumeric(and '_') chars only of a string, lowercased

mapIfMapAvailable

public static String mapIfMapAvailable(String s,
                       com.google.common.base.Function<String,String> mapping)

Return a mapping from a given map function if available, and the key itself if not.

partitionDescriptor

public static String partitionDescriptor(Map<String,String> ptnDesc)

serializeCommand

public static String serializeCommand(Command command)
                               throws IOException

Command implements Writable, but that's not terribly easy to use compared to String, even if it plugs in easily into the rest of Hadoop. Provide utility methods to easily serialize and deserialize Commands serializeCommand returns a base64 String representation of given command

Throws:

IOException

deserializeCommand

public static Command deserializeCommand(String s)
                                  throws IOException

Command implements Writable, but that's not terribly easy to use compared to String, even if it plugs in easily into the rest of Hadoop. Provide utility methods to easily serialize and deserialize Commands deserializeCommand instantiates a concrete Command and initializes it, given a base64 String representation of it.

Throws:

IOException