org.apache.giraph.io.hbase

Class HBaseVertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.VertexOutputFormat<I,V,E>

org.apache.giraph.io.hbase.HBaseVertexOutputFormat<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

public abstract class HBaseVertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends VertexOutputFormat<I,V,E>

Base class for writing Vertex mutations back to specific rows in an HBase table. This class wraps an instance of TableOutputFormat for easy configuration with the existing properties. Setting conf.set(TableOutputFormat.OUTPUT_TABLE, "out_table"); will properly delegate to the TableOutputFormat instance contained in this class. The Configurable interface prevents specific wrapper methods from having to be called. Works with HBaseVertexInputFormat

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HBaseVertexOutputFormat.HBaseVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> Constructor Simple class which takes an instance of RecordWriter over Writable objects.

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.apache.hadoop.hbase.mapreduce.TableOutputFormat<org.apache.hadoop.hbase.io.ImmutableBytesWritable>	BASE_FORMAT delegate output format that writes to HBase

Constructor Summary

Constructors

Constructor and Description
HBaseVertexOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) checkOutputSpecs
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) getOutputCommitter

Methods inherited from class org.apache.giraph.io.VertexOutputFormat

createVertexWriter

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BASE_FORMAT

protected static final org.apache.hadoop.hbase.mapreduce.TableOutputFormat<org.apache.hadoop.hbase.io.ImmutableBytesWritable> BASE_FORMAT

delegate output format that writes to HBase

Constructor Detail

HBaseVertexOutputFormat

public HBaseVertexOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

checkOutputSpecs

Specified by:

checkOutputSpecs in class VertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - information about the job

Throws:

IOException

InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

getOutputCommitter

Specified by:

getOutputCommitter in class VertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - the task context

Returns:

OutputCommitter ouputCommitter

Throws:

IOException

InterruptedException