org.apache.giraph.io.internal

Class WrappedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.internal.WrappedEdgeReader<I,E>

Type Parameters:

I - Vertex id

E - Edge data

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

public class WrappedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends EdgeReader<I,E>

For internal use only. Wraps EdgeReader to make sure proper configuration parameters are passed around, that parameters set in original configuration are available in methods of this reader

Constructor Summary

Constructors

Constructor and Description
WrappedEdgeReader(EdgeReader<I,E> baseEdgeReader, ImmutableClassesGiraphConfiguration<I,org.apache.hadoop.io.Writable,E> conf) Constructor

Method Summary

Modifier and Type	Method and Description
void	close() Close this EdgeReader to future operations.
Edge<I,E>	getCurrentEdge() Get the current edge.
I	getCurrentSourceId() Get the current edge source id.
float	getProgress() How much of the input has the EdgeReader consumed i.e.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the edges.
boolean	nextEdge() Read the next edge.
void	setConf(ImmutableClassesGiraphConfiguration<I,org.apache.hadoop.io.Writable,E> conf) Set the configuration to be used by this object.
void	setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage) Set worker global communication usage

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WrappedEdgeReader

public WrappedEdgeReader(EdgeReader<I,E> baseEdgeReader,
                         ImmutableClassesGiraphConfiguration<I,org.apache.hadoop.io.Writable,E> conf)

Constructor

Parameters:

baseEdgeReader - EdgeReader to delegate all the methods to

conf - Configuration

Method Detail

setConf

public void setConf(ImmutableClassesGiraphConfiguration<I,org.apache.hadoop.io.Writable,E> conf)

Description copied from interface: GiraphConfigurationSettable

Set the configuration to be used by this object.

Specified by:

setConf in interface GiraphConfigurationSettable<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Overrides:

setConf in class DefaultImmutableClassesGiraphConfigurable<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

conf - Set configuration

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: EdgeReader

Use the input split and context to setup reading the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading edges.

context - Context from the task.

Throws:

IOException

InterruptedException

setWorkerGlobalCommUsage

public void setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage)

Description copied from class: WorkerAggregatorDelegator

Set worker global communication usage

Overrides:

setWorkerGlobalCommUsage in class WorkerAggregatorDelegator<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

usage - Worker global communication usage

nextEdge

public boolean nextEdge()
                 throws IOException,
                        InterruptedException

Description copied from class: EdgeReader

Read the next edge.

Specified by:

nextEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

false iff there are no more edges

Throws:

IOException

InterruptedException

getCurrentSourceId

public I getCurrentSourceId()
                     throws IOException,
                            InterruptedException

Description copied from class: EdgeReader

Get the current edge source id.

Specified by:

getCurrentSourceId in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Current edge source id which has been read. nextEdge() should be called first.

Throws:

IOException

InterruptedException

getCurrentEdge

public Edge<I,E> getCurrentEdge()
                         throws IOException,
                                InterruptedException

Description copied from class: EdgeReader

Get the current edge.

Specified by:

getCurrentEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

the current edge which has been read. nextEdge() should be called first.

Throws:

IOException

InterruptedException

close

public void close()
           throws IOException

Description copied from class: EdgeReader

Close this EdgeReader to future operations.

Specified by:

close in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Description copied from class: EdgeReader

How much of the input has the EdgeReader consumed i.e. has been processed by?

Specified by:

getProgress in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException

InterruptedException