org.apache.solr.hadoop
Class LineRandomizerReducer

java.lang.Object
  org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>
      org.apache.solr.hadoop.LineRandomizerReducer

public class LineRandomizerReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

MR Reducer that randomizing a list of URLs. Reducer input is (randomPosition, URL) pairs. Each such pair indicates a file to index. Reducer output is a list of URLs, each URL in a random position.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

LineRandomizerReducer()

Method Summary

protected void

reduce(org.apache.hadoop.io.LongWritable key, Iterable<org.apache.hadoop.io.Text> values, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineRandomizerReducer

public LineRandomizerReducer()

Method Detail

reduce

protected void reduce(org.apache.hadoop.io.LongWritable key,
                      Iterable<org.apache.hadoop.io.Text> values,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>

Throws:

IOException

InterruptedException