public class PipelinedSorter extends ExternalSorter
Modifier and Type | Class and Description |
---|---|
protected class |
PipelinedSorter.InputByteBuffer |
ExternalSorter.MapBufferTooSmallException
Modifier and Type | Field and Description |
---|---|
static int |
MAP_OUTPUT_INDEX_RECORD_LENGTH
The size of each record in the index file for the map-outputs.
|
additionalSpillBytesRead, additionalSpillBytesWritten, availableMemoryMb, codec, combiner, comparator, conf, fileOutputByteCounter, ifileBufferSize, ifileReadAhead, ifileReadAheadLength, keyClass, keySerializer, mapOutputByteCounter, mapOutputFile, mapOutputRecordCounter, nullProgressable, numAdditionalSpills, outputBytesWithOverheadCounter, outputContext, partitioner, partitions, rfs, serializationFactory, sorter, spilledRecordsCounter, valClass, valSerializer
Constructor and Description |
---|
PipelinedSorter(org.apache.tez.runtime.api.OutputContext outputContext,
org.apache.hadoop.conf.Configuration conf,
int numOutputs,
long initialMemoryAvailable) |
Modifier and Type | Method and Description |
---|---|
void |
close() |
void |
flush() |
void |
sort() |
void |
spill() |
void |
write(Object key,
Object value) |
getInitialMemoryRequirement, getMapOutput, getShuffleHeader, getSortedStream, runCombineProcessor, sameVolRename, write
public static final int MAP_OUTPUT_INDEX_RECORD_LENGTH
public PipelinedSorter(org.apache.tez.runtime.api.OutputContext outputContext, org.apache.hadoop.conf.Configuration conf, int numOutputs, long initialMemoryAvailable) throws IOException
IOException
public void sort() throws IOException
IOException
public void write(Object key, Object value) throws IOException
write
in class ExternalSorter
IOException
public void spill() throws IOException
IOException
public void flush() throws IOException
flush
in class ExternalSorter
IOException
public void close()
close
in class ExternalSorter
Copyright © 2015 Apache Software Foundation. All rights reserved.