A B C D E F G H I K L M N O P R S T U V W 

A

abort() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
abort() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Abort the output.
abort() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
abort() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
accept(Class<?>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization
 
actualSize - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
addCompletedInputWithData(InputAttemptIdentifier, FetchedInput) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
addCompletedInputWithNoData(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
addConfigMapToConfiguration(Configuration, Map<String, String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
additionalSpillBytesRead - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
additionalSpillBytesReadCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents additional bytes read from disk to merge all the previous spills into a single file.
additionalSpillBytesWritten - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
additionalSpillBytesWritternCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents additional bytes written to disk as a result of spills, excluding the final spill.
addKnownInput(String, int, InputAttemptIdentifier, int) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
addKnownInput(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
allInputsFetched() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
allocate(long, long, InputAttemptIdentifier) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetchedInputAllocator
 
allocate(long, long, InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
allocateType(FetchedInput.Type, long, long, InputAttemptIdentifier) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetchedInputAllocator
 
allocateType(FetchedInput.Type, long, long, InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
append(Object, Object) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryWriter
 
append(Object, Object) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Send key/value to be appended to IFile.
append(DataInputBuffer, DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Send key/value to be appended to IFile.
appendKeyValues(K, Iterator<V>) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Append key and its associated set of values.
appendValue(Object) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Appends the value to previous key.
appendValue(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Appends the value to previous key.
appendValues(Iterator<V>) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
Appends the value to previous key.
assignMemory(long, int, int, Iterable<InitialMemoryRequestContext>) - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
 
assignWork(String, int, int, List<InputAttemptIdentifier>) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
availableMemoryMb - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 

B

BASE_PARTITION_RANGE_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
BaseUnorderedPartitionedKVWriter - Class in org.apache.tez.runtime.library.common.writers
 
BaseUnorderedPartitionedKVWriter(OutputContext, Configuration, int) - Constructor for class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
buffer - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
bufferSize - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
BufferUtils - Class in org.apache.tez.runtime.library.utils
 
BufferUtils() - Constructor for class org.apache.tez.runtime.library.utils.BufferUtils
 
build() - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
build() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
build() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 
build() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
Create the actual configuration instance.
build() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Build and return an instance of the configuration
build() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
Create the actual configuration instance.
build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
Build and return an instance of the configuration
build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
Create the actual configuration instance.
build() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
Create the actual configuration instance.
build() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
Build and return an instance of the configuration
build() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
Create the actual configuration instance.
build() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
build() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
build() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
build() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
build() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
buildMsgFrom(URL) - Static method in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
Shuffle specific utils - build string for encoding from URL
buildPartial() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
buildPartial() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
buildPartial() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
buildPartial() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
buildPartial() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
bytesRead - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 

C

call() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
callback - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
checkState(boolean, String, Object...) - Static method in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
cleanup(boolean) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
Cleanup the connection.
clear() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
clear() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
clear() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
clear() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
clear() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
clearAndGetPendingInputs() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
clearBasePartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 base_partition_range = 3;
clearCompressedLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 compressed_length = 2;
clearData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
clearData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional bytes data = 3;
clearEmptyPartitions() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional bytes empty_partitions = 1;
clearHost() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
clearNumDestinationTasks() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_destination_tasks = 2;
clearNumSourceTaskOutputs() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_source_task_outputs = 1;
clearOutputSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
optional int64 output_size = 1;
clearPartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
optional int32 partition_range = 1;
clearPathComponent() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
clearPort() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 port = 3;
clearRawLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 raw_length = 1;
clearRemainderRangeForLastShuffler() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 remainder_range_for_last_shuffler = 4;
clearRunDuration() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 run_duration = 5;
clone() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
clone() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
clone() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
clone() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
clone() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
close() - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
close() - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableDeserializer
 
close() - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableSerializer
 
close() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
close() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryWriter
 
close() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
Close the input stream.
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileOutputStream
 
close() - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
close() - Method in interface org.apache.tez.runtime.library.common.sort.impl.TezRawKeyValueIterator
Closes the iterator so that the underlying streams can be closed.
close() - Method in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
close() - Method in class org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter
 
close() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
close() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
close() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
close() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
close() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
close() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
close() - Method in class org.apache.tez.runtime.library.processor.SleepProcessor
 
closeInMemoryFile(MapOutput) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
closeInMemoryMergedFile(MapOutput) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
closeOnDiskFile(FileChunk) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
codec - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
codec - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
combine(TezRawKeyValueIterator, IFile.Writer) - Method in interface org.apache.tez.runtime.library.common.combine.Combiner
 
Combiner - Interface in org.apache.tez.runtime.library.common.combine
Combiner Initialization
combiner - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
commit() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
commit() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Commit the output.
commit() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
commit() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
comparator - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
compare(byte[], int, int, byte[], int, int) - Method in class org.apache.tez.runtime.library.common.comparator.TezBytesComparator
Compare the buffers in serialized form.
compare(int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
Compare logical range, st i, j MOD offset capacity.
compare(DataInputBuffer, DataInputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
compare(DataOutputBuffer, DataOutputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
compare(DataInputBuffer, DataOutputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
compare(DataOutputBuffer, DataInputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
compareTo(FileChunk) - Method in class org.apache.hadoop.io.FileChunk
 
COMPRESSED_LENGTH_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
compressedSize - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
ConcatenatedMergedKeyValueInput - Class in org.apache.tez.runtime.library.input
Implements a MergedLogicalInput that merges the incoming inputs (e.g.
ConcatenatedMergedKeyValueInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput
 
ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader - Class in org.apache.tez.runtime.library.input
 
ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader() - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader
 
ConcatenatedMergedKeyValuesInput - Class in org.apache.tez.runtime.library.input
Implements a MergedLogicalInput that merges the incoming inputs (e.g.
ConcatenatedMergedKeyValuesInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput
 
ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader - Class in org.apache.tez.runtime.library.input
 
ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader() - Constructor for class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader
 
conf - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
conf - Variable in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
 
conf - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
conf - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
conf - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
configureInput() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Configure the specific input
configureInput() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
Configure the specific input
configureInput() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
Configure the specific input
configureOutput() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Configure the specific output
configureOutput() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
Configure the specific output
configureOutput() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
Configure the specific output
ConfigUtils - Class in org.apache.tez.runtime.library.common
 
ConfigUtils() - Constructor for class org.apache.tez.runtime.library.common.ConfigUtils
 
connect() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
Connect to source
connect(int) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
Connect to source with specific timeout
connection - Variable in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
 
Constants - Class in org.apache.tez.runtime.library.common
 
Constants() - Constructor for class org.apache.tez.runtime.library.common.Constants
 
constructBaseURIForShuffleHandler(String, int, int, String, boolean) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
constructBaseURIForShuffleHandler(String, int, String, boolean) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
constructHttpShuffleConnectionParams(Configuration) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
constructInputURL(String, List<InputAttemptIdentifier>, boolean) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
convertJobTokenToBytes(Token<JobTokenIdentifier>) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
copy(DataInputBuffer, DataOutputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
copy(DataOutputBuffer, DataOutputBuffer) - Static method in class org.apache.tez.runtime.library.utils.BufferUtils
 
createConfigBuilder(Configuration) - Static method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
Create a VertexManagerPluginDescriptor builder that can be used to configure the plugin.
createDefaultBroadcastEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.
createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.
createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.
createDefaultCustomEdgeProperty(EdgeManagerPluginDescriptor) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
This is a convenience method for creating an Edge descriptor based on the specified EdgeManagerDescriptor.
createDefaultEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.
createDefaultEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.
createDefaultOneToOneEdgeProperty() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
This is a convenience method for the typical usage of this edge, and creates an instance of EdgeProperty which is likely to be used.
createIdentifier(String, int) - Static method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
createValuesIterator() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
currentKeyLength - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
currentValueLength - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 

D

DATA_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
DATA_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
dataIn - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
DEFAULT_COMBINE_RECORDS_BEFORE_PROGRESS - Static variable in class org.apache.tez.runtime.library.common.Constants
 
DEFAULT_HTTP_HEADER_NAME - Static variable in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
DEFAULT_HTTP_HEADER_VERSION - Static variable in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
DefaultSorter - Class in org.apache.tez.runtime.library.common.sort.impl.dflt
 
DefaultSorter(OutputContext, Configuration, int, long) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
DefaultSorter.BlockingBuffer - Class in org.apache.tez.runtime.library.common.sort.impl.dflt
Inner class managing the spill of serialized records to disk.
DefaultSorter.BlockingBuffer() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.BlockingBuffer
 
DefaultSorter.Buffer - Class in org.apache.tez.runtime.library.common.sort.impl.dflt
 
DefaultSorter.Buffer() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.Buffer
 
DefaultSorter.MRResultIterator - Class in org.apache.tez.runtime.library.common.sort.impl.dflt
 
DefaultSorter.MRResultIterator(int, int) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
DefaultSorter.SpillThread - Class in org.apache.tez.runtime.library.common.sort.impl.dflt
 
DefaultSorter.SpillThread() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.SpillThread
 
deserialize(Writable) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableDeserializer
 
deserializeShuffleProviderMetaData(ByteBuffer) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
disableChecksumValidation() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
DiskFetchedInput - Class in org.apache.tez.runtime.library.common.shuffle
 
DiskFetchedInput(long, long, InputAttemptIdentifier, FetchedInputCallback, Configuration, LocalDirAllocator, TezTaskOutputFiles) - Constructor for class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
doesKeyQualify(String, List<Set<String>>, List<String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
doHttpFetch() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
doHttpFetch(Fetcher.CachingCallBack) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
done() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
done() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
done() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
done() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder
 
done() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder
 
doSharedFetch() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 

E

EMPTY_PARTITIONS_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
eof - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
EOF_MARKER - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
equals(Object) - Method in class org.apache.hadoop.io.FileChunk
 
equals(Object) - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
equals(Object) - Method in class org.apache.tez.runtime.library.common.InputIdentifier
 
equals(Object) - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
equals(Object) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
equals(Object) - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
equals(Object) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
equals(Object) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
equals(Object) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
equals(Object) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
equals(Object) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
ExternalSorter - Class in org.apache.tez.runtime.library.common.sort.impl
 
ExternalSorter(OutputContext, Configuration, int, long) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
ExternalSorter.MapBufferTooSmallException - Exception in org.apache.tez.runtime.library.common.sort.impl
Exception indicating that the allocated sort buffer is insufficient to hold the current record.
ExternalSorter.MapBufferTooSmallException(String) - Constructor for exception org.apache.tez.runtime.library.common.sort.impl.ExternalSorter.MapBufferTooSmallException
 
extractConfigurationMap(Map<String, String>, Set<String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
extractConfigurationMap(Map<String, String>, List<Set<String>>, List<String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
extractConfigurationMap(Configuration, List<Set<String>>, List<String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 

F

fetchComplete(FetchedInput) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetchedInputCallback
 
fetchComplete(FetchedInput) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
FetchedInput - Class in org.apache.tez.runtime.library.common.shuffle
 
FetchedInput(FetchedInput.Type, long, long, InputAttemptIdentifier, FetchedInputCallback) - Constructor for class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
FetchedInput.State - Enum in org.apache.tez.runtime.library.common.shuffle
 
FetchedInput.Type - Enum in org.apache.tez.runtime.library.common.shuffle
 
FetchedInputAllocator - Interface in org.apache.tez.runtime.library.common.shuffle
 
FetchedInputCallback - Interface in org.apache.tez.runtime.library.common.shuffle
 
Fetcher - Class in org.apache.tez.runtime.library.common.shuffle
Responsible for fetching inputs served by the ShuffleHandler for a single host.
Fetcher.FetcherBuilder - Class in org.apache.tez.runtime.library.common.shuffle
Builder for the construction of Fetchers
Fetcher.FetcherBuilder(FetcherCallback, HttpConnection.HttpConnectionParams, FetchedInputAllocator, ApplicationId, JobTokenSecretManager, String, Configuration, boolean) - Constructor for class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
Fetcher.FetcherBuilder(FetcherCallback, HttpConnection.HttpConnectionParams, FetchedInputAllocator, ApplicationId, JobTokenSecretManager, String, Configuration, RawLocalFileSystem, LocalDirAllocator, Path, boolean, boolean) - Constructor for class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
FetcherCallback - Interface in org.apache.tez.runtime.library.common.shuffle
 
FetcherReadTimeoutException - Exception in org.apache.tez.runtime.library.exceptions
 
FetcherReadTimeoutException() - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException
 
FetcherReadTimeoutException(String) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException
 
FetcherReadTimeoutException(Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException
 
FetcherReadTimeoutException(String, Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.FetcherReadTimeoutException
 
fetchFailed(FetchedInput) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetchedInputCallback
 
fetchFailed(String, InputAttemptIdentifier, boolean) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetcherCallback
 
fetchFailed(String, InputAttemptIdentifier, boolean) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
fetchFailed(FetchedInput) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
FetchResult - Class in org.apache.tez.runtime.library.common.shuffle
 
FetchResult(String, int, int, Iterable<InputAttemptIdentifier>) - Constructor for class org.apache.tez.runtime.library.common.shuffle.FetchResult
 
fetchSucceeded(String, InputAttemptIdentifier, FetchedInput, long, long, long) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetcherCallback
 
fetchSucceeded(String, InputAttemptIdentifier, FetchedInput, long, long, long) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
FileBasedKVWriter - Class in org.apache.tez.runtime.library.broadcast.output
 
FileBasedKVWriter(OutputContext, Configuration) - Constructor for class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
FileChunk - Class in org.apache.hadoop.io
 
FileChunk(Path, long, long, boolean, InputAttemptIdentifier) - Constructor for class org.apache.hadoop.io.FileChunk
 
FileChunk(Path, long, long) - Constructor for class org.apache.hadoop.io.FileChunk
 
fileOutputByteCounter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
fileOutputBytesCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents the final output size, with file format overheads and compression factored in.
finish() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileOutputStream
Finishes writing data to the output stream, by writing the checksum bytes to the end.
flush() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
flush() - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
flush() - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
free() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
free() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Called when this input has been consumed, so that resources can be reclaimed.
free() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
free() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
freeResources(FetchedInput) - Method in interface org.apache.tez.runtime.library.common.shuffle.FetchedInputCallback
 
freeResources(FetchedInput) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig
 
fromUserPayload(UserPayload) - Method in class org.apache.tez.runtime.library.processor.SleepProcessor.SleepProcessorConfig
 

G

generateEventsForNonStartedOutput(List<Event>, int, OutputContext, boolean, boolean) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
Generate events for outputs which have not been started.
generateEventsOnClose() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
generateHash(byte[], SecretKey) - Static method in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
Base64 encoded hash of msg
generateWeightStrings(int, int, int, int, int, int) - Static method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
 
getActualSize() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
getAllowedPrefixes() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
getAttemptNumber() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
getBasePartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 base_partition_range = 3;
getBasePartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 base_partition_range = 3;
getBasePartitionRange() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 base_partition_range = 3;
getBufferSize() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
getBytes() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
getChecksum() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 
getCompressedLength() - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
getCompressedLength() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
getCompressedLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
getCompressedLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 compressed_length = 2;
getCompressedLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional int32 compressed_length = 2;
getCompressedLength() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional int32 compressed_length = 2;
getCompressedSize() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
getConf() - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
 
getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
getConfigurationKeySet() - Static method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
getConnectionTimeout() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
getCurrentKey() - Method in class org.apache.tez.runtime.library.api.KeyValueReader
Returns the current key
getCurrentKey() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader
Returns the current key
getCurrentKey() - Method in class org.apache.tez.runtime.library.common.readers.UnorderedKVReader
 
getCurrentKey() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader
 
getCurrentKey() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader
 
getCurrentValue() - Method in class org.apache.tez.runtime.library.api.KeyValueReader
Returns the current value
getCurrentValue() - Method in class org.apache.tez.runtime.library.common.readers.UnorderedKVReader
 
getCurrentValue() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader
 
getCurrentValues() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader
Returns an Iterable view of the values associated with the current key
getCurrentValues() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader
 
getData() - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
getData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
getData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional .DataProto data = 6;
getData() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional .DataProto data = 6;
getData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional bytes data = 3;
getData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional bytes data = 3;
getData() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional bytes data = 3;
getDataBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
getDataOrBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
getDataOrBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional .DataProto data = 6;
getDataOrBuilder() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional .DataProto data = 6;
getDefaultInstance() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getDefaultInstance() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getDefaultInstance() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getDefaultInstance() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getDefaultInstance() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
getDefaultInstanceForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
getDescriptor() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getDescriptorForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
getDescriptorForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
getDescriptorForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
getDescriptorForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
getDescriptorForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
getDeserializer(Class<Writable>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization
 
getEmptyPartitions() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional bytes empty_partitions = 1;
getEmptyPartitions() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional bytes empty_partitions = 1;
getEmptyPartitions() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional bytes empty_partitions = 1;
getHost() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchResult
 
getHost() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
getHost() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
getHost() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string host = 2;
getHost() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string host = 2;
getHostBytes() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
getHostBytes() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string host = 2;
getHostBytes() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string host = 2;
getIdentifier() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
getIndex(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
Get spill offsets for given partition.
getInitialMemoryReq(Configuration, long) - Static method in class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
getInitialMemoryRequirement(Configuration, long) - Static method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
getInitialMemoryRequirement(Configuration, long) - Static method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
getInitialMemoryRequirement(Configuration, long) - Static method in class org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter
 
getInMemVBytesLength(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
getInputAttemptIdentifier() - Method in class org.apache.hadoop.io.FileChunk
 
getInputAttemptIdentifier() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
getInputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig
 
getInputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getInputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getInputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getInputFile() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
getInputFile(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Return a local reduce input file created earlier
getInputFile(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Return a local input file created earlier TODO: TEZ-1855.
getInputFile(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Return a local input file created earlier ${appDir}/${uniqueId}_spill_${spillNumber}.out e.g.
getInputFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local reduce input file name.
getInputFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local input file name.
getInputFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local input file name.
getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getInputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getInputIdentifier() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
getInputIndex() - Method in class org.apache.tez.runtime.library.common.InputIdentifier
 
getInputKeyComparator() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
getInputKeySecondaryGroupingComparator(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getInputPath() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
getInputPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getInputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getInputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getInputs() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
getInputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
getInputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Return an input stream to be used to read the previously fetched data.
getInputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
Get the inputstream from the connection
getInputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
getInputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
getIntermediateInputCompressorClass(Configuration, Class<DefaultCodec>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateInputKeyClass(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateInputKeyComparator(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateInputValueClass(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateOutputCompressorClass(Configuration, Class<DefaultCodec>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateOutputKeyClass(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateOutputKeyComparator(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIntermediateOutputValueClass(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
getIterator() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedInputLegacy
 
getJobTokenSecretFromTokenBytes(ByteBuffer) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
getKeepAlive() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
getKeepAliveMaxConnections() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
getKey() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
getKey() - Method in interface org.apache.tez.runtime.library.common.sort.impl.TezRawKeyValueIterator
Gets the current raw key.
getKey() - Method in class org.apache.tez.runtime.library.common.ValuesIterator
The current key.
getLength() - Method in class org.apache.hadoop.io.FileChunk
 
getLength() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
getLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
getLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
getLocalFS() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
getMapId() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
getMapOutput() - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
getMemoryAssigned() - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler
 
getNextInput() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
getNumDestinationConsumerTasks(int) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
getNumDestinationTaskPhysicalInputs(int) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
getNumDestinationTasks() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_destination_tasks = 2;
getNumDestinationTasks() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 num_destination_tasks = 2;
getNumDestinationTasks() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 num_destination_tasks = 2;
getNumPendingInputs() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
getNumSourceTaskOutputs() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_source_task_outputs = 1;
getNumSourceTaskOutputs() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 num_source_task_outputs = 1;
getNumSourceTaskOutputs() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 num_source_task_outputs = 1;
getNumSourceTaskPhysicalOutputs(int) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
getOffset() - Method in class org.apache.hadoop.io.FileChunk
 
getOtherConfigDefaults() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getOutputClassName() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getOutputFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Return the path to local map output file created earlier
getOutputFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Return the path to local output file created earlier.
getOutputFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Return the path to local output file created earlier.
getOutputFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map output file name.
getOutputFileForWrite() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map output file name.
getOutputFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output file name.
getOutputFileForWrite() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output file name.
getOutputFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output file name.
getOutputFileForWrite() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output file name.
getOutputFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map output file name on the same volume.
getOutputFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output file name on the same volume.
getOutputFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output file name on the same volume.
getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getOutputHistoryText() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getOutputIndexFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Return the path to a local map output index file created earlier
getOutputIndexFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Return the path to a local output index file created earlier TODO TEZ-1855: Remove this.
getOutputIndexFile() - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Return the path to a local output index file created earlier ${appDir}/output/${uniqueId}/file.out.index e.g.
getOutputIndexFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map output index file name.
getOutputIndexFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output index file name.
getOutputIndexFileForWrite(long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output index file name.
getOutputIndexFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map output index file name on the same volume.
getOutputIndexFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output index file name on the same volume.
getOutputIndexFileForWriteInVolume(Path) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output index file name on the same volume.
getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
 
getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
 
getOutputPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
 
getOutputs() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
getOutputSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
optional int64 output_size = 1;
getOutputSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
optional int64 output_size = 1;
getOutputSize() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProtoOrBuilder
optional int64 output_size = 1;
getOutputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
getOutputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Returns the output stream to be used to write fetched data.
getOutputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
getOutputStream() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
getOutputStream() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
getParserForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getParserForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getParserForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getParserForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getParserForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getPartition(Object, Object, int) - Method in interface org.apache.tez.runtime.library.api.Partitioner
Get partition for given key/value.
getPartition() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchResult
 
getPartition() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
getPartition(Object, Object, int) - Method in class org.apache.tez.runtime.library.partitioner.HashPartitioner
 
getPartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
optional int32 partition_range = 1;
getPartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
optional int32 partition_range = 1;
getPartitionRange() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProtoOrBuilder
optional int32 partition_range = 1;
getPartLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
getPath() - Method in class org.apache.hadoop.io.FileChunk
 
getPathComponent() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
getPathComponent() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
getPathComponent() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string path_component = 4;
getPathComponent() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string path_component = 4;
getPathComponentBytes() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
getPathComponentBytes() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string path_component = 4;
getPathComponentBytes() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string path_component = 4;
getPendingInputs() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchResult
 
getPort() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchResult
 
getPort() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
getPort() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 port = 3;
getPort() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional int32 port = 3;
getPort() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional int32 port = 3;
getPosition() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
getPosition() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
getPosition() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 
getPosition() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
getProgress() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
getProgress() - Method in interface org.apache.tez.runtime.library.common.sort.impl.TezRawKeyValueIterator
Gets the Progress object; this has a float (0.0 - 1.0) indicating the bytes processed by the iterator so far
getProxy(KEY) - Method in interface org.apache.tez.runtime.library.common.comparator.ProxyComparator
This comparator interface provides a fast-path for comparisons between keys.
getProxy(BytesWritable) - Method in class org.apache.tez.runtime.library.common.comparator.TezBytesComparator
 
getRawLength() - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
getRawLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
getRawLength() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
getRawLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 raw_length = 1;
getRawLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional int32 raw_length = 1;
getRawLength() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional int32 raw_length = 1;
getReader() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput
Provides a KeyValueReader that iterates over the concatenated input data
getReader() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput
Provides a KeyValuesReader that iterates over the concatenated input data
getReader() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
Get a KVReader for the Input.
getReader() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput
Provides an ordered KeyValuesReader
getReader() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
getReadTimeout() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
getRemainderRangeForLastShuffler() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 remainder_range_for_last_shuffler = 4;
getRemainderRangeForLastShuffler() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 remainder_range_for_last_shuffler = 4;
getRemainderRangeForLastShuffler() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 remainder_range_for_last_shuffler = 4;
getRunDuration() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 run_duration = 5;
getRunDuration() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional int32 run_duration = 5;
getRunDuration() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional int32 run_duration = 5;
getRuntimeAdditionalConfigKeySet() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
getRuntimeConfigKeySet() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
getSerializedSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getSerializedSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getSerializedSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getSerializedSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getSerializedSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getSerializer(Class<Writable>) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization
 
getShuffleHeader(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
getShuffleInputFileName(String, String) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
getSize() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 
getSortedStream(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
getSpillFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Return a local map spill file created earlier.
getSpillFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Return a local output spill file created earlier.
getSpillFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Return a local output spill file created earlier.
getSpillFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map spill file name.
getSpillFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output spill file name.
getSpillFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local spill file name.
getSpillFileName(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
 
getSpillFileName(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Construct a spill file name, given a spill number
getSpillFileName(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Construct a spill file name, given a spill number ${uniqueId}_spill_${spillNumber}.out e.g.
getSpillIndexFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Return a local map spill index file created earlier
getSpillIndexFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Return a local output spill index file created earlier TODO TEZ-1855: Remove this.
getSpillIndexFile(int) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Return a local map spill index file created earlier
getSpillIndexFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
Create a local map spill index file name.
getSpillIndexFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
Create a local output spill index file name.
getSpillIndexFileForWrite(int, long) - Method in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
Create a local output spill index file name.
getSrcPhysicalIndex() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
getStartOffset() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
getStartOffset() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
getTaskAttemptIdentifier(int, int) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
getTaskAttemptIdentifier(String, int, int) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
getTaskIdentifier(String, int) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
getTezIndexRecord(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
getTezRuntimeConfigDefaults() - Static method in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
getTimeToSleepMS() - Method in class org.apache.tez.runtime.library.processor.SleepProcessor.SleepProcessorConfig
 
getType() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
getUncompressedLength() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
getUnknownFields() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
getUnknownFields() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
getUnknownFields() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
getUnknownFields() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
getUnknownFields() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
getValue() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
getValue() - Method in interface org.apache.tez.runtime.library.common.sort.impl.TezRawKeyValueIterator
Gets the current raw value.
getValues() - Method in class org.apache.tez.runtime.library.common.ValuesIterator
 
getWriter() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
getWriter() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
getWriter() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 

H

handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleInputEventHandlerImpl
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleInputEventHandlerOrderedGrouped
 
handleEvents(List<Event>) - Method in interface org.apache.tez.runtime.library.common.shuffle.ShuffleEventHandler
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
handleEvents(List<Event>) - Method in class org.apache.tez.runtime.library.processor.SleepProcessor
 
hasBasePartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 base_partition_range = 3;
hasBasePartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 base_partition_range = 3;
hasBasePartitionRange() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 base_partition_range = 3;
hasCompressedLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 compressed_length = 2;
hasCompressedLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional int32 compressed_length = 2;
hasCompressedLength() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional int32 compressed_length = 2;
hasData() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
hasData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
hasData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional .DataProto data = 6;
hasData() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional .DataProto data = 6;
hasData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional bytes data = 3;
hasData() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional bytes data = 3;
hasData() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional bytes data = 3;
hasEmptyPartitions() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional bytes empty_partitions = 1;
hasEmptyPartitions() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional bytes empty_partitions = 1;
hasEmptyPartitions() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional bytes empty_partitions = 1;
hashCode() - Method in class org.apache.hadoop.io.FileChunk
 
hashCode() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
hashCode() - Method in class org.apache.tez.runtime.library.common.InputIdentifier
 
hashCode() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
hashCode() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
hashCode() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
hashCode() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
hashCode() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
hashCode() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
hashCode() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
hashCode() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
hashFromString(String, JobTokenSecretManager) - Static method in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
Aux util to calculate hash of a String
hasHost() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
hasHost() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string host = 2;
hasHost() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string host = 2;
HashPartitioner - Class in org.apache.tez.runtime.library.partitioner
Implements a Partitioner that does hash based partitioning
HashPartitioner() - Constructor for class org.apache.tez.runtime.library.partitioner.HashPartitioner
 
hasNumDestinationTasks() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_destination_tasks = 2;
hasNumDestinationTasks() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 num_destination_tasks = 2;
hasNumDestinationTasks() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 num_destination_tasks = 2;
hasNumSourceTaskOutputs() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_source_task_outputs = 1;
hasNumSourceTaskOutputs() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 num_source_task_outputs = 1;
hasNumSourceTaskOutputs() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 num_source_task_outputs = 1;
hasOutputSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
optional int64 output_size = 1;
hasOutputSize() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
optional int64 output_size = 1;
hasOutputSize() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProtoOrBuilder
optional int64 output_size = 1;
hasPartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
optional int32 partition_range = 1;
hasPartitionRange() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
optional int32 partition_range = 1;
hasPartitionRange() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProtoOrBuilder
optional int32 partition_range = 1;
hasPathComponent() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
hasPathComponent() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional string path_component = 4;
hasPathComponent() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional string path_component = 4;
hasPort() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 port = 3;
hasPort() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional int32 port = 3;
hasPort() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional int32 port = 3;
hasRawLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 raw_length = 1;
hasRawLength() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
optional int32 raw_length = 1;
hasRawLength() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProtoOrBuilder
optional int32 raw_length = 1;
hasRemainderRangeForLastShuffler() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 remainder_range_for_last_shuffler = 4;
hasRemainderRangeForLastShuffler() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
optional int32 remainder_range_for_last_shuffler = 4;
hasRemainderRangeForLastShuffler() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder
optional int32 remainder_range_for_last_shuffler = 4;
hasRunDuration() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 run_duration = 5;
hasRunDuration() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
optional int32 run_duration = 5;
hasRunDuration() - Method in interface org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder
optional int32 run_duration = 5;
HEADER - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
HOST_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
HTTP_HEADER_NAME - Static variable in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
Header info of the shuffle http request/response
HTTP_HEADER_REPLY_URL_HASH - Static variable in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
 
HTTP_HEADER_URL_HASH - Static variable in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
 
HTTP_HEADER_VERSION - Static variable in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
HttpConnection - Class in org.apache.tez.runtime.library.common.shuffle
HttpConnection which can be used for Unordered / Ordered shuffle.
HttpConnection(URL, HttpConnection.HttpConnectionParams, String, JobTokenSecretManager) - Constructor for class org.apache.tez.runtime.library.common.shuffle.HttpConnection
HttpConnection
HttpConnection.HttpConnectionParams - Class in org.apache.tez.runtime.library.common.shuffle
 
HttpConnection.HttpConnectionParams() - Constructor for class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
HttpConnection.HttpConnectionParamsBuilder - Class in org.apache.tez.runtime.library.common.shuffle
 
HttpConnection.HttpConnectionParamsBuilder() - Constructor for class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 

I

id - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
IFile - Class in org.apache.tez.runtime.library.common.sort.impl
IFile is the simple format for the intermediate map-outputs in Map-Reduce.
IFile() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile
 
IFile.Reader - Class in org.apache.tez.runtime.library.common.sort.impl
IFile.Reader to read intermediate map-outputs.
IFile.Reader(FileSystem, Path, CompressionCodec, TezCounter, TezCounter, boolean, int, int) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
Construct an IFile Reader.
IFile.Reader(InputStream, long, CompressionCodec, TezCounter, TezCounter, boolean, int, int) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
Construct an IFile Reader.
IFile.Reader(InputStream, long, CompressionCodec, TezCounter, TezCounter, boolean, int, int, boolean) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
Construct an IFile Reader.
IFile.Reader.KeyState - Enum in org.apache.tez.runtime.library.common.sort.impl
 
IFile.Writer - Class in org.apache.tez.runtime.library.common.sort.impl
IFile.Writer to write out intermediate map-outputs.
IFile.Writer(Configuration, FileSystem, Path, Class, Class, CompressionCodec, TezCounter, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
IFile.Writer(TezCounter, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
IFile.Writer(Configuration, FSDataOutputStream, Class, Class, CompressionCodec, TezCounter, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
IFile.Writer(Configuration, FSDataOutputStream, Class, Class, CompressionCodec, TezCounter, TezCounter, boolean) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
IFile.Writer(Configuration, FileSystem, Path) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
ifileBufferSize - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
ifileBufferSize - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
IFileInputStream - Class in org.apache.tez.runtime.library.common.sort.impl
A checksum input stream, used for IFiles.
IFileInputStream(InputStream, long) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
Create a checksum input stream that reads without readAhead.
IFileInputStream(InputStream, long, boolean, int) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
Create a checksum input stream that reads
IFileOutputStream - Class in org.apache.tez.runtime.library.common.sort.impl
A Checksum output stream.
IFileOutputStream(OutputStream) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.IFileOutputStream
Create a checksum output stream that writes the bytes to the given stream.
ifileReadAhead - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
ifileReadAhead - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
ifileReadAheadLength - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
ifileReadAheadLength - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
in - Variable in class org.apache.tez.runtime.library.common.ValuesIterator
 
INDEX_RECORD_LENGTH - Static variable in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
initialize() - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
initialize() - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
initialize() - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
initialize() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
initialize() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
initialize() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
initialize() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
initialize() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
initialize() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
initialize() - Method in class org.apache.tez.runtime.library.processor.SleepProcessor
 
InMemoryReader - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
IFile.InMemoryReader to read map-outputs present in-memory.
InMemoryReader(MergeManager, InputAttemptIdentifier, byte[], int, int) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
InMemoryWriter - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
 
InMemoryWriter(BoundedByteArrayOutputStream) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryWriter
 
InputAlreadyClosedException - Exception in org.apache.tez.runtime.library.exceptions
 
InputAlreadyClosedException() - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException
 
InputAlreadyClosedException(Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException
 
InputAlreadyClosedException(String, Throwable) - Constructor for exception org.apache.tez.runtime.library.exceptions.InputAlreadyClosedException
 
InputAttemptIdentifier - Class in org.apache.tez.runtime.library.common
Container for a task number and an attempt number for the task.
InputAttemptIdentifier(int, int) - Constructor for class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
InputAttemptIdentifier(InputIdentifier, int, String) - Constructor for class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
InputAttemptIdentifier(InputIdentifier, int, String, boolean) - Constructor for class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
InputAttemptIdentifier(int, int, String) - Constructor for class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
InputAttemptIdentifier(int, int, String, boolean) - Constructor for class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
inputAttemptIdentifier - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
InputHost - Class in org.apache.tez.runtime.library.common.shuffle
Represents a Host with respect to the MapReduce ShuffleHandler.
InputHost(String, int, ApplicationId, int) - Constructor for class org.apache.tez.runtime.library.common.shuffle.InputHost
 
InputIdentifier - Class in org.apache.tez.runtime.library.common
 
InputIdentifier(int) - Constructor for class org.apache.tez.runtime.library.common.InputIdentifier
 
InputReadyVertexManager - Class in org.apache.tez.dag.library.vertexmanager
 
InputReadyVertexManager(VertexManagerPluginContext) - Constructor for class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
inputs - Variable in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
instantiateCombiner(Configuration, TaskContext) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
instantiatePartitioner(Configuration) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
instantiateTaskOutputManager(Configuration, OutputContext) - Static method in class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
internalGetFieldAccessorTable() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
isCompressed - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
isCompressedFlagEnabled(InputStream) - Static method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
isInitialized() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
isInputReady() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
Indicates whether the Shuffle and Merge processing is complete.
isInputReady() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
Check if the input is ready for consumption
isIntermediateInputCompressed(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
isLocalFile() - Method in class org.apache.hadoop.io.FileChunk
 
isMergeComplete() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
Should only be used after the Shuffle phaze is complete, otherwise can return an invalid state since a merge may not be in progress dur to inadequate inputs
isShared() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
isSSLShuffleEnabled() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 

K

keyClass - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
keyClass - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
keySerializer - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
keySerializer - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
KEYSTART - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
KeyValueReader - Class in org.apache.tez.runtime.library.api
A key/value(s) pair based Reader.
KeyValueReader() - Constructor for class org.apache.tez.runtime.library.api.KeyValueReader
 
KeyValuesReader - Class in org.apache.tez.runtime.library.api
A key/value(s) pair based Reader.
KeyValuesReader() - Constructor for class org.apache.tez.runtime.library.api.KeyValuesReader
 
KeyValuesWriter - Class in org.apache.tez.runtime.library.api
key/value(s) based KeyValueWriter
KeyValuesWriter() - Constructor for class org.apache.tez.runtime.library.api.KeyValuesWriter
 
KeyValueWriter - Class in org.apache.tez.runtime.library.api
A key/value(s) pair based Writer
KeyValueWriter() - Constructor for class org.apache.tez.runtime.library.api.KeyValueWriter
 

L

LOCAL_DIRS - Static variable in class org.apache.tez.common.TezRuntimeFrameworkConfigs
List of directories available to the Runtime.
LocalDiskFetchedInput - Class in org.apache.tez.runtime.library.common.shuffle
 
LocalDiskFetchedInput(long, long, long, InputAttemptIdentifier, Path, Configuration, FetchedInputCallback) - Constructor for class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
LocalShuffle - Class in org.apache.tez.runtime.library.common.localshuffle
 
LocalShuffle(InputContext, Configuration, int) - Constructor for class org.apache.tez.runtime.library.common.localshuffle.LocalShuffle
 
LOG - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 

M

MAP_OUTPUT_FILENAME_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
MAP_OUTPUT_INDEX_RECORD_LENGTH - Static variable in class org.apache.tez.runtime.library.common.Constants
 
MAP_OUTPUT_INDEX_RECORD_LENGTH - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
The size of each record in the index file for the map-outputs.
MAP_OUTPUT_INDEX_RECORD_LENGTH - Static variable in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
The size of each record in the index file for the map-outputs.
MAP_OUTPUT_INDEX_SUFFIX_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
mapOutputByteCounter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
mapOutputFile - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
mapOutputRecordCounter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
markRecord() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.BlockingBuffer
Mark end of record.
memoryAssigned(long) - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler
 
MemoryFetchedInput - Class in org.apache.tez.runtime.library.common.shuffle
 
MemoryFetchedInput(long, long, InputAttemptIdentifier, FetchedInputCallback) - Constructor for class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
MemoryUpdateCallbackHandler - Class in org.apache.tez.runtime.library.common
 
MemoryUpdateCallbackHandler() - Constructor for class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler
 
memoryUpdateCallbackHandler - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
memoryUpdateCallbackHandler - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
merge(Configuration, FileSystem, Class, Class, CompressionCodec, boolean, int, int, Path[], boolean, int, Path, RawComparator, Progressable, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
merge(Configuration, FileSystem, Class, Class, CompressionCodec, boolean, int, int, Path[], boolean, int, Path, RawComparator, Progressable, TezCounter, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
merge(Configuration, FileSystem, Class, Class, List<TezMerger.Segment>, int, Path, RawComparator, Progressable, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
merge(Configuration, FileSystem, Class, Class, List<TezMerger.Segment>, int, Path, RawComparator, Progressable, boolean, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
merge(Configuration, FileSystem, Class, Class, CompressionCodec, List<TezMerger.Segment>, int, Path, RawComparator, Progressable, boolean, boolean, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
merge(Configuration, FileSystem, Class, Class, CompressionCodec, List<TezMerger.Segment>, int, int, Path, RawComparator, Progressable, boolean, TezCounter, TezCounter, TezCounter, Progress) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
mergeConfsWithExclusions(Configuration, Map<String, String>, Set<String>) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
MERGED_OUTPUT_PREFIX - Static variable in class org.apache.tez.runtime.library.common.Constants
 
mergeData(ShuffleUserPayloads.DataProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
mergeFrom(Message) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
mergeFrom(ShuffleUserPayloads.DataMovementEventPayloadProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
mergeFrom(CodedInputStream, ExtensionRegistryLite) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
 
mergeFrom(Message) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
mergeFrom(ShuffleUserPayloads.DataProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
mergeFrom(CodedInputStream, ExtensionRegistryLite) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
 
mergeFrom(Message) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
mergeFrom(ShuffleUserPayloads.InputInformationEventPayloadProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
mergeFrom(CodedInputStream, ExtensionRegistryLite) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
 
mergeFrom(Message) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
mergeFrom(ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
mergeFrom(CodedInputStream, ExtensionRegistryLite) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
 
mergeFrom(Message) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
mergeFrom(ShuffleUserPayloads.VertexManagerEventPayloadProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
mergeFrom(CodedInputStream, ExtensionRegistryLite) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
 
MergeManager - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
Usage.
MergeManager(Configuration, FileSystem, LocalDirAllocator, InputContext, Combiner, TezCounter, TezCounter, TezCounter, ExceptionReporter, long, CompressionCodec, boolean, int) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
Construct the MergeManager.
METASIZE - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
moveToNext() - Method in class org.apache.tez.runtime.library.common.ValuesIterator
Move to the next K-Vs pair

N

newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig
 
newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
Create a builder to configure the relevant Input and Output.
newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig
Create a builder to configure the relevant Input and Output
newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig
 
newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig
 
newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig
Create a builder to configure the relevant Input and Output
newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig
 
newBuilder(String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig
 
newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
Create a builder to configure the relevant Input and Output.
newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig
Create a builder to configure the relevant Input and Output
newBuilder(String, String, String) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig
 
newBuilder(String, String, String, Map<String, String>) - Static method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig
 
newBuilder() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
newBuilder(ShuffleUserPayloads.DataMovementEventPayloadProto) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
newBuilder() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
newBuilder(ShuffleUserPayloads.DataProto) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
newBuilder() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
newBuilder(ShuffleUserPayloads.InputInformationEventPayloadProto) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
newBuilder() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
newBuilder(ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
newBuilder() - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
newBuilder(ShuffleUserPayloads.VertexManagerEventPayloadProto) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
newBuilderForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
newBuilderForType(GeneratedMessage.BuilderParent) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
newBuilderForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
newBuilderForType(GeneratedMessage.BuilderParent) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
newBuilderForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
newBuilderForType(GeneratedMessage.BuilderParent) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
newBuilderForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
newBuilderForType(GeneratedMessage.BuilderParent) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
newBuilderForType() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
newBuilderForType(GeneratedMessage.BuilderParent) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
newInputAvailable() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
next() - Method in class org.apache.tez.runtime.library.api.KeyValueReader
Moves to the next key/values(s) pair
next() - Method in class org.apache.tez.runtime.library.api.KeyValuesReader
Moves to the next key/values(s) pair
next() - Method in class org.apache.tez.runtime.library.common.readers.UnorderedKVReader
Moves to the next key/values(s) pair
next() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.MRResultIterator
 
next() - Method in interface org.apache.tez.runtime.library.common.sort.impl.TezRawKeyValueIterator
Sets up the current key and value (for getKey and getValue).
next() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput.ConcatenatedMergedKeyValueReader
 
next() - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput.ConcatenatedMergedKeyValuesReader
 
nextRawKey(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
nextRawValue(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
nextRawValue(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
NMETA - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
notifyFetchComplete() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Inform the Allocator about a committed resource.
notifyFetchFailure() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Inform the Allocator about a failed resource.
notifyFreedResource() - Method in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
Inform the Allocator about a completed resource being released.
nullProgressable - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
NullProgressable - Class in org.apache.tez.runtime.library.hadoop.compat
 
NullProgressable() - Constructor for class org.apache.tez.runtime.library.hadoop.compat.NullProgressable
 
NUM_DESTINATION_TASKS_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
NUM_SOURCE_TASK_OUTPUTS_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
numAdditionalSpills - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
numAdditionalSpillsCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents the number of additional spills.
numPartitions - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 

O

obsoleteKnownInput(InputAttemptIdentifier) - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
onRootVertexInitialized(String, InputDescriptor, List<Event>) - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
onRootVertexInitialized(String, InputDescriptor, List<Event>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
onSourceTaskCompleted(String, Integer) - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
onSourceTaskCompleted(String, Integer) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
onVertexManagerEventReceived(VertexManagerEvent) - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
onVertexManagerEventReceived(VertexManagerEvent) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
onVertexStarted(Map<String, List<Integer>>) - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
onVertexStarted(Map<String, List<Integer>>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
onVertexStateUpdated(VertexStateUpdate) - Method in class org.apache.tez.dag.library.vertexmanager.InputReadyVertexManager
 
onVertexStateUpdated(VertexStateUpdate) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
open(InputStream) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableDeserializer
 
open(OutputStream) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableSerializer
 
openIFileReader(FetchedInput) - Method in class org.apache.tez.runtime.library.common.readers.UnorderedKVReader
 
OrderedGroupedInputLegacy - Class in org.apache.tez.runtime.library.input
 
OrderedGroupedInputLegacy(InputContext, int) - Constructor for class org.apache.tez.runtime.library.input.OrderedGroupedInputLegacy
 
OrderedGroupedKVInput - Class in org.apache.tez.runtime.library.input
OrderedGroupedKVInput in a AbstractLogicalInput which shuffles intermediate sorted data, merges them and provides key/ to the consumer.
OrderedGroupedKVInput(InputContext, int) - Constructor for class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
OrderedGroupedKVInputConfig - Class in org.apache.tez.runtime.library.conf
 
OrderedGroupedKVInputConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
OrderedGroupedKVInputConfig.SpecificBuilder<E extends HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf
 
OrderedGroupedKVInputConfig.SpecificConfigBuilder<T> - Interface in org.apache.tez.runtime.library.conf
Configure parameters which are specific to the Input.
OrderedGroupedMergedKVInput - Class in org.apache.tez.runtime.library.input
A MergedLogicalInput which merges multiple OrderedGroupedKVInputs and returns a single view of these by merging values which belong to the same key.
OrderedGroupedMergedKVInput(MergedInputContext, List<Input>) - Constructor for class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput
 
OrderedPartitionedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf
Configure payloads for the OrderedPartitionedKVOutput and OrderedGroupedKVInput pair
OrderedPartitionedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
OrderedPartitionedKVOutput - Class in org.apache.tez.runtime.library.output
OrderedPartitionedKVOutput is an AbstractLogicalOutput which sorts key/value pairs written to it.
OrderedPartitionedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
OrderedPartitionedKVOutputConfig - Class in org.apache.tez.runtime.library.conf
 
OrderedPartitionedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
OrderedPartitionedKVOutputConfig.SpecificBuilder<E extends HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf
 
OrderedPartitionedKVOutputConfig.SpecificConfigBuilder<T> - Interface in org.apache.tez.runtime.library.conf
Configure parameters which are specific to the Output.
org.apache.hadoop.io - package org.apache.hadoop.io
 
org.apache.tez.common - package org.apache.tez.common
 
org.apache.tez.dag.library.vertexmanager - package org.apache.tez.dag.library.vertexmanager
 
org.apache.tez.runtime.library.api - package org.apache.tez.runtime.library.api
 
org.apache.tez.runtime.library.broadcast.output - package org.apache.tez.runtime.library.broadcast.output
 
org.apache.tez.runtime.library.common - package org.apache.tez.runtime.library.common
 
org.apache.tez.runtime.library.common.combine - package org.apache.tez.runtime.library.common.combine
 
org.apache.tez.runtime.library.common.comparator - package org.apache.tez.runtime.library.common.comparator
 
org.apache.tez.runtime.library.common.localshuffle - package org.apache.tez.runtime.library.common.localshuffle
 
org.apache.tez.runtime.library.common.readers - package org.apache.tez.runtime.library.common.readers
 
org.apache.tez.runtime.library.common.security - package org.apache.tez.runtime.library.common.security
 
org.apache.tez.runtime.library.common.serializer - package org.apache.tez.runtime.library.common.serializer
 
org.apache.tez.runtime.library.common.shuffle - package org.apache.tez.runtime.library.common.shuffle
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.shuffle.impl - package org.apache.tez.runtime.library.common.shuffle.impl
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.shuffle.orderedgrouped - package org.apache.tez.runtime.library.common.shuffle.orderedgrouped
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.sort.impl - package org.apache.tez.runtime.library.common.sort.impl
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.sort.impl.dflt - package org.apache.tez.runtime.library.common.sort.impl.dflt
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.task.local.output - package org.apache.tez.runtime.library.common.task.local.output
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.common.writers - package org.apache.tez.runtime.library.common.writers
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.conf - package org.apache.tez.runtime.library.conf
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.exceptions - package org.apache.tez.runtime.library.exceptions
 
org.apache.tez.runtime.library.hadoop.compat - package org.apache.tez.runtime.library.hadoop.compat
 
org.apache.tez.runtime.library.input - package org.apache.tez.runtime.library.input
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.output - package org.apache.tez.runtime.library.output
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
org.apache.tez.runtime.library.partitioner - package org.apache.tez.runtime.library.partitioner
 
org.apache.tez.runtime.library.processor - package org.apache.tez.runtime.library.processor
 
org.apache.tez.runtime.library.resources - package org.apache.tez.runtime.library.resources
 
org.apache.tez.runtime.library.shuffle.impl - package org.apache.tez.runtime.library.shuffle.impl
 
org.apache.tez.runtime.library.utils - package org.apache.tez.runtime.library.utils
 
originalKeyLength - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
out - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
OUTPUT_SIZE_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
outputBytesWithOverheadCounter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
outputBytesWithOverheadCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents the size of the final output - with any overheads introduced by meta-information.
outputContext - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
outputContext - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
outputFileHandler - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
outputLargeRecordsCounter - Variable in class org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter
Represents final number of records written (spills are not counted)
outputRecordBytesCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents the serialized size of the output records.
outputRecordsCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents final number of records written (spills are not counted)
outputs - Variable in class org.apache.tez.runtime.library.processor.SimpleProcessor
 

P

parseDelimitedFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseDelimitedFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseDelimitedFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseDelimitedFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseDelimitedFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseDelimitedFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseDelimitedFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseDelimitedFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseDelimitedFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseDelimitedFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(ByteString) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(ByteString, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(byte[]) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(byte[], ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(CodedInputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(CodedInputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
parseFrom(ByteString) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(ByteString, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(byte[]) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(byte[], ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(CodedInputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(CodedInputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
parseFrom(ByteString) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(ByteString, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(byte[]) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(byte[], ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(CodedInputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(CodedInputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
parseFrom(ByteString) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(ByteString, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(byte[]) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(byte[], ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(CodedInputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(CodedInputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
parseFrom(ByteString) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(ByteString, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(byte[]) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(byte[], ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(InputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(InputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(CodedInputStream) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
parseFrom(CodedInputStream, ExtensionRegistryLite) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
PARSER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
PARSER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
PARSER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
PARSER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
PARSER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
PARTITION - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
PARTITION_RANGE_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
Partitioner - Interface in org.apache.tez.runtime.library.api
Partitioner is used by the TEZ framework to partition output key/value pairs.
partitioner - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
partitioner - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
partitions - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
PATH_COMPONENT_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
PATH_PREFIX - Static variable in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
PipelinedSorter - Class in org.apache.tez.runtime.library.common.sort.impl
 
PipelinedSorter(OutputContext, Configuration, int, long) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
PipelinedSorter.InputByteBuffer - Class in org.apache.tez.runtime.library.common.sort.impl
 
PipelinedSorter.InputByteBuffer() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.InputByteBuffer
 
PORT_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
positionToNextRecord(DataInput) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
Reset key length and value length for next record in the file
postOp() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
Called after SimpleProcessor.run() is called and can be used to do post-processing like committing output etc
preOp() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
Implements input/output initialization.
prevKeyLength - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
PreWarmProcessor - Class in org.apache.tez.runtime.library.processor
Built-in convenience Processor to be used for pre-warming.
PreWarmProcessor(ProcessorContext) - Constructor for class org.apache.tez.runtime.library.processor.PreWarmProcessor
 
preWarmTezCode() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor
Pre-warm Tez code.
preWarmUserCode() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor
Pre-warm user code.
progress() - Method in class org.apache.tez.runtime.library.hadoop.compat.NullProgressable
 
ProxyComparator<KEY> - Interface in org.apache.tez.runtime.library.common.comparator
 
putIndex(TezIndexRecord, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
Set spill offsets for given partition.

R

RAW_LENGTH_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
rawIter - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
read(byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
Read bytes from the stream.
read() - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 
readFields(DataInput) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
readKeyValueLength(DataInput) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
readKeyValueLength(DataInput) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
readRawKey(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
readRawKey(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
readToMemory(byte[], InputStream, int, CompressionCodec, boolean, int) - Static method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
Read entire ifile content to memory.
readValueLength(DataInput) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
readWithChecksum(byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
Read bytes from the stream.
recNo - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
REDUCE_INPUT_FILE_FORMAT_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
registerAllExtensions(ExtensionRegistry) - Static method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads
 
REMAINDER_RANGE_FOR_LAST_SHUFFLER_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
REPEAT_KEY - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
reportException(Throwable) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
reserve(InputAttemptIdentifier, long, long, int) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
reset(int) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.InMemoryReader
 
reset(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Reader
 
reset(ByteBuffer, int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.InputByteBuffer
 
reset(DataInputBuffer) - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter.InputByteBuffer
 
rfs - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
rle - Variable in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
RLE_MARKER - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
routeDataMovementEventToDestination(DataMovementEvent, int, int, Map<Integer, List<Integer>>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
routeInputErrorEventToSource(InputReadErrorEvent, int, int) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
routeInputSourceTaskFailedEventToDestination(int, Map<Integer, List<Integer>>) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
run() - Method in class org.apache.tez.runtime.library.common.localshuffle.LocalShuffle
 
run() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
run() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
run() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.SpillThread
 
run() - Method in class org.apache.tez.runtime.library.processor.PreWarmProcessor
 
run(Map<String, LogicalInput>, Map<String, LogicalOutput>) - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
 
run() - Method in class org.apache.tez.runtime.library.processor.SimpleProcessor
Users must implement this method to provide the main application logic code
run(Map<String, LogicalInput>, Map<String, LogicalOutput>) - Method in class org.apache.tez.runtime.library.processor.SleepProcessor
 
RUN_DURATION_FIELD_NUMBER - Static variable in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
runCombineProcessor(TezRawKeyValueIterator, IFile.Writer) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 

S

sameVolRename(Path, Path) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
Rename srcPath to dstPath on the same volume.
SecureShuffleUtils - Class in org.apache.tez.runtime.library.common.security
utilities for generating kyes, hashes and verifying them for shuffle
SecureShuffleUtils() - Constructor for class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
 
serializationFactory - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
serializationFactory - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
serialize(Writable) - Method in class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableSerializer
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
 
setAdditionalConfiguration(String, String) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder
 
setAdditionalConfiguration(Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder
 
setAutoReduceParallelism(boolean) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
setAvailableBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
 
setAvailableBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder
 
setAvailableBufferSize(int) - Method in interface org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder
Set the buffer size to use
setBasePartitionRange(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 base_partition_range = 3;
setBufferSize(int) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 
setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setCombiner(String) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Configure the combiner class
setCombiner(String, Map<String, String>) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Configure the combiner class and it's associated configuration (specified as key-value pairs).
setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setCombiner(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setCombiner(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setCombiner(String) - Method in interface org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificConfigBuilder
Configure the combiner class
setCombiner(String, Map<String, String>) - Method in interface org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificConfigBuilder
Configure the combiner class and it's associated configuration (specified as key-value pairs).
setCompressedLength(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 compressed_length = 2;
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
 
setCompression(boolean, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
 
setCompressionParameters(CompressionCodec) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
setConf(Configuration) - Method in class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
 
setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValueInput
 
setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.ConcatenatedMergedKeyValuesInput
 
setConstituentInputIsReady(Input) - Method in class org.apache.tez.runtime.library.input.OrderedGroupedMergedKVInput
 
setData(ShuffleUserPayloads.DataProto) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
setData(ShuffleUserPayloads.DataProto.Builder) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional .DataProto data = 6;
setData(ByteString) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional bytes data = 3;
setDesiredTaskInputSize(long) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
setEmptyPartitions(ByteString) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional bytes empty_partitions = 1;
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.SpecificBuilder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
 
setFromConfiguration(Configuration) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.SpecificBuilder
 
setHost(String) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
setHostBytes(ByteString) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string host = 2;
setHttpConnectionParameters(HttpConnection.HttpConnectionParams) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
setIFileParams(boolean, int) - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher.FetcherBuilder
 
setKeepAlive(boolean, int) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 
setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
Set the key comparator class
setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
Set the key comparator class and it's associated configuration.
setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Set the key comparator class
setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Set the key comparator class and it's associated configuration.
setKeyComparatorClass(String) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
Set the key comparator class
setKeyComparatorClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
Set the key comparator class and it's associated configuration.
setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
Set serialization class and the relevant comparator to be used for sorting.
setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Set serialization class and the relevant comparator to be used for sorting.
setKeySerializationClass(String, String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
Set serialization class and the relevant comparator to be used for sorting.
setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
Set serialization class responsible for providing serializer/deserializer for key/value and the corresponding comparator class to be used as key comparator.
setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for key/value and the corresponding comparator class to be used as key comparator.
setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for keys.
setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
Set serialization class responsible for providing serializer/deserializer for keys.
setKeySerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for keys.
setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setMaxSingleMemorySegmentFraction(float) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Sets a size limit on the maximum segment size to be shuffled to disk.
setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setMaxSingleMemorySegmentFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setMaxSingleMemorySegmentFraction(float) - Method in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
Sets a size limit on the maximum segment size to be shuffled to disk.
setMemToMemMerger(boolean) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setMemToMemMerger(boolean) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setMemToMemMerger(boolean) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Enable the memory to memory merger
setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setMergeFraction(float) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Configure the point at which in memory segments will be merged.
setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setMergeFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setMergeFraction(float) - Method in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
Configure the point at which in memory segments will be merged and written out to a single large disk segment.
setMinTaskParallelism(int) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
setNumDestinationTasks(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_destination_tasks = 2;
setNumSourceTaskOutputs(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 num_source_task_outputs = 1;
setOutputSize(long) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder
optional int64 output_size = 1;
setPartitionRange(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto.Builder
optional int32 partition_range = 1;
setPathComponent(String) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
setPathComponentBytes(ByteString) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional string path_component = 4;
setPort(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 port = 3;
setPostMergeBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setPostMergeBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setPostMergeBufferFraction(float) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Sets the buffer fraction, as a fraction of container size, to be used after the fetch and merge are complete.
setRawLength(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto.Builder
optional int32 raw_length = 1;
setReadTimeout(int) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
setRemainderRangeForLastShuffler(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder
optional int32 remainder_range_for_last_shuffler = 4;
setRunDuration(int) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto.Builder
optional int32 run_duration = 5;
setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
setShuffleBufferFraction(float) - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Sets the buffer fraction, as a fraction of container size, to be used while fetching remote data.
setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
 
setShuffleBufferFraction(float) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificBuilder
 
setShuffleBufferFraction(float) - Method in interface org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.SpecificConfigBuilder
Sets the buffer fraction, as a fraction of container size, to be used while fetching remote data.
setSlowStartMaxSrcCompletionFraction(float) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
setSlowStartMinSrcCompletionFraction(float) - Method in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.ShuffleVertexManagerConfigBuilder
 
setSortBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setSortBufferSize(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setSortBufferSize(int) - Method in interface org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificConfigBuilder
Set the buffer size to use when sort the output
setSorterNumThreads(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
 
setSorterNumThreads(int) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificBuilder
 
setSorterNumThreads(int) - Method in interface org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.SpecificConfigBuilder
Configure the number of threads to be used by the sorter
setSSL(boolean, Configuration) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 
setTimeout(int, int) - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParamsBuilder
 
setupLocalDiskFetch() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
Serialization class to be used for serializing values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVEdgeConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVEdgeConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVEdgeConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
setValueSerializationClass(String, Map<String, String>) - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig.Builder
Set serialization class responsible for providing serializer/deserializer for values.
shiftBufferedKey() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.BlockingBuffer
Set position from last mark to end of writable buffer, then rewrite the data between last mark and kvindex.
shouldCompressIntermediateOutput(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 
Shuffle - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
Usage: Create instance, setInitialMemoryAllocated(long), run()
Shuffle(InputContext, Configuration, int, long) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
shuffle - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
Shuffle.ShuffleError - Exception in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
 
SHUFFLE_HANDLER_SERVICE_ID - Static variable in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
ShuffleEventHandler - Interface in org.apache.tez.runtime.library.common.shuffle
 
ShuffleHeader - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
Shuffle Header information that is sent by the TaskTracker and deciphered by the Fetcher thread of Reduce task
ShuffleHeader() - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
ShuffleHeader(String, long, long, int) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
ShuffleInputEventHandlerImpl - Class in org.apache.tez.runtime.library.common.shuffle.impl
A base class for generic Event handling for Inputs which need to Shuffle data.
ShuffleInputEventHandlerImpl(InputContext, ShuffleManager, FetchedInputAllocator, CompressionCodec, boolean, int) - Constructor for class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleInputEventHandlerImpl
 
ShuffleInputEventHandlerOrderedGrouped - Class in org.apache.tez.runtime.library.common.shuffle.orderedgrouped
 
ShuffleInputEventHandlerOrderedGrouped(InputContext, ShuffleScheduler, boolean) - Constructor for class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleInputEventHandlerOrderedGrouped
 
ShuffleManager - Class in org.apache.tez.runtime.library.common.shuffle.impl
 
ShuffleManager(InputContext, Configuration, int, int, boolean, int, CompressionCodec, FetchedInputAllocator) - Constructor for class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
shuffleToDisk(OutputStream, String, InputStream, long, Log, String) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
shuffleToMemory(byte[], InputStream, int, int, CompressionCodec, boolean, int, Log, String) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
ShuffleUserPayloads - Class in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUserPayloads.DataMovementEventPayloadProto - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type DataMovementEventPayloadProto
ShuffleUserPayloads.DataMovementEventPayloadProto.Builder - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type DataMovementEventPayloadProto
ShuffleUserPayloads.DataMovementEventPayloadProtoOrBuilder - Interface in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUserPayloads.DataProto - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type DataProto
ShuffleUserPayloads.DataProto.Builder - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type DataProto
ShuffleUserPayloads.DataProtoOrBuilder - Interface in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUserPayloads.InputInformationEventPayloadProto - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type InputInformationEventPayloadProto
ShuffleUserPayloads.InputInformationEventPayloadProto.Builder - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type InputInformationEventPayloadProto
ShuffleUserPayloads.InputInformationEventPayloadProtoOrBuilder - Interface in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type ShuffleEdgeManagerConfigPayloadProto
ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto.Builder - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type ShuffleEdgeManagerConfigPayloadProto
ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProtoOrBuilder - Interface in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUserPayloads.VertexManagerEventPayloadProto - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type VertexManagerEventPayloadProto
ShuffleUserPayloads.VertexManagerEventPayloadProto.Builder - Class in org.apache.tez.runtime.library.shuffle.impl
Protobuf type VertexManagerEventPayloadProto
ShuffleUserPayloads.VertexManagerEventPayloadProtoOrBuilder - Interface in org.apache.tez.runtime.library.shuffle.impl
 
ShuffleUtils - Class in org.apache.tez.runtime.library.common.shuffle
 
ShuffleUtils() - Constructor for class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
ShuffleVertexManager - Class in org.apache.tez.dag.library.vertexmanager
Starts scheduling tasks when number of completed source tasks crosses slowStartMinSrcCompletionFraction and schedules all tasks when slowStartMaxSrcCompletionFraction is reached
ShuffleVertexManager(VertexManagerPluginContext) - Constructor for class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
ShuffleVertexManager.CustomShuffleEdgeManager - Class in org.apache.tez.dag.library.vertexmanager
 
ShuffleVertexManager.CustomShuffleEdgeManager(EdgeManagerPluginContext) - Constructor for class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.CustomShuffleEdgeManager
 
ShuffleVertexManager.ShuffleVertexManagerConfigBuilder - Class in org.apache.tez.dag.library.vertexmanager
Helper class to configure ShuffleVertexManager
shutdown() - Method in class org.apache.tez.runtime.library.common.shuffle.Fetcher
 
shutdown() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
shutdown() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
 
SimpleFetchedInputAllocator - Class in org.apache.tez.runtime.library.common.shuffle.impl
Usage: Create instance, setInitialMemoryAvailable(long), configureAndStart()
SimpleFetchedInputAllocator(String, Configuration, long, long) - Constructor for class org.apache.tez.runtime.library.common.shuffle.impl.SimpleFetchedInputAllocator
 
SimpleProcessor - Class in org.apache.tez.runtime.library.processor
Implements an AbstractLogicalIOProcessor and provides empty implementations of most methods and handles input/output initialization.
SimpleProcessor(ProcessorContext) - Constructor for class org.apache.tez.runtime.library.processor.SimpleProcessor
 
size() - Method in class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
Return number of IndexRecord entries in this spill.
skip(long) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileInputStream
 
SleepProcessor - Class in org.apache.tez.runtime.library.processor
A simple sleep processor implementation that sleeps for the configured time in milliseconds.
SleepProcessor(ProcessorContext) - Constructor for class org.apache.tez.runtime.library.processor.SleepProcessor
 
SleepProcessor.SleepProcessorConfig - Class in org.apache.tez.runtime.library.processor
Configuration for the Sleep Processor.
SleepProcessor.SleepProcessorConfig() - Constructor for class org.apache.tez.runtime.library.processor.SleepProcessor.SleepProcessorConfig
 
SleepProcessor.SleepProcessorConfig(int) - Constructor for class org.apache.tez.runtime.library.processor.SleepProcessor.SleepProcessorConfig
 
sort() - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
sortAndSpill() - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
sorter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
sorter - Variable in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
spill(int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
spill() - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
spilledRecordsCounter - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
spilledRecordsCounter - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
Represents the additional records written to disk due to spills.
start() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 
start() - Method in class org.apache.tez.runtime.library.input.UnorderedKVInput
 
start() - Method in class org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput
 
start() - Method in class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
start() - Method in class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
state - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 
stringify(ShuffleUserPayloads.DataMovementEventPayloadProto) - Static method in class org.apache.tez.runtime.library.common.shuffle.ShuffleUtils
 
swap(int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
Swap metadata for items i,j

T

TEZ - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_COMBINE_MIN_SPILLS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_COMBINE_MIN_SPILLS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_COMBINER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Specifies a combiner class (primarily for Shuffle)
TEZ_RUNTIME_COMPRESS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_COMPRESS_CODEC - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_CONVERT_USER_PAYLOAD_TO_HISTORY_TEXT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Value: Boolean Whether to publish configuration information to History logger.
TEZ_RUNTIME_CONVERT_USER_PAYLOAD_TO_HISTORY_TEXT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_EMPTY_PARTITION_INFO_VIA_EVENTS_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_EMPTY_PARTITION_INFO_VIA_EVENTS_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_GROUP_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IFILE_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IFILE_READAHEAD - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Configuration key to enable/disable IFile readahead.
TEZ_RUNTIME_IFILE_READAHEAD_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Configuration key to set the IFile readahead length in bytes.
TEZ_RUNTIME_IFILE_READAHEAD_BYTES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IFILE_READAHEAD_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_INDEX_CACHE_MEMORY_LIMIT_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_INDEX_CACHE_MEMORY_LIMIT_BYTES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_INPUT_BUFFER_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_INPUT_POST_MERGE_BUFFER_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_INTERNAL_SORTER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IO_FILE_BUFFER_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
This is copy of io.file.buffer.size from Hadoop, which is used in several places such as compression codecs, buffer sizes in IFile, while fetching etc.
TEZ_RUNTIME_IO_SORT_FACTOR - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IO_SORT_FACTOR_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IO_SORT_MB - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_IO_SORT_MB_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_JOB_CREDENTIALS - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_KEY_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_KEY_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_KEY_SECONDARY_COMPARATOR_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_METRICS_SESSION_ID - Static variable in class org.apache.tez.common.TezRuntimeFrameworkConfigs
 
TEZ_RUNTIME_METRICS_SESSION_ID_DEFAULT - Static variable in class org.apache.tez.common.TezRuntimeFrameworkConfigs
 
TEZ_RUNTIME_NUM_EXPECTED_PARTITIONS - Static variable in class org.apache.tez.common.TezRuntimeFrameworkConfigs
 
TEZ_RUNTIME_OPTIMIZE_LOCAL_FETCH - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
If the shuffle input is on the local host bypass the http fetch and access the files directly
TEZ_RUNTIME_OPTIMIZE_LOCAL_FETCH_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
local mode bypassing the http fetch is not enabled by default till we have unit tests in.
TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Share data fetched between tasks running on the same host if applicable
TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
shared mode bypassing the http fetch is not enabled by default till we have unit tests in.
TEZ_RUNTIME_PARTITIONER_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Specifies a partitioner class, which is used in Tez Runtime components like OnFileSortedOutput
TEZ_RUNTIME_RECORDS_BEFORE_PROGRESS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_RECORDS_BEFORE_PROGRESS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_BUFFER_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_BUFFER_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_CONNECT_TIMEOUT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_ENABLE_MEMTOMEM - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_ENABLE_MEMTOMEM_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_ENABLE_SSL - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_ENABLE_SSL_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_BUFFER_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_BUFFER_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_FAILURES_LIMIT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_FAILURES_LIMIT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_MAX_TASK_OUTPUT_AT_ONCE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_FETCH_MAX_TASK_OUTPUT_AT_ONCE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_MAX_CONNECTIONS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_KEEP_ALIVE_MAX_CONNECTIONS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_MEMORY_LIMIT_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_MEMORY_LIMIT_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_MEMTOMEM_SEGMENTS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_MERGE_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_MERGE_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_NOTIFY_READERROR - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_NOTIFY_READERROR_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_PARALLEL_COPIES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_PARALLEL_COPIES_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_READ_TIMEOUT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_READ_TIMEOUT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SHUFFLE_STALLED_COPY_TIMEOUT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SORT_SPILL_PERCENT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SORT_SPILL_PERCENT_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SORT_THREADS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_SORT_THREADS_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_TASK_ATTEMPT_ID - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_INPUT_FILE_FORMAT_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_MEMORY - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_OUTPUT_DIR - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_OUTPUT_FILENAME_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_OUTPUT_INDEX_SUFFIX_STRING - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TASK_OUTPUT_MANAGER - Static variable in class org.apache.tez.runtime.library.common.Constants
 
TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_ENABLED - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_ENABLED_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_MAX_SIZE - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_MAX_SIZE_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Size of the buffer to use if not writing directly to disk.
TEZ_RUNTIME_UNORDERED_OUTPUT_BUFFER_SIZE_MB_DEFAULT - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_RUNTIME_UNORDERED_OUTPUT_MAX_PER_BUFFER_SIZE_BYTES - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
Maximum size for individual buffers used in the UnsortedPartitionedOutput.
TEZ_RUNTIME_VALUE_CLASS - Static variable in class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TEZ_SHUFFLE_VERTEX_MANAGER_DESIRED_TASK_INPUT_SIZE - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
The desired size of input per task.
TEZ_SHUFFLE_VERTEX_MANAGER_DESIRED_TASK_INPUT_SIZE_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
TEZ_SHUFFLE_VERTEX_MANAGER_ENABLE_AUTO_PARALLEL - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
Enables automatic parallelism determination for the vertex.
TEZ_SHUFFLE_VERTEX_MANAGER_ENABLE_AUTO_PARALLEL_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
TEZ_SHUFFLE_VERTEX_MANAGER_MAX_SRC_FRACTION - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
In case of a ScatterGather connection, once this fraction of source tasks have completed, all tasks on the current vertex can be scheduled.
TEZ_SHUFFLE_VERTEX_MANAGER_MAX_SRC_FRACTION_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
TEZ_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
In case of a ScatterGather connection, the fraction of source tasks which should complete before tasks for the current vertex are scheduled
TEZ_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
TEZ_SHUFFLE_VERTEX_MANAGER_MIN_TASK_PARALLELISM - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
Automatic parallelism determination will not decrease parallelism below this value
TEZ_SHUFFLE_VERTEX_MANAGER_MIN_TASK_PARALLELISM_DEFAULT - Static variable in class org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager
 
TezBytesComparator - Class in org.apache.tez.runtime.library.common.comparator
 
TezBytesComparator() - Constructor for class org.apache.tez.runtime.library.common.comparator.TezBytesComparator
 
TezBytesWritableSerialization - Class in org.apache.tez.runtime.library.common.serializer
When using BytesWritable, data is serialized in memory (4 bytes per key and 4 bytes per value) and written to IFile where it gets serialized again (4 bytes per key and 4 bytes per value).
TezBytesWritableSerialization() - Constructor for class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization
 
TezBytesWritableSerialization.TezBytesWritableDeserializer - Class in org.apache.tez.runtime.library.common.serializer
 
TezBytesWritableSerialization.TezBytesWritableDeserializer(Configuration, Class<?>) - Constructor for class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableDeserializer
 
TezBytesWritableSerialization.TezBytesWritableSerializer - Class in org.apache.tez.runtime.library.common.serializer
 
TezBytesWritableSerialization.TezBytesWritableSerializer() - Constructor for class org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization.TezBytesWritableSerializer
 
TezIndexRecord - Class in org.apache.tez.runtime.library.common.sort.impl
 
TezIndexRecord() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
TezIndexRecord(long, long, long) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezIndexRecord
 
TezLocalTaskOutputFiles - Class in org.apache.tez.runtime.library.common.task.local.output
Manipulate the working area for the transient store for maps and reduces.
TezLocalTaskOutputFiles(Configuration, String) - Constructor for class org.apache.tez.runtime.library.common.task.local.output.TezLocalTaskOutputFiles
 
TezMerger - Class in org.apache.tez.runtime.library.common.sort.impl
Merger is an utility class used by the Map and Reduce tasks for merging both their memory and disk segments
TezMerger() - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
TezMerger.Segment<K,V> - Class in org.apache.tez.runtime.library.common.sort.impl
 
TezMerger.Segment(Configuration, FileSystem, Path, CompressionCodec, boolean, int, int, boolean) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezMerger.Segment(Configuration, FileSystem, Path, CompressionCodec, boolean, int, int, boolean, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezMerger.Segment(Configuration, FileSystem, Path, long, long, CompressionCodec, boolean, int, int, boolean) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezMerger.Segment(Configuration, FileSystem, Path, long, long, CompressionCodec, boolean, int, int, boolean, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezMerger.Segment(IFile.Reader, boolean) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezMerger.Segment(IFile.Reader, boolean, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezMerger.Segment
 
TezRawKeyValueIterator - Interface in org.apache.tez.runtime.library.common.sort.impl
TezRawKeyValueIterator is an iterator used to iterate over the raw keys and values during sort/merge of intermediate data.
TezRuntimeConfiguration - Class in org.apache.tez.runtime.library.api
Meant for user configurable job properties.
TezRuntimeConfiguration() - Constructor for class org.apache.tez.runtime.library.api.TezRuntimeConfiguration
 
TezRuntimeFrameworkConfigs - Class in org.apache.tez.common
Configuration parameters which are internal to the Inputs and Outputs which exist in the Runtime
TezRuntimeFrameworkConfigs() - Constructor for class org.apache.tez.common.TezRuntimeFrameworkConfigs
 
TezRuntimeUtils - Class in org.apache.tez.runtime.library.common
 
TezRuntimeUtils() - Constructor for class org.apache.tez.runtime.library.common.TezRuntimeUtils
 
TezSpillRecord - Class in org.apache.tez.runtime.library.common.sort.impl
 
TezSpillRecord(int) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
 
TezSpillRecord(Path, Configuration) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
 
TezSpillRecord(Path, Configuration, String) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
 
TezSpillRecord(Path, Configuration, Checksum, String) - Constructor for class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
 
TezTaskOutput - Class in org.apache.tez.runtime.library.common.task.local.output
Manipulate the working area for the transient store for components in tez-runtime-library This class is used by Inputs and Outputs in tez-runtime-library to identify the directories that they need to write to / read from for intermediate files.
TezTaskOutput(Configuration, String) - Constructor for class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
 
TezTaskOutputFiles - Class in org.apache.tez.runtime.library.common.task.local.output
Manipulate the working area for the transient store for components in tez-runtime-library This class is used by Inputs and Outputs in tez-runtime-library to identify the directories that they need to write to / read from for intermediate files.
TezTaskOutputFiles(Configuration, String) - Constructor for class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutputFiles
 
toBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
toBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
toBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
toBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
toBuilder() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
toDetailedString() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
toHex(byte[]) - Static method in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
byte array to Hex String
toString() - Method in class org.apache.tez.runtime.library.common.InputAttemptIdentifier
 
toString() - Method in class org.apache.tez.runtime.library.common.InputIdentifier
 
toString() - Method in class org.apache.tez.runtime.library.common.shuffle.DiskFetchedInput
 
toString() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection.HttpConnectionParams
 
toString() - Method in class org.apache.tez.runtime.library.common.shuffle.InputHost
 
toString() - Method in class org.apache.tez.runtime.library.common.shuffle.LocalDiskFetchedInput
 
toString() - Method in class org.apache.tez.runtime.library.common.shuffle.MemoryFetchedInput
 
toUserPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig
Get a UserPayload representation of the Configuration
toUserPayload() - Method in class org.apache.tez.runtime.library.conf.OrderedPartitionedKVOutputConfig
Get a UserPayload representation of the Configuration
toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVInputConfig
Get a UserPayload representation of the Configuration
toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedKVOutputConfig
Get a UserPayload representation of the Configuration
toUserPayload() - Method in class org.apache.tez.runtime.library.conf.UnorderedPartitionedKVOutputConfig
Get a UserPayload representation of the Configuration
toUserPayload() - Method in class org.apache.tez.runtime.library.processor.SleepProcessor.SleepProcessorConfig
 
type - Variable in class org.apache.tez.runtime.library.common.shuffle.FetchedInput
 

U

uniqueId - Variable in class org.apache.tez.runtime.library.common.task.local.output.TezTaskOutput
 
UnorderedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf
Configure payloads for the UnorderedKVOutput and UnorderedKVInput pair
UnorderedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVInput - Class in org.apache.tez.runtime.library.input
UnorderedKVInput provides unordered key value input by bringing together (shuffling) a set of distributed data and providing a unified view to that data.
UnorderedKVInput(InputContext, int) - Constructor for class org.apache.tez.runtime.library.input.UnorderedKVInput
 
UnorderedKVInputConfig - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVInputConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVInputConfig.SpecificBuilder<E extends HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVInputConfig.SpecificConfigBuilder<T> - Interface in org.apache.tez.runtime.library.conf
Configure parameters which are specific to the Input.
UnorderedKVOutput - Class in org.apache.tez.runtime.library.output
UnorderedKVOutput is a LogicalOutput that writes key value data without applying any ordering or grouping constraints.
UnorderedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.UnorderedKVOutput
 
UnorderedKVOutputConfig - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVOutputConfig.SpecificBuilder<E extends HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf
 
UnorderedKVOutputConfig.SpecificConfigBuilder<T> - Interface in org.apache.tez.runtime.library.conf
Configure parameters which are specific to the Output.
UnorderedKVReader<K,V> - Class in org.apache.tez.runtime.library.common.readers
 
UnorderedKVReader(ShuffleManager, Configuration, CompressionCodec, boolean, int, int, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.readers.UnorderedKVReader
 
UnorderedPartitionedKVEdgeConfig - Class in org.apache.tez.runtime.library.conf
Configure payloads for the UnorderedPartitionedKVOutput and UnorderedKVInput pair
UnorderedPartitionedKVEdgeConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
UnorderedPartitionedKVOutput - Class in org.apache.tez.runtime.library.output
UnorderedPartitionedKVOutput is a LogicalOutput which can be used to write Key-Value pairs.
UnorderedPartitionedKVOutput(OutputContext, int) - Constructor for class org.apache.tez.runtime.library.output.UnorderedPartitionedKVOutput
 
UnorderedPartitionedKVOutputConfig - Class in org.apache.tez.runtime.library.conf
 
UnorderedPartitionedKVOutputConfig.Builder - Class in org.apache.tez.runtime.library.conf
 
UnorderedPartitionedKVOutputConfig.SpecificBuilder<E extends HadoopKeyValuesBasedBaseEdgeConfig.Builder> - Class in org.apache.tez.runtime.library.conf
 
UnorderedPartitionedKVOutputConfig.SpecificConfigBuilder<T> - Interface in org.apache.tez.runtime.library.conf
Configure parameters which are specific to the Output.
UnorderedPartitionedKVWriter - Class in org.apache.tez.runtime.library.common.writers
 
UnorderedPartitionedKVWriter(OutputContext, Configuration, int, long) - Constructor for class org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter
 
updateCountersForExternalAppend(long) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
updateEventReceivedTime() - Method in class org.apache.tez.runtime.library.common.shuffle.impl.ShuffleManager
 
useLegacyInput() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.Builder
 
useLegacyInput() - Method in class org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificBuilder
 
useLegacyInput() - Method in interface org.apache.tez.runtime.library.conf.OrderedGroupedKVInputConfig.SpecificConfigBuilder
Specifies whether the legacy version of this input should be used.
useNewApi(Configuration) - Static method in class org.apache.tez.runtime.library.common.ConfigUtils
 

V

V_END_MARKER - Static variable in class org.apache.tez.runtime.library.common.sort.impl.IFile
 
valClass - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
valClass - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
validate() - Method in class org.apache.tez.runtime.library.common.shuffle.HttpConnection
 
validateUpdateReceived() - Method in class org.apache.tez.runtime.library.common.MemoryUpdateCallbackHandler
 
VALLEN - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
valSerializer - Variable in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
valSerializer - Variable in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
VALSTART - Static variable in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
valueOf(String) - Static method in enum org.apache.tez.runtime.library.common.shuffle.FetchedInput.State
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.tez.runtime.library.common.shuffle.FetchedInput.Type
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.tez.runtime.library.common.sort.impl.IFile.Reader.KeyState
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor.RequestType
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.tez.runtime.library.common.shuffle.FetchedInput.State
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.tez.runtime.library.common.shuffle.FetchedInput.Type
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.tez.runtime.library.common.sort.impl.IFile.Reader.KeyState
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor.RequestType
Returns an array containing the constants of this enum type, in the order they are declared.
ValuesIterator<KEY,VALUE> - Class in org.apache.tez.runtime.library.common
Iterates values while keys match in sorted input.
ValuesIterator(TezRawKeyValueIterator, RawComparator<KEY>, Class<KEY>, Class<VALUE>, Configuration, TezCounter, TezCounter) - Constructor for class org.apache.tez.runtime.library.common.ValuesIterator
 
verifyReply(String, String, JobTokenSecretManager) - Static method in class org.apache.tez.runtime.library.common.security.SecureShuffleUtils
verify that base64Hash is same as HMacHash(msg)
vIter - Variable in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
 

W

waitForInMemoryMerge() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
waitForInput() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.Shuffle
Waits for the Shuffle and Merge to complete, and returns an iterator over the input.
waitForInputReady() - Method in class org.apache.tez.runtime.library.input.OrderedGroupedKVInput
Waits for the input to become ready for consumption
waitForShuffleToMergeMemory() - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.MergeManager
 
WeightedScalingMemoryDistributor - Class in org.apache.tez.runtime.library.resources
Distributes memory between various requesting components by applying a weighted scaling function.
WeightedScalingMemoryDistributor() - Constructor for class org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor
 
WeightedScalingMemoryDistributor.RequestType - Enum in org.apache.tez.runtime.library.resources
 
write(Object, Iterable<Object>) - Method in class org.apache.tez.runtime.library.api.KeyValuesWriter
Writes a key and its associated values
write(Object, Object) - Method in class org.apache.tez.runtime.library.api.KeyValueWriter
Writes a key/value pair.
write(Object, Object) - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
write(Object, Iterable<Object>) - Method in class org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter
 
write(DataOutput) - Method in class org.apache.tez.runtime.library.common.shuffle.orderedgrouped.ShuffleHeader
 
write(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.Buffer
 
write(byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.Buffer
Attempt to write a sequence of bytes to the collection buffer.
write(Object, Object) - Method in class org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter
 
write(Object, Object) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
write(Object, Iterable<Object>) - Method in class org.apache.tez.runtime.library.common.sort.impl.ExternalSorter
 
write(byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileOutputStream
Write bytes to the stream.
write(int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFileOutputStream
 
write(Object, Object) - Method in class org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter
 
write(Object, Object) - Method in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
write(Object, Iterable<Object>) - Method in class org.apache.tez.runtime.library.common.writers.BaseUnorderedPartitionedKVWriter
 
write(Object, Object) - Method in class org.apache.tez.runtime.library.common.writers.UnorderedPartitionedKVWriter
 
writeFile(TezRawKeyValueIterator, IFile.Writer, Progressable, long) - Static method in class org.apache.tez.runtime.library.common.sort.impl.TezMerger
 
writeHeader(OutputStream) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
writeKVPair(byte[], int, int, byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
writeReplace() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
writeReplace() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
writeReplace() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
writeReplace() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
writeReplace() - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
writeRLE(DataOutputStream) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
writeTo(CodedOutputStream) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataMovementEventPayloadProto
 
writeTo(CodedOutputStream) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.DataProto
 
writeTo(CodedOutputStream) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.InputInformationEventPayloadProto
 
writeTo(CodedOutputStream) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.ShuffleEdgeManagerConfigPayloadProto
 
writeTo(CodedOutputStream) - Method in class org.apache.tez.runtime.library.shuffle.impl.ShuffleUserPayloads.VertexManagerEventPayloadProto
 
writeToFile(Path, Configuration) - Method in class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
Write this spill record to the location provided.
writeToFile(Path, Configuration, Checksum) - Method in class org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord
 
writeValue(byte[], int, int) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
writeValueMarker(DataOutputStream) - Method in class org.apache.tez.runtime.library.common.sort.impl.IFile.Writer
 
A B C D E F G H I K L M N O P R S T U V W 

Copyright © 2015 Apache Software Foundation. All rights reserved.