org.apache.hadoop.hive.ql.optimizer.correlation

Class ReduceSinkDeDuplication

java.lang.Object

org.apache.hadoop.hive.ql.optimizer.correlation.ReduceSinkDeDuplication

All Implemented Interfaces:

Transform

public class ReduceSinkDeDuplication
extends Object
implements Transform

If two reducer sink operators share the same partition/sort columns and order, they can be merged. This should happen after map join optimization because map join optimization will remove reduce sink operators. This optimizer removes/replaces child-RS (not parent) which is safer way for DefaultGraphWalker.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ReduceSinkDeDuplication.AbsctractReducerReducerProc
protected class	ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx

Field Summary

Fields

Modifier and Type	Field and Description
protected ParseContext	pGraphContext

Constructor Summary

Constructors

Constructor and Description
ReduceSinkDeDuplication()

Method Summary

Methods

Modifier and Type	Method and Description
ParseContext	transform(ParseContext pctx) All transformation steps implement this interface.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

pGraphContext

protected ParseContext pGraphContext

Constructor Detail

ReduceSinkDeDuplication

public ReduceSinkDeDuplication()

Method Detail

transform

public ParseContext transform(ParseContext pctx)
                       throws SemanticException

Description copied from interface: Transform

All transformation steps implement this interface.

Specified by:

transform in interface Transform

Parameters:

pctx - input parse context

Returns:

ParseContext

Throws:

SemanticException