public class PTFOperator extends Operator<PTFDesc> implements java.io.Serializable
Operator.OperatorFunc, Operator.ProgressCounter, Operator.State
Modifier and Type | Field and Description |
---|---|
protected KeyWrapper |
currentKeys |
protected KeyWrapper |
newKeys |
alias, beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, isLogInfoEnabled, LOG, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime
Constructor and Description |
---|
PTFOperator() |
Modifier and Type | Method and Description |
---|---|
protected void |
closeOp(boolean abort)
Operator specific close routine.
|
static void |
connectLeadLagFunctionsToPartition(PTFDesc ptfDesc,
PTFPartition.PTFPartitionIterator<java.lang.Object> pItr) |
PTFPartition |
createFirstPartitionForChain(ObjectInspector oi,
HiveConf hiveConf,
boolean isMapSide)
Create a new Partition.
|
java.lang.String |
getName()
Implements the getName function for the Node Interface.
|
static java.lang.String |
getOperatorName() |
OperatorType |
getType()
Return the type of the specific operator among the
types in OperatorType.
|
protected void |
initializeOp(Configuration jobConf)
Operator specific initialization.
|
protected void |
processInputPartition() |
protected void |
processMapFunction() |
void |
processOp(java.lang.Object row,
int tag)
Process the row.
|
protected void |
reconstructQueryDef(HiveConf hiveConf)
Initialize the visitor to use the QueryDefDeserializer Use the order
defined in QueryDefWalker to visit the QueryDef
|
protected void |
setupKeysWrapper(ObjectInspector inputOI) |
acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, assignCounterNameToEnum, augmentPlan, checkFatalErrors, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, close, columnNamesRowResolvedCanBeObtained, dump, dump, endGroup, fatalErrorMessage, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getCounterNames, getCounterNameToEnum, getCounters, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getParentOperators, getSchema, getStats, getWrappedCounterName, incrCounter, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeCounters, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, process, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetLastEnumUsed, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setCounterNames, setCounterNameToEnum, setDone, setExecContext, setGroupKeyObject, setId, setInputObjInspectors, setOperatorId, setOutputCollector, setParentOperators, setReporter, setSchema, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString, updateCounters
protected transient KeyWrapper currentKeys
protected transient KeyWrapper newKeys
protected void initializeOp(Configuration jobConf) throws HiveException
Operator
initializeOp
in class Operator<PTFDesc>
HiveException
protected void closeOp(boolean abort) throws HiveException
Operator
closeOp
in class Operator<PTFDesc>
HiveException
public void processOp(java.lang.Object row, int tag) throws HiveException
Operator
processOp
in class Operator<PTFDesc>
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.HiveException
protected void reconstructQueryDef(HiveConf hiveConf) throws HiveException
hiveConf
- HiveException
protected void setupKeysWrapper(ObjectInspector inputOI) throws HiveException
HiveException
protected void processInputPartition() throws HiveException
HiveException
protected void processMapFunction() throws HiveException
HiveException
public java.lang.String getName()
Operator
public static java.lang.String getOperatorName()
public OperatorType getType()
Operator
public PTFPartition createFirstPartitionForChain(ObjectInspector oi, HiveConf hiveConf, boolean isMapSide) throws HiveException
The Partition we want to create here is for feeding the First table function in the chain. So for map-side processing use the Serde from the output Shape its InputDef. For reduce-side processing use the Serde from its RawInputShape(the shape after map-side processing).
oi
- hiveConf
- isMapSide
- HiveException
public static void connectLeadLagFunctionsToPartition(PTFDesc ptfDesc, PTFPartition.PTFPartitionIterator<java.lang.Object> pItr) throws HiveException
HiveException
Copyright © 2012 The Apache Software Foundation