I1
- The type of the first input DataSet of the Cross transformation.I2
- The type of the second input DataSet of the Cross transformation.@Public public static final class CrossOperator.DefaultCross<I1,I2> extends CrossOperator<I1,I2,Tuple2<I1,I2>>
CrossOperator.CrossProjection<I1,I2>, CrossOperator.DefaultCross<I1,I2>, CrossOperator.DefaultCrossFunction<T1,T2>, CrossOperator.ProjectCross<I1,I2,OUT extends Tuple>, CrossOperator.ProjectCrossFunction<T1,T2,R extends Tuple>
name, parallelism
Constructor and Description |
---|
DefaultCross(DataSet<I1> input1,
DataSet<I2> input2,
CrossOperatorBase.CrossHint hint,
String defaultName) |
Modifier and Type | Method and Description |
---|---|
<OUT extends Tuple> |
projectFirst(int... firstFieldIndexes)
|
<OUT extends Tuple> |
projectSecond(int... secondFieldIndexes)
|
<R> CrossOperator<I1,I2,R> |
with(CrossFunction<I1,I2,R> function)
Finalizes a Cross transformation by applying a
CrossFunction to each pair of crossed elements.Each CrossFunction call returns exactly one element. |
getCrossHint, getFunction, translateToDataFlow
extractSemanticAnnotationsFromUdf, getAnalyzedUdfSemanticsFlag, getBroadcastSets, getParameters, getSemanticProperties, returns, returns, returns, returns, setAnalyzedUdfSemanticsFlag, setSemanticProperties, udfWithForwardedFieldsFirstAnnotation, udfWithForwardedFieldsSecondAnnotation, withBroadcastSet, withForwardedFieldsFirst, withForwardedFieldsSecond, withParameters
getInput1, getInput1Type, getInput2, getInput2Type
getName, getParallelism, getResultType, name, setParallelism
aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText
public <R> CrossOperator<I1,I2,R> with(CrossFunction<I1,I2,R> function)
CrossFunction
to each pair of crossed elements.function
- The CrossFunction that is called for each pair of crossed elements.CrossFunction
,
DataSet
public <OUT extends Tuple> CrossOperator.ProjectCross<I1,I2,OUT> projectFirst(int... firstFieldIndexes)
Tuple
DataSet
, fields can be selected by their index.
If the first cross input is not a Tuple DataSet, no parameters should be passed.CrossOperator.ProjectCross.projectFirst(int...)
and
CrossOperator.ProjectCross.projectSecond(int...)
.
Note: With the current implementation, the Project transformation looses type information.firstFieldIndexes
- If the first input is a Tuple DataSet, the indexes of the selected fields.
For a non-Tuple DataSet, do not provide parameters.
The order of fields in the output tuple is defined by to the order of field indexes.Tuple
,
DataSet
,
CrossOperator.ProjectCross
public <OUT extends Tuple> CrossOperator.ProjectCross<I1,I2,OUT> projectSecond(int... secondFieldIndexes)
Tuple
DataSet
, fields can be selected by their index.
If the second cross input is not a Tuple DataSet, no parameters should be passed.CrossOperator.ProjectCross.projectFirst(int...)
and
CrossOperator.ProjectCross.projectSecond(int...)
.
Note: With the current implementation, the Project transformation looses type information.secondFieldIndexes
- If the second input is a Tuple DataSet, the indexes of the selected fields.
For a non-Tuple DataSet, do not provide parameters.
The order of fields in the output tuple is defined by to the order of field indexes.Tuple
,
DataSet
,
CrossOperator.ProjectCross
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.