Modifier and Type | Method and Description |
---|---|
KeySelector<T,K> |
Keys.SelectorFunctionKeys.getKeyExtractor() |
Constructor and Description |
---|
SelectorFunctionKeys(KeySelector<T,K> keyExtractor,
TypeInformation<T> inputType,
TypeInformation<K> keyType) |
Modifier and Type | Method and Description |
---|---|
<K> DistinctOperator<T> |
DataSet.distinct(KeySelector<T,K> keyExtractor)
Returns a distinct set of a
DataSet using a KeySelector function. |
<K> UnsortedGrouping<T> |
DataSet.groupBy(KeySelector<T,K> keyExtractor)
Groups a
DataSet using a KeySelector function. |
<K extends Comparable<K>> |
DataSet.partitionByHash(KeySelector<T,K> keyExtractor)
Partitions a DataSet using the specified KeySelector.
|
<K extends Comparable<K>> |
DataSet.partitionByRange(KeySelector<T,K> keyExtractor)
Range-partitions a DataSet using the specified KeySelector.
|
<K extends Comparable<K>> |
DataSet.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keyExtractor)
Partitions a DataSet on the key returned by the selector, using a custom partitioner.
|
<K> SortPartitionOperator<T> |
DataSet.sortPartition(KeySelector<T,K> keyExtractor,
Order order)
Locally sorts the partitions of the DataSet on the extracted key in the specified order.
|
Modifier and Type | Class and Description |
---|---|
class |
NullByteKeySelector<T>
Used as a dummy
KeySelector to allow using keyed operators
for non-keyed use cases. |
Modifier and Type | Method and Description |
---|---|
<K> CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.CoGroupOperatorWithoutFunction |
CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.equalTo(KeySelector<I2,K> keyExtractor)
Continues a CoGroup transformation and defines a
KeySelector function for the second co-grouped DataSet . |
<K> JoinOperator.DefaultJoin<I1,I2> |
JoinOperator.JoinOperatorSets.JoinOperatorSetsPredicate.equalTo(KeySelector<I2,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the second join DataSet . |
<K> SortedGrouping<T> |
UnsortedGrouping.sortGroup(KeySelector<T,K> keySelector,
Order order)
Sorts elements within a group on a key extracted by the specified
KeySelector
in the specified Order . |
<K> SortPartitionOperator<T> |
SortPartitionOperator.sortPartition(KeySelector<T,K> keyExtractor,
Order order) |
<K> CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate |
CoGroupOperator.CoGroupOperatorSets.where(KeySelector<I1,K> keyExtractor)
Continues a CoGroup transformation and defines a
KeySelector function for the first co-grouped DataSet . |
<K> JoinOperator.JoinOperatorSets.JoinOperatorSetsPredicate |
JoinOperator.JoinOperatorSets.where(KeySelector<I1,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the first join DataSet . |
Modifier and Type | Method and Description |
---|---|
<K> JoinFunctionAssigner<I1,I2> |
JoinOperatorSetsBase.JoinOperatorSetsPredicateBase.equalTo(KeySelector<I2,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the second join DataSet . |
<K> JoinOperatorSetsBase.JoinOperatorSetsPredicateBase |
JoinOperatorSetsBase.where(KeySelector<I1,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the first join DataSet . |
Constructor and Description |
---|
KeyExtractingMapper(KeySelector<T,K> keySelector) |
TwoKeyExtractingMapper(KeySelector<T,K1> keySelector1,
KeySelector<T,K2> keySelector2) |
TwoKeyExtractingMapper(KeySelector<T,K1> keySelector1,
KeySelector<T,K2> keySelector2) |
Modifier and Type | Method and Description |
---|---|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getKeySelectorTypes(KeySelector<IN,OUT> selectorInterface,
TypeInformation<IN> inType) |
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getKeySelectorTypes(KeySelector<IN,OUT> selectorInterface,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing) |
Modifier and Type | Method and Description |
---|---|
static <T,K extends Comparable<K>> |
DataSetUtils.partitionByRange(DataSet<T> input,
DataDistribution distribution,
KeySelector<T,K> keyExtractor)
Range-partitions a DataSet using the specified key selector function.
|
Modifier and Type | Method and Description |
---|---|
<K> KeyedOperatorTransformation<K,T> |
OneInputOperatorTransformation.keyBy(KeySelector<T,K> keySelector)
It creates a new
KeyedOperatorTransformation that uses the provided key for partitioning its operator
states. |
<K> KeyedOperatorTransformation<K,T> |
OneInputOperatorTransformation.keyBy(KeySelector<T,K> keySelector,
TypeInformation<K> keyType)
It creates a new
KeyedOperatorTransformation that uses the provided key with explicit type
information for partitioning its operator states. |
Modifier and Type | Class and Description |
---|---|
class |
HashSelector<IN>
A wrapper around a
KeySelector that returns the Object.hashCode() of the returned
key. |
Constructor and Description |
---|
HashSelector(KeySelector<IN,?> keySelector) |
Constructor and Description |
---|
BoundedStreamConfig(TypeSerializer<?> keySerializer,
KeySelector<IN,?> keySelector) |
Modifier and Type | Method and Description |
---|---|
KeySelector<T,KEY> |
KeyedStream.getKeySelector()
Gets the key selector that can get the key by which the stream if partitioned from the elements.
|
Modifier and Type | Method and Description |
---|---|
CoGroupedStreams.Where.EqualTo |
CoGroupedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector)
Specifies a
KeySelector for elements from the second input. |
JoinedStreams.Where.EqualTo |
JoinedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector)
Specifies a
KeySelector for elements from the second input. |
CoGroupedStreams.Where.EqualTo |
CoGroupedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector,
TypeInformation<KEY> keyType)
Specifies a
KeySelector for elements from the second input with explicit type information for the key type. |
JoinedStreams.Where.EqualTo |
JoinedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector,
TypeInformation<KEY> keyType)
Specifies a
KeySelector for elements from the second input with explicit type information for the key type. |
ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,?> keySelector1,
KeySelector<F,?> keySelector2) |
ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,?> keySelector1,
KeySelector<F,?> keySelector2) |
<KEY> ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,KEY> keySelector1,
KeySelector<F,KEY> keySelector2,
TypeInformation<KEY> keyType) |
<KEY> ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,KEY> keySelector1,
KeySelector<F,KEY> keySelector2,
TypeInformation<KEY> keyType) |
ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,?> keySelector1,
KeySelector<IN2,?> keySelector2)
KeyBy operation for connected data stream.
|
ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,?> keySelector1,
KeySelector<IN2,?> keySelector2)
KeyBy operation for connected data stream.
|
<KEY> ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,KEY> keySelector1,
KeySelector<IN2,KEY> keySelector2,
TypeInformation<KEY> keyType)
KeyBy operation for connected data stream.
|
<KEY> ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,KEY> keySelector1,
KeySelector<IN2,KEY> keySelector2,
TypeInformation<KEY> keyType)
KeyBy operation for connected data stream.
|
<K> KeyedStream<T,K> |
DataStream.keyBy(KeySelector<T,K> key)
It creates a new
KeyedStream that uses the provided key for partitioning
its operator states. |
<K> KeyedStream<T,K> |
DataStream.keyBy(KeySelector<T,K> key,
TypeInformation<K> keyType)
It creates a new
KeyedStream that uses the provided key with explicit type information
for partitioning its operator states. |
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keySelector)
Partitions a DataStream on the key returned by the selector, using a custom partitioner.
|
static <T,K> KeyedStream<T,K> |
DataStreamUtils.reinterpretAsKeyedStream(DataStream<T> stream,
KeySelector<T,K> keySelector)
|
static <T,K> KeyedStream<T,K> |
DataStreamUtils.reinterpretAsKeyedStream(DataStream<T> stream,
KeySelector<T,K> keySelector,
TypeInformation<K> typeInfo)
|
<KEY> CoGroupedStreams.Where<KEY> |
CoGroupedStreams.where(KeySelector<T1,KEY> keySelector)
Specifies a
KeySelector for elements from the first input. |
<KEY> JoinedStreams.Where<KEY> |
JoinedStreams.where(KeySelector<T1,KEY> keySelector)
Specifies a
KeySelector for elements from the first input. |
<KEY> CoGroupedStreams.Where<KEY> |
CoGroupedStreams.where(KeySelector<T1,KEY> keySelector,
TypeInformation<KEY> keyType)
Specifies a
KeySelector for elements from the first input with explicit type information. |
<KEY> JoinedStreams.Where<KEY> |
JoinedStreams.where(KeySelector<T1,KEY> keySelector,
TypeInformation<KEY> keyType)
Specifies a
KeySelector for elements from the first input with explicit type information for the key type. |
Modifier and Type | Method and Description |
---|---|
KeySelector<?,Serializable> |
StreamConfig.getStatePartitioner(int input,
ClassLoader cl) |
KeySelector<?,?> |
StreamNode.getStatePartitioner1() |
KeySelector<?,?> |
StreamNode.getStatePartitioner2() |
Modifier and Type | Method and Description |
---|---|
void |
StreamGraph.setOneInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector,
TypeSerializer<?> keySerializer) |
void |
StreamConfig.setStatePartitioner(int input,
KeySelector<?,?> partitioner) |
void |
StreamNode.setStatePartitioner1(KeySelector<?,?> statePartitioner) |
void |
StreamNode.setStatePartitioner2(KeySelector<?,?> statePartitioner) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
Modifier and Type | Method and Description |
---|---|
KeySelector<IN,?> |
OneInputTransformation.getStateKeySelector()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation. |
KeySelector<T,?> |
SinkTransformation.getStateKeySelector()
Returns the
KeySelector that must be used for partitioning keyed state in this
Sink. |
KeySelector<IN1,?> |
TwoInputTransformation.getStateKeySelector1()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation for the first input. |
KeySelector<IN2,?> |
TwoInputTransformation.getStateKeySelector2()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation for the second input. |
Modifier and Type | Method and Description |
---|---|
void |
OneInputTransformation.setStateKeySelector(KeySelector<IN,?> stateKeySelector)
Sets the
KeySelector that must be used for partitioning keyed state of this operation. |
void |
SinkTransformation.setStateKeySelector(KeySelector<T,?> stateKeySelector)
Sets the
KeySelector that must be used for partitioning keyed state of this Sink. |
void |
TwoInputTransformation.setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1,
KeySelector<IN2,?> stateKeySelector2)
Sets the
KeySelectors that must be used for partitioning keyed state of
this transformation. |
void |
TwoInputTransformation.setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1,
KeySelector<IN2,?> stateKeySelector2)
Sets the
KeySelectors that must be used for partitioning keyed state of
this transformation. |
Modifier and Type | Method and Description |
---|---|
KeySelector<IN,K> |
WindowOperator.getKeySelector() |
Constructor and Description |
---|
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness,
OutputTag<IN> lateDataOutputTag) |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness,
OutputTag<IN> lateDataOutputTag)
Creates a new
WindowOperator based on the given policies and user functions. |
Constructor and Description |
---|
CustomPartitionerWrapper(Partitioner<K> partitioner,
KeySelector<T,K> keySelector) |
KeyGroupStreamPartitioner(KeySelector<T,K> keySelector,
int maxParallelism) |
Modifier and Type | Class and Description |
---|---|
static class |
KeySelectorUtil.ArrayKeySelector<IN>
A key selector for selecting individual array fields as keys and returns them as a Tuple.
|
static class |
KeySelectorUtil.ComparableKeySelector<IN>
A key selector for selecting key fields via a TypeComparator.
|
static class |
KeySelectorUtil.OneKeySelector<IN,K>
Key extractor that extracts a single field via a generic comparator.
|
Modifier and Type | Method and Description |
---|---|
static <X> KeySelector<X,Tuple> |
KeySelectorUtil.getSelectorForKeys(Keys<X> keys,
TypeInformation<X> typeInfo,
ExecutionConfig executionConfig) |
static <X,K> KeySelector<X,K> |
KeySelectorUtil.getSelectorForOneKey(Keys<X> keys,
Partitioner<K> partitioner,
TypeInformation<X> typeInfo,
ExecutionConfig executionConfig) |
Modifier and Type | Interface and Description |
---|---|
interface |
BaseRowKeySelector
BaseRowKeySelector takes an BaseRow and extracts the deterministic key for the BaseRow.
|
Modifier and Type | Class and Description |
---|---|
class |
BinaryRowKeySelector
A KeySelector which will extract key from BaseRow.
|
class |
NullBinaryRowKeySelector
A utility class which key is always empty no matter what the input row is.
|
Constructor and Description |
---|
MiniBatchIncrementalGroupAggFunction(GeneratedAggsHandleFunction genPartialAggsHandler,
GeneratedAggsHandleFunction genFinalAggsHandler,
KeySelector<BaseRow,BaseRow> finalKeySelector) |
Constructor and Description |
---|
MapBundleOperator(MapBundleFunction<K,V,IN,OUT> function,
BundleTrigger<IN> bundleTrigger,
KeySelector<IN,K> keySelector) |
Modifier and Type | Method and Description |
---|---|
KeySelector<BaseRow,BaseRow> |
JoinInputSideSpec.getUniqueKeySelector()
Returns the
KeySelector to extract unique key from the input row. |
Modifier and Type | Method and Description |
---|---|
static JoinInputSideSpec |
JoinInputSideSpec.withUniqueKey(BaseRowTypeInfo uniqueKeyType,
KeySelector<BaseRow,BaseRow> uniqueKeySelector)
Creates a
JoinInputSideSpec that the input has an unique key. |
static JoinInputSideSpec |
JoinInputSideSpec.withUniqueKeyContainedByJoinKey(BaseRowTypeInfo uniqueKeyType,
KeySelector<BaseRow,BaseRow> uniqueKeySelector)
Creates a
JoinInputSideSpec that input has an unique key and the unique key is
contained by the join key. |
Modifier and Type | Field and Description |
---|---|
protected KeySelector<BaseRow,BaseRow> |
AbstractTopNFunction.sortKeySelector |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.