Modifier and Type | Method and Description |
---|---|
KeySelector<T,K> |
Keys.SelectorFunctionKeys.getKeyExtractor() |
Constructor and Description |
---|
SelectorFunctionKeys(KeySelector<T,K> keyExtractor,
TypeInformation<T> inputType,
TypeInformation<K> keyType) |
Modifier and Type | Method and Description |
---|---|
<K> DistinctOperator<T> |
DataSet.distinct(KeySelector<T,K> keyExtractor)
Returns a distinct set of a
DataSet using a KeySelector function. |
<K> UnsortedGrouping<T> |
DataSet.groupBy(KeySelector<T,K> keyExtractor)
Groups a
DataSet using a KeySelector function. |
<K extends Comparable<K>> |
DataSet.partitionByHash(KeySelector<T,K> keyExtractor)
Partitions a DataSet using the specified KeySelector.
|
<K extends Comparable<K>> |
DataSet.partitionByRange(KeySelector<T,K> keyExtractor)
Range-partitions a DataSet using the specified KeySelector.
|
<K extends Comparable<K>> |
DataSet.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keyExtractor)
Partitions a DataSet on the key returned by the selector, using a custom partitioner.
|
<K> SortPartitionOperator<T> |
DataSet.sortPartition(KeySelector<T,K> keyExtractor,
Order order)
Locally sorts the partitions of the DataSet on the extracted key in the specified order.
|
Modifier and Type | Class and Description |
---|---|
class |
NullByteKeySelector<T>
Used as a dummy
KeySelector to allow using keyed operators
for non-keyed usecases. |
Modifier and Type | Method and Description |
---|---|
<K> JoinOperator.DefaultJoin<I1,I2> |
JoinOperator.JoinOperatorSets.JoinOperatorSetsPredicate.equalTo(KeySelector<I2,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the second join DataSet .The KeySelector function is called for each element of the second DataSet and extracts a single key value on which the DataSet is joined. |
<K> CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.CoGroupOperatorWithoutFunction |
CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate.equalTo(KeySelector<I2,K> keyExtractor)
Continues a CoGroup transformation and defines a
KeySelector function for the second co-grouped DataSet .The KeySelector function is called for each element of the second DataSet and extracts a single key value on which the DataSet is grouped. |
<K> SortedGrouping<T> |
UnsortedGrouping.sortGroup(KeySelector<T,K> keySelector,
Order order)
Sorts elements within a group on a key extracted by the specified
KeySelector
in the specified Order .Chaining UnsortedGrouping.sortGroup(KeySelector, Order) calls is not supported. |
<K> SortPartitionOperator<T> |
SortPartitionOperator.sortPartition(KeySelector<T,K> keyExtractor,
Order order) |
<K> JoinOperator.JoinOperatorSets.JoinOperatorSetsPredicate |
JoinOperator.JoinOperatorSets.where(KeySelector<I1,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the first join DataSet .The KeySelector function is called for each element of the first DataSet and extracts a single key value on which the DataSet is joined. |
<K> CoGroupOperator.CoGroupOperatorSets.CoGroupOperatorSetsPredicate |
CoGroupOperator.CoGroupOperatorSets.where(KeySelector<I1,K> keyExtractor)
Continues a CoGroup transformation and defines a
KeySelector function for the first co-grouped DataSet .The KeySelector function is called for each element of the first DataSet and extracts a single key value on which the DataSet is grouped. |
Modifier and Type | Method and Description |
---|---|
<K> JoinFunctionAssigner<I1,I2> |
JoinOperatorSetsBase.JoinOperatorSetsPredicateBase.equalTo(KeySelector<I2,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the second join DataSet .The KeySelector function is called for each element of the second DataSet and extracts a single key value on which the DataSet is joined. |
<K> JoinOperatorSetsBase.JoinOperatorSetsPredicateBase |
JoinOperatorSetsBase.where(KeySelector<I1,K> keySelector)
Continues a Join transformation and defines a
KeySelector function for the first join DataSet .The KeySelector function is called for each element of the first DataSet and extracts a single key value on which the DataSet is joined. |
Constructor and Description |
---|
KeyExtractingMapper(KeySelector<T,K> keySelector) |
TwoKeyExtractingMapper(KeySelector<T,K1> keySelector1,
KeySelector<T,K2> keySelector2) |
TwoKeyExtractingMapper(KeySelector<T,K1> keySelector1,
KeySelector<T,K2> keySelector2) |
Modifier and Type | Method and Description |
---|---|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getKeySelectorTypes(KeySelector<IN,OUT> selectorInterface,
TypeInformation<IN> inType) |
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getKeySelectorTypes(KeySelector<IN,OUT> selectorInterface,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing) |
Modifier and Type | Method and Description |
---|---|
static <T,K extends Comparable<K>> |
DataSetUtils.partitionByRange(DataSet<T> input,
DataDistribution distribution,
KeySelector<T,K> keyExtractor)
Range-partitions a DataSet using the specified key selector function.
|
Modifier and Type | Method and Description |
---|---|
KeySelector<T,KEY> |
KeyedStream.getKeySelector()
Gets the key selector that can get the key by which the stream if partitioned from the elements.
|
Modifier and Type | Method and Description |
---|---|
JoinedStreams.Where.EqualTo |
JoinedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector)
Specifies a
KeySelector for elements from the second input. |
CoGroupedStreams.Where.EqualTo |
CoGroupedStreams.Where.equalTo(KeySelector<T2,KEY> keySelector)
Specifies a
KeySelector for elements from the second input. |
ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,?> keySelector1,
KeySelector<F,?> keySelector2) |
ConnectedStreams<I,F> |
IterativeStream.ConnectedIterativeStreams.keyBy(KeySelector<I,?> keySelector1,
KeySelector<F,?> keySelector2) |
ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,?> keySelector1,
KeySelector<IN2,?> keySelector2)
KeyBy operation for connected data stream.
|
ConnectedStreams<IN1,IN2> |
ConnectedStreams.keyBy(KeySelector<IN1,?> keySelector1,
KeySelector<IN2,?> keySelector2)
KeyBy operation for connected data stream.
|
<K> KeyedStream<T,K> |
DataStream.keyBy(KeySelector<T,K> key)
It creates a new
KeyedStream that uses the provided key for partitioning
its operator states. |
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keySelector)
Partitions a DataStream on the key returned by the selector, using a custom partitioner.
|
<KEY> JoinedStreams.Where<KEY> |
JoinedStreams.where(KeySelector<T1,KEY> keySelector)
Specifies a
KeySelector for elements from the first input. |
<KEY> CoGroupedStreams.Where<KEY> |
CoGroupedStreams.where(KeySelector<T1,KEY> keySelector)
Specifies a
KeySelector for elements from the first input. |
Modifier and Type | Method and Description |
---|---|
KeySelector<?,Serializable> |
StreamConfig.getStatePartitioner(int input,
ClassLoader cl) |
KeySelector<?,?> |
StreamNode.getStatePartitioner1() |
KeySelector<?,?> |
StreamNode.getStatePartitioner2() |
Modifier and Type | Method and Description |
---|---|
void |
StreamGraph.setOneInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector,
TypeSerializer<?> keySerializer) |
void |
StreamConfig.setStatePartitioner(int input,
KeySelector<?,?> partitioner) |
void |
StreamNode.setStatePartitioner1(KeySelector<?,?> statePartitioner) |
void |
StreamNode.setStatePartitioner2(KeySelector<?,?> statePartitioner) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
Modifier and Type | Class and Description |
---|---|
class |
KeySelectorWithType<IN,K> |
Constructor and Description |
---|
EqualTo(KeySelector<T2,KEY> keySelector2) |
EqualTo(KeySelector<T2,KEY> keySelector2) |
Where(KeySelector<T1,KEY> keySelector1,
TypeInformation<KEY> keyType) |
Where(KeySelector<T1,KEY> keySelector1,
TypeInformation<KEY> keyType) |
Modifier and Type | Method and Description |
---|---|
KeySelector<T,?> |
SinkTransformation.getStateKeySelector()
Returns the
KeySelector that must be used for partitioning keyed state in this
Sink. |
KeySelector<IN,?> |
OneInputTransformation.getStateKeySelector()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation. |
KeySelector<IN1,?> |
TwoInputTransformation.getStateKeySelector1()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation for the first input. |
KeySelector<IN2,?> |
TwoInputTransformation.getStateKeySelector2()
Returns the
KeySelector that must be used for partitioning keyed state in this
Operation for the second input. |
Modifier and Type | Method and Description |
---|---|
void |
OneInputTransformation.setStateKeySelector(KeySelector<IN,?> stateKeySelector)
Sets the
KeySelector that must be used for partitioning keyed state of this operation. |
void |
SinkTransformation.setStateKeySelector(KeySelector<T,?> stateKeySelector)
Sets the
KeySelector that must be used for partitioning keyed state of this Sink. |
void |
TwoInputTransformation.setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1,
KeySelector<IN2,?> stateKeySelector2)
Sets the
KeySelectors that must be used for partitioning keyed state of
this transformation. |
void |
TwoInputTransformation.setStateKeySelectors(KeySelector<IN1,?> stateKeySelector1,
KeySelector<IN2,?> stateKeySelector2)
Sets the
KeySelectors that must be used for partitioning keyed state of
this transformation. |
Modifier and Type | Class and Description |
---|---|
static class |
GroupedProcessingTimeWindowExample.FirstFieldKeyExtractor<Type extends Tuple,Key> |
Modifier and Type | Method and Description |
---|---|
KeySelector<IN,K> |
WindowOperator.getKeySelector() |
Modifier and Type | Method and Description |
---|---|
protected AggregatingKeyedTimePanes<IN,KEY> |
AggregatingProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function)
Deprecated.
|
protected AccumulatingKeyedTimePanes<IN,KEY,OUT> |
AccumulatingProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function)
Deprecated.
|
protected abstract AbstractKeyedTimePanes<IN,KEY,STATE,OUT> |
AbstractAlignedProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function)
Deprecated.
|
Constructor and Description |
---|
AbstractAlignedProcessingTimeWindowOperator(F function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<STATE> stateTypeSerializer,
long windowLength,
long windowSlide)
Deprecated.
|
AccumulatingKeyedTimePanes(KeySelector<Type,Key> keySelector,
InternalWindowFunction<Iterable<Type>,Result,Key,Window> function) |
AccumulatingProcessingTimeWindowOperator(InternalWindowFunction<Iterable<IN>,OUT,KEY,TimeWindow> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> valueSerializer,
long windowLength,
long windowSlide)
Deprecated.
|
AggregatingKeyedTimePanes(KeySelector<Type,Key> keySelector,
ReduceFunction<Type> reducer) |
AggregatingProcessingTimeWindowOperator(ReduceFunction<IN> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> aggregateSerializer,
long windowLength,
long windowSlide)
Deprecated.
|
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness,
OutputTag<IN> lateDataOutputTag) |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness,
OutputTag<IN> lateDataOutputTag)
Creates a new
WindowOperator based on the given policies and user functions. |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness,
OutputTag<IN> lateDataOutputTag,
LegacyWindowOperatorType legacyWindowOperatorType)
Creates a new
WindowOperator based on the given policies and user functions. |
Constructor and Description |
---|
CustomPartitionerWrapper(Partitioner<K> partitioner,
KeySelector<T,K> keySelector) |
KeyGroupStreamPartitioner(KeySelector<T,K> keySelector,
int maxParallelism) |
Modifier and Type | Class and Description |
---|---|
static class |
KeySelectorUtil.ArrayKeySelector<IN>
A key selector for selecting individual array fields as keys and returns them as a Tuple.
|
static class |
KeySelectorUtil.ComparableKeySelector<IN>
A key selector for selecting key fields via a TypeComparator.
|
static class |
KeySelectorUtil.OneKeySelector<IN,K>
Key extractor that extracts a single field via a generic comparator.
|
Modifier and Type | Method and Description |
---|---|
static <X> KeySelector<X,Tuple> |
KeySelectorUtil.getSelectorForKeys(Keys<X> keys,
TypeInformation<X> typeInfo,
ExecutionConfig executionConfig) |
static <X,K> KeySelector<X,K> |
KeySelectorUtil.getSelectorForOneKey(Keys<X> keys,
Partitioner<K> partitioner,
TypeInformation<X> typeInfo,
ExecutionConfig executionConfig) |
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.