Modifier and Type | Method and Description |
---|---|
void |
SerializedListAccumulator.add(T value,
TypeSerializer<T> serializer) |
static <T> List<T> |
SerializedListAccumulator.deserializeList(ArrayList<byte[]> data,
TypeSerializer<T> serializer) |
Constructor and Description |
---|
CopyingIterator(Iterator<E> source,
TypeSerializer<E> serializer) |
CopyingListCollector(List<T> list,
TypeSerializer<T> serializer) |
Constructor and Description |
---|
SimpleListIterable(List<IN> values,
TypeComparator<IN> comparator,
TypeSerializer<IN> serializer) |
SimpleListIterator(List<IN> values,
TypeSerializer<IN> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<BT> |
JoinHashMap.getBuildSerializer() |
Constructor and Description |
---|
JoinHashMap(TypeSerializer<BT> buildSerializer,
TypeComparator<BT> buildComparator) |
ListKeyGroupedIterator(List<E> input,
TypeSerializer<E> serializer,
TypeComparator<E> comparator)
Initializes the ListKeyGroupedIterator..
|
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<T> |
StateDescriptor.serializer
The serializer for the type.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
StateDescriptor.getSerializer()
Returns the
TypeSerializer that can be used to serialize the value in the state. |
Constructor and Description |
---|
FoldingStateDescriptor(String name,
ACC initialValue,
FoldFunction<T,ACC> foldFunction,
TypeSerializer<ACC> typeSerializer)
Creates a new
ValueStateDescriptor with the given name and default value. |
ListStateDescriptor(String name,
TypeSerializer<T> typeSerializer)
Creates a new
ListStateDescriptor with the given name and list element type. |
ReducingStateDescriptor(String name,
ReduceFunction<T> reduceFunction,
TypeSerializer<T> typeSerializer)
Creates a new
ValueStateDescriptor with the given name and default value. |
StateDescriptor(String name,
TypeSerializer<T> serializer,
T defaultValue)
Create a new
StateDescriptor with the given name and the given type serializer. |
ValueStateDescriptor(String name,
TypeSerializer<T> typeSerializer,
T defaultValue)
Creates a new
ValueStateDescriptor with the given name, default value, and the specific
serializer. |
Modifier and Type | Method and Description |
---|---|
abstract TypeSerializer<T> |
TypeInformation.createSerializer(ExecutionConfig config)
Creates a serializer for the type.
|
TypeSerializer<T> |
SqlTimeTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
PrimitiveArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<Nothing> |
NothingTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
BasicTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
BasicArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
Constructor and Description |
---|
BasicTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
FractionalTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
IntegerTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
NumericTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
SqlTimeTypeInfo(Class<T> clazz,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
Modifier and Type | Method and Description |
---|---|
abstract TypeSerializer<T> |
TypeSerializer.duplicate()
Creates a deep copy of this serializer if it is necessary, i.e.
|
TypeSerializer<T> |
TypeSerializerFactory.getSerializer() |
Constructor and Description |
---|
GenericArraySerializer(Class<C> componentClass,
TypeSerializer<C> componentSerializer) |
Modifier and Type | Class and Description |
---|---|
class |
BooleanPrimitiveArraySerializer
A serializer for boolean arrays.
|
class |
BytePrimitiveArraySerializer
A serializer for byte arrays.
|
class |
CharPrimitiveArraySerializer
A serializer for char arrays.
|
class |
DoublePrimitiveArraySerializer
A serializer for double arrays.
|
class |
FloatPrimitiveArraySerializer
A serializer for float arrays.
|
class |
IntPrimitiveArraySerializer
A serializer for int arrays.
|
class |
LongPrimitiveArraySerializer
A serializer for long arrays.
|
class |
ShortPrimitiveArraySerializer
A serializer for short arrays.
|
class |
StringArraySerializer
A serializer for String arrays.
|
Constructor and Description |
---|
CollectHelper(String id,
TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
void |
TypeSerializerOutputFormat.setSerializer(TypeSerializer<T> serializer) |
Constructor and Description |
---|
CollectionInputFormat(Collection<T> dataSet,
TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
WritableTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
ValueTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
PojoTypeInfo.createSerializer(ExecutionConfig config) |
TypeSerializer<T> |
ObjectArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<InvalidTypesException> |
MissingTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
GenericTypeInfo.createSerializer(ExecutionConfig config) |
TypeSerializer<T> |
EnumTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<Either<L,R>> |
EitherTypeInfo.createSerializer(ExecutionConfig config) |
Modifier and Type | Class and Description |
---|---|
class |
AvroSerializer<T>
General purpose serialization.
|
class |
CopyableValueSerializer<T extends CopyableValue<T>> |
class |
EitherSerializer<L,R>
A
TypeSerializer for the type of the Java class. |
class |
PojoSerializer<T> |
class |
Tuple0Serializer |
class |
TupleSerializer<T extends Tuple> |
class |
TupleSerializerBase<T> |
class |
ValueSerializer<T extends Value>
Serializer for
Value types. |
class |
WritableSerializer<T extends org.apache.hadoop.io.Writable> |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<Object>[] |
TupleSerializerBase.fieldSerializers |
protected TypeSerializer[] |
TupleComparatorBase.serializers
serializers to deserialize the first n fields for comparison
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Either<L,R>> |
EitherSerializer.duplicate() |
TypeSerializer<T> |
RuntimeSerializerFactory.getSerializer() |
Modifier and Type | Method and Description |
---|---|
static <T> T |
KryoUtils.copy(T from,
com.esotericsoftware.kryo.Kryo kryo,
TypeSerializer<T> serializer)
Tries to copy the given record from using the provided Kryo instance.
|
static <T> T |
KryoUtils.copy(T from,
T reuse,
com.esotericsoftware.kryo.Kryo kryo,
TypeSerializer<T> serializer)
Tries to copy the given record from using the provided Kryo instance.
|
Constructor and Description |
---|
EitherSerializer(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer) |
EitherSerializer(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer) |
GenericTypeComparator(boolean ascending,
TypeSerializer<T> serializer,
Class<T> type) |
PojoComparator(Field[] keyFields,
TypeComparator<?>[] comparators,
TypeSerializer<T> serializer,
Class<T> type) |
PojoSerializer(Class<T> clazz,
TypeSerializer<?>[] fieldSerializers,
Field[] fields,
ExecutionConfig executionConfig) |
RuntimeSerializerFactory(TypeSerializer<T> serializer,
Class<T> clazz) |
TupleComparator(int[] keyPositions,
TypeComparator<?>[] comparators,
TypeSerializer<?>[] serializers) |
TupleComparatorBase(int[] keyPositions,
TypeComparator<?>[] comparators,
TypeSerializer<?>[] serializers) |
TupleSerializer(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
TupleSerializerBase(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
Modifier and Type | Class and Description |
---|---|
class |
KryoSerializer<T>
A type serializer that serializes its type using the Kryo serialization
framework (https://github.com/EsotericSoftware/kryo).
|
Modifier and Type | Class and Description |
---|---|
class |
CaseClassSerializer<T extends scala.Product>
Serializer for Case Classes.
|
class |
EnumValueSerializer<E extends scala.Enumeration>
Serializer for
Enumeration values. |
class |
NothingSerializer
Serializer for cases where no serializer is required but the system still expects one.
|
class |
OptionSerializer<A>
Serializer for
Option . |
class |
TraversableSerializer<T extends scala.collection.TraversableOnce<E>,E>
Serializer for Scala Collections.
|
class |
TrySerializer<A>
Serializer for
Try . |
class |
UnitSerializer |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
TryTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
OptionTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<scala.runtime.Nothing$> |
ScalaNothingTypeInfo.createSerializer(ExecutionConfig config) |
TypeSerializer<scala.Enumeration.Value> |
EnumValueTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
EitherTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<scala.runtime.BoxedUnit> |
UnitTypeInfo.createSerializer(ExecutionConfig config) |
abstract TypeSerializer<T> |
TraversableTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<E> |
TraversableSerializer.elementSerializer() |
TypeSerializer<A> |
OptionSerializer.elemSerializer() |
TypeSerializer<A> |
EitherSerializer.leftSerializer() |
TypeSerializer<B> |
EitherSerializer.rightSerializer() |
Constructor and Description |
---|
CaseClassComparator(int[] keys,
TypeComparator<?>[] scalaComparators,
TypeSerializer<?>[] scalaSerializers) |
CaseClassSerializer(Class<T> clazz,
TypeSerializer<?>[] scalaFieldSerializers) |
EitherSerializer(TypeSerializer<A> leftSerializer,
TypeSerializer<B> rightSerializer) |
EitherSerializer(TypeSerializer<A> leftSerializer,
TypeSerializer<B> rightSerializer) |
OptionSerializer(TypeSerializer<A> elemSerializer) |
TraversableSerializer(TypeSerializer<E> elementSerializer) |
TrySerializer(TypeSerializer<A> elemSerializer,
ExecutionConfig executionConfig) |
Modifier and Type | Class and Description |
---|---|
class |
RowSerializer
Serializer for
Row . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Row> |
RowTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<Object>[] |
RowSerializer.fieldSerializers() |
TypeSerializer<Object>[] |
RowComparator.serializers()
serializers to deserialize the first n fields for comparison
|
Constructor and Description |
---|
RowComparator(int numberOfFields,
int[] keyPositions,
NullAwareComparator<Object>[] comparators,
TypeSerializer<Object>[] serializers)
Intermediate constructor for creating auxiliary fields.
|
RowComparator(int numberOfFields,
int[] keyPositions,
TypeComparator<Object>[] comparators,
TypeSerializer<Object>[] serializers,
boolean[] orders)
General constructor for RowComparator.
|
RowSerializer(TypeSerializer<Object>[] fieldSerializers) |
Modifier and Type | Class and Description |
---|---|
class |
NonDuplicatingTypeSerializer<T>
Type serializer which keeps track of the serialized objects so that each object is only
serialized once.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
NonDuplicatingTypeSerializer.duplicate() |
TypeSerializer<T> |
NonDuplicatingTypeSerializer.getTypeSerializer() |
Constructor and Description |
---|
NonDuplicatingTypeSerializer(TypeSerializer<T> typeSerializer) |
Modifier and Type | Class and Description |
---|---|
static class |
NFA.Serializer<T>
TypeSerializer for NFA that uses Java Serialization. |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<NFA<T>> |
NFA.Serializer.duplicate() |
Constructor and Description |
---|
NFA(TypeSerializer<T> eventSerializer,
long windowTime,
boolean handleTimeout) |
SharedBuffer(TypeSerializer<V> valueSerializer) |
Modifier and Type | Method and Description |
---|---|
static <T> NFA<T> |
NFACompiler.compile(Pattern<T,?> pattern,
TypeSerializer<T> inputTypeSerializer,
boolean timeoutHandling)
Compiles the given pattern into a
NFA . |
static <T> NFACompiler.NFAFactory<T> |
NFACompiler.compileFactory(Pattern<T,?> pattern,
TypeSerializer<T> inputTypeSerializer,
boolean timeoutHandling)
Compiles the given pattern into a
NFACompiler.NFAFactory . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<IN> |
AbstractCEPBasePatternOperator.getInputSerializer() |
Constructor and Description |
---|
AbstractCEPBasePatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime) |
AbstractCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
NFACompiler.NFAFactory<IN> nfaFactory) |
AbstractKeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
AbstractKeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
CEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
NFACompiler.NFAFactory<IN> nfaFactory) |
KeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
KeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
TimeoutCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
NFACompiler.NFAFactory<IN> nfaFactory) |
TimeoutKeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
TimeoutKeyedCEPPatternOperator(TypeSerializer<IN> inputSerializer,
boolean isProcessingTime,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
NFACompiler.NFAFactory<IN> nfaFactory) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer |
RocksDBStateBackend.keySerializer()
Used by k/v states to access the key serializer.
|
Modifier and Type | Method and Description |
---|---|
protected <N,T,ACC> FoldingState<T,ACC> |
RocksDBStateBackend.createFoldingState(TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc) |
protected <N,T> ListState<T> |
RocksDBStateBackend.createListState(TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<T> stateDesc) |
protected <N,T> ReducingState<T> |
RocksDBStateBackend.createReducingState(TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<T> stateDesc) |
protected <N,T> ValueState<T> |
RocksDBStateBackend.createValueState(TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<T> stateDesc) |
void |
RocksDBStateBackend.initializeForJob(Environment env,
String operatorIdentifier,
TypeSerializer<?> keySerializer) |
Constructor and Description |
---|
AbstractRocksDBState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
RocksDBStateBackend backend)
Creates a new RocksDB backed state.
|
RocksDBFoldingState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc,
RocksDBStateBackend backend)
Creates a new
RocksDBFoldingState . |
RocksDBListState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc,
RocksDBStateBackend backend)
Creates a new
RocksDBListState . |
RocksDBReducingState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc,
RocksDBStateBackend backend)
Creates a new
RocksDBReducingState . |
RocksDBValueState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc,
RocksDBStateBackend backend)
Creates a new
RocksDBValueState . |
Constructor and Description |
---|
HadoopTupleUnwrappingIterator(TypeSerializer<KEY> keySerializer) |
Constructor and Description |
---|
ChannelReaderInputViewIterator(BlockChannelReader<MemorySegment> reader,
LinkedBlockingQueue<MemorySegment> returnQueue,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
ChannelReaderInputViewIterator(ChannelReaderInputView inView,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors) |
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
LinkedBlockingQueue<MemorySegment> returnQueue,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
InputViewIterator(DataInputView inputView,
TypeSerializer<E> serializer) |
Constructor and Description |
---|
HashPartitionIterator(Iterator<HashPartition<BT,PT>> partitions,
TypeSerializer<BT> serializer) |
WorksetUpdateOutputCollector(DataOutputView outputView,
TypeSerializer<T> serializer) |
WorksetUpdateOutputCollector(DataOutputView outputView,
TypeSerializer<T> serializer,
Collector<T> delegate) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<BT> |
MutableHashTable.buildSideSerializer
The utilities to serialize the build side data types.
|
protected TypeSerializer<T> |
AbstractMutableHashTable.buildSideSerializer
The utilities to serialize the build side data types.
|
protected TypeSerializer<V1> |
ReusingBuildSecondHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V2> |
ReusingBuildFirstHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V1> |
NonReusingBuildSecondHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V2> |
NonReusingBuildFirstHashJoinIterator.probeSideSerializer |
protected TypeSerializer<PT> |
MutableHashTable.probeSideSerializer
The utilities to serialize the probe side data types.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
AbstractMutableHashTable.getBuildSideSerializer() |
Modifier and Type | Method and Description |
---|---|
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
HashJoinIteratorBase.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBloomFilters) |
<BT,PT> MutableHashTable<BT,PT> |
HashJoinIteratorBase.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBloomFilters) |
Constructor and Description |
---|
AbstractMutableHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator) |
CompactingHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator,
List<MemorySegment> memorySegments) |
CompactingHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator,
List<MemorySegment> memorySegments,
int avgRecordLen) |
InMemoryPartition(TypeSerializer<T> serializer,
int partitionNumber,
ListMemorySegmentSource memSource,
int pageSize,
int pageSizeInBits)
Creates a new partition, in memory, with one buffer.
|
InPlaceMutableHashTable(TypeSerializer<T> serializer,
TypeComparator<T> comparator,
List<MemorySegment> memory) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
int avgRecordLen,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
int avgRecordLen,
boolean useBloomFilters) |
NonReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReOpenableMutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBitmapFilters) |
ReOpenableMutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBitmapFilters) |
ReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<T> |
SpillingResettableMutableObjectIterator.serializer |
protected TypeSerializer<T> |
SpillingResettableIterator.serializer |
Constructor and Description |
---|
OutputCollector(List<RecordWriter<SerializationDelegate<T>>> writers,
TypeSerializer<T> serializer)
Initializes the output collector with a set of writers.
|
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<E> |
UnilateralSortMerger.SpillingThread.serializer |
protected TypeSerializer<T1> |
AbstractMergeIterator.serializer1 |
protected TypeSerializer<T2> |
AbstractMergeIterator.serializer2 |
Modifier and Type | Method and Description |
---|---|
protected <T> T |
ReusingMergeOuterJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> T |
ReusingMergeInnerJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> T |
NonReusingMergeOuterJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> T |
NonReusingMergeInnerJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected abstract <T> T |
AbstractMergeIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse)
Copies an instance of the given type, potentially reusing the object passed as the reuse parameter, which may be null.
|
protected <T> KeyGroupedIterator<T> |
ReusingMergeOuterJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
ReusingMergeInnerJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
NonReusingMergeOuterJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
NonReusingMergeInnerJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected abstract <T> KeyGroupedIterator<T> |
AbstractMergeIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected UnilateralSortMerger.ThreadBase<E> |
UnilateralSortMerger.getReadingThread(ExceptionHandler<IOException> exceptionHandler,
MutableObjectIterator<E> reader,
UnilateralSortMerger.CircularQueues<E> queues,
LargeRecordHandler<E> largeRecordHandler,
AbstractInvokable parentTask,
TypeSerializer<E> serializer,
long startSpillingBytes)
Creates the reading thread.
|
Constructor and Description |
---|
ReaderIterator(MutableReader<DeserializationDelegate<T>> reader,
TypeSerializer<T> serializer)
Creates a new iterator, wrapping the given reader.
|
Constructor and Description |
---|
NonReusingDeserializationDelegate(TypeSerializer<T> serializer) |
ReusingDeserializationDelegate(TypeSerializer<T> serializer) |
SerializationDelegate(TypeSerializer<T> serializer) |
Modifier and Type | Class and Description |
---|---|
class |
ArrayListSerializer<T> |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<?> |
AbstractStateBackend.keySerializer |
protected TypeSerializer<K> |
AbstractHeapState.keySerializer
The serializer for the keys
|
protected TypeSerializer<N> |
AbstractHeapState.namespaceSerializer
The serializer for the namespace
|
protected TypeSerializer<SV> |
AbstractHeapState.stateSerializer
Serializer for the state value.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<ArrayList<T>> |
ArrayListSerializer.duplicate() |
TypeSerializer<K> |
AbstractHeapState.getKeySerializer()
Gets the serializer for the keys.
|
TypeSerializer<N> |
AbstractHeapState.getNamespaceSerializer()
Gets the serializer for the namespace.
|
Modifier and Type | Method and Description |
---|---|
protected abstract <N,T,ACC> FoldingState<T,ACC> |
AbstractStateBackend.createFoldingState(TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc)
Creates and returns a new
FoldingState . |
protected abstract <N,T> ListState<T> |
AbstractStateBackend.createListState(TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<T> stateDesc)
Creates and returns a new
ListState . |
protected abstract <N,T> ReducingState<T> |
AbstractStateBackend.createReducingState(TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<T> stateDesc)
Creates and returns a new
ReducingState . |
protected abstract <N,T> ValueState<T> |
AbstractStateBackend.createValueState(TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<T> stateDesc)
Creates and returns a new
ValueState . |
static <T> SerializedCheckpointData[] |
SerializedCheckpointData.fromDeque(ArrayDeque<Tuple2<Long,List<T>>> checkpoints,
TypeSerializer<T> serializer)
Converts a list of checkpoints with elements into an array of SerializedCheckpointData.
|
static <T> SerializedCheckpointData[] |
SerializedCheckpointData.fromDeque(ArrayDeque<Tuple2<Long,List<T>>> checkpoints,
TypeSerializer<T> serializer,
DataOutputSerializer outputBuffer)
Converts a list of checkpoints into an array of SerializedCheckpointData.
|
<N,S extends State> |
AbstractStateBackend.getPartitionedState(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor)
Creates or retrieves a partitioned state backed by this state backend.
|
void |
AbstractStateBackend.initializeForJob(Environment env,
String operatorIdentifier,
TypeSerializer<?> keySerializer)
This method is called by the task upon deployment to initialize the state backend for
data for a specific job.
|
<N,S extends MergingState<?,?>> |
AbstractStateBackend.mergePartitionedStates(N target,
Collection<N> sources,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor) |
KvState<K,N,S,SD,Backend> |
KvStateSnapshot.restoreState(Backend stateBackend,
TypeSerializer<K> keySerializer,
ClassLoader classLoader)
Loads the key/value state back from this snapshot.
|
KvState<K,N,S,SD,Backend> |
AsynchronousKvStateSnapshot.restoreState(Backend stateBackend,
TypeSerializer<K> keySerializer,
ClassLoader classLoader) |
static <T> ArrayDeque<Tuple2<Long,List<T>>> |
SerializedCheckpointData.toDeque(SerializedCheckpointData[] data,
TypeSerializer<T> serializer)
De-serializes an array of SerializedCheckpointData back into an ArrayDeque of element checkpoints.
|
Constructor and Description |
---|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc)
Creates a new empty key/value state.
|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc)
Creates a new empty key/value state.
|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc)
Creates a new empty key/value state.
|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state)
Creates a new key/value state for the given hash map of key/value pairs.
|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state)
Creates a new key/value state for the given hash map of key/value pairs.
|
AbstractHeapState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state)
Creates a new key/value state for the given hash map of key/value pairs.
|
ArrayListSerializer(TypeSerializer<T> elementSerializer) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
AbstractFsStateSnapshot.keySerializer
Key Serializer
|
protected TypeSerializer<N> |
AbstractFsStateSnapshot.namespaceSerializer
Namespace Serializer
|
protected TypeSerializer<SV> |
AbstractFsStateSnapshot.stateSerializer
Serializer for the state value
|
Modifier and Type | Method and Description |
---|---|
protected <N,T,ACC> FoldingState<T,ACC> |
FsStateBackend.createFoldingState(TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc) |
<N,T> ListState<T> |
FsStateBackend.createListState(TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<T> stateDesc) |
<N,T> ReducingState<T> |
FsStateBackend.createReducingState(TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<T> stateDesc) |
<N,V> ValueState<V> |
FsStateBackend.createValueState(TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc) |
void |
FsStateBackend.initializeForJob(Environment env,
String operatorIdentifier,
TypeSerializer<?> keySerializer) |
KvState<K,N,S,SD,FsStateBackend> |
AbstractFsStateSnapshot.restoreState(FsStateBackend stateBackend,
TypeSerializer<K> keySerializer,
ClassLoader classLoader) |
Constructor and Description |
---|
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractFsState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractFsStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
Path filePath)
Creates a new state snapshot with data in the file system.
|
AbstractFsStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
Path filePath)
Creates a new state snapshot with data in the file system.
|
AbstractFsStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
Path filePath)
Creates a new state snapshot with data in the file system.
|
FsFoldingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc)
Creates a new and empty partitioned state.
|
FsFoldingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc)
Creates a new and empty partitioned state.
|
FsFoldingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc,
HashMap<N,Map<K,ACC>> state)
Creates a new key/value state with the given state contents.
|
FsFoldingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc,
HashMap<N,Map<K,ACC>> state)
Creates a new key/value state with the given state contents.
|
FsListState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc)
Creates a new and empty partitioned state.
|
FsListState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc)
Creates a new and empty partitioned state.
|
FsListState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc,
HashMap<N,Map<K,ArrayList<V>>> state)
Creates a new key/value state with the given state contents.
|
FsListState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc,
HashMap<N,Map<K,ArrayList<V>>> state)
Creates a new key/value state with the given state contents.
|
FsReducingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc)
Creates a new and empty partitioned state.
|
FsReducingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc)
Creates a new and empty partitioned state.
|
FsReducingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state)
Creates a new key/value state with the given state contents.
|
FsReducingState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state)
Creates a new key/value state with the given state contents.
|
FsValueState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc)
Creates a new and empty key/value state.
|
FsValueState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc)
Creates a new and empty key/value state.
|
FsValueState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state)
Creates a new key/value state with the given state contents.
|
FsValueState(FsStateBackend backend,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state)
Creates a new key/value state with the given state contents.
|
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
Path filePath) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
Path filePath) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
AbstractMemStateSnapshot.keySerializer
Key Serializer
|
protected TypeSerializer<N> |
AbstractMemStateSnapshot.namespaceSerializer
Namespace Serializer
|
protected TypeSerializer<SV> |
AbstractMemStateSnapshot.stateSerializer
Serializer for the state value
|
Modifier and Type | Method and Description |
---|---|
<N,T,ACC> FoldingState<T,ACC> |
MemoryStateBackend.createFoldingState(TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc) |
<N,T> ListState<T> |
MemoryStateBackend.createListState(TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<T> stateDesc) |
<N,T> ReducingState<T> |
MemoryStateBackend.createReducingState(TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<T> stateDesc) |
<N,V> ValueState<V> |
MemoryStateBackend.createValueState(TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc) |
KvState<K,N,S,SD,MemoryStateBackend> |
AbstractMemStateSnapshot.restoreState(MemoryStateBackend stateBackend,
TypeSerializer<K> keySerializer,
ClassLoader classLoader) |
Constructor and Description |
---|
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc) |
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractMemState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
HashMap<N,Map<K,SV>> state) |
AbstractMemStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
byte[] data)
Creates a new heap memory state snapshot.
|
AbstractMemStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
byte[] data)
Creates a new heap memory state snapshot.
|
AbstractMemStateSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<SV> stateSerializer,
SD stateDesc,
byte[] data)
Creates a new heap memory state snapshot.
|
MemFoldingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc) |
MemFoldingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc) |
MemFoldingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc,
HashMap<N,Map<K,ACC>> state) |
MemFoldingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
FoldingStateDescriptor<T,ACC> stateDesc,
HashMap<N,Map<K,ACC>> state) |
MemListState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc) |
MemListState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc) |
MemListState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc,
HashMap<N,Map<K,ArrayList<V>>> state) |
MemListState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ListStateDescriptor<V> stateDesc,
HashMap<N,Map<K,ArrayList<V>>> state) |
MemReducingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc) |
MemReducingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc) |
MemReducingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state) |
MemReducingState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ReducingStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state) |
MemValueState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc) |
MemValueState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc) |
MemValueState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state) |
MemValueState(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
ValueStateDescriptor<V> stateDesc,
HashMap<N,Map<K,V>> state) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ACC> stateSerializer,
FoldingStateDescriptor<T,ACC> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<ArrayList<V>> stateSerializer,
ListStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ReducingStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
byte[] data) |
Snapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateSerializer,
ValueStateDescriptor<V> stateDescs,
byte[] data) |
Constructor and Description |
---|
NonReusingMutableToRegularIteratorWrapper(MutableObjectIterator<T> source,
TypeSerializer<T> serializer) |
RegularToMutableObjectIterator(Iterator<T> iterator,
TypeSerializer<T> serializer) |
ReusingKeyGroupedIterator(MutableObjectIterator<E> iterator,
TypeSerializer<E> serializer,
TypeComparator<E> comparator)
Initializes the KeyGroupedIterator.
|
ReusingMutableToRegularIteratorWrapper(MutableObjectIterator<T> source,
TypeSerializer<T> serializer) |
Constructor and Description |
---|
FromElementsFunction(TypeSerializer<T> serializer,
Iterable<T> elements) |
FromElementsFunction(TypeSerializer<T> serializer,
T... elements) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<?> |
StreamNode.getStateKeySerializer() |
<K> TypeSerializer<K> |
StreamConfig.getStateKeySerializer(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerIn1() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerIn1(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerIn2() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerIn2(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerOut() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerOut(ClassLoader cl) |
Modifier and Type | Method and Description |
---|---|
void |
StreamGraph.setOneInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector,
TypeSerializer<?> keySerializer) |
void |
StreamNode.setSerializerIn1(TypeSerializer<?> typeSerializerIn1) |
void |
StreamNode.setSerializerIn2(TypeSerializer<?> typeSerializerIn2) |
void |
StreamNode.setSerializerOut(TypeSerializer<?> typeSerializerOut) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamNode.setStateKeySerializer(TypeSerializer<?> stateKeySerializer) |
void |
StreamConfig.setStateKeySerializer(TypeSerializer<?> serializer) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
void |
StreamConfig.setTypeSerializerIn1(TypeSerializer<?> serializer) |
void |
StreamConfig.setTypeSerializerIn2(TypeSerializer<?> serializer) |
void |
StreamConfig.setTypeSerializerOut(TypeSerializer<?> serializer) |
Modifier and Type | Method and Description |
---|---|
protected <S extends State,N> |
AbstractStreamOperator.getPartitionedState(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor)
Creates a partitioned state handle, using the state backend configured for this task.
|
Constructor and Description |
---|
StreamGroupedReduce(ReduceFunction<IN> reducer,
TypeSerializer<IN> serializer) |
StreamProject(int[] fields,
TypeSerializer<OUT> outSerializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<S> |
StatefulFunction.stateSerializer() |
Modifier and Type | Method and Description |
---|---|
static <T,W extends Window> |
DeltaTrigger.of(double threshold,
DeltaFunction<T> deltaFunction,
TypeSerializer<T> stateSerializer)
Creates a delta trigger from the given threshold and
DeltaFunction . |
Modifier and Type | Class and Description |
---|---|
static class |
GlobalWindow.Serializer |
static class |
TimeWindow.Serializer |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<TimeWindow> |
TimeWindow.Serializer.duplicate() |
TypeSerializer<GlobalWindow> |
GlobalWindow.Serializer.duplicate() |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<IN> |
CassandraSink.CassandraSinkBuilder.serializer |
Constructor and Description |
---|
CassandraPojoSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraTupleSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraTupleWriteAheadSink(String insertQuery,
TypeSerializer<IN> serializer,
ClusterBuilder builder,
CheckpointCommitter committer) |
Constructor and Description |
---|
RecordWriterOutput(StreamRecordWriter<SerializationDelegate<StreamRecord<OUT>>> recordWriter,
TypeSerializer<OUT> outSerializer,
boolean enableWatermarkMultiplexing) |
StreamInputProcessor(InputGate[] inputGates,
TypeSerializer<IN> inputSerializer,
StatefulTask<?> checkpointListener,
CheckpointingMode checkpointMode,
IOManager ioManager,
boolean enableWatermarkMultiplexing,
Configuration taskManagerConfig) |
StreamTwoInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
StatefulTask<?> checkpointListener,
CheckpointingMode checkpointMode,
IOManager ioManager,
boolean enableWatermarkMultiplexing,
Configuration taskManagerConfig) |
StreamTwoInputProcessor(Collection<InputGate> inputGates1,
Collection<InputGate> inputGates2,
TypeSerializer<IN1> inputSerializer1,
TypeSerializer<IN2> inputSerializer2,
StatefulTask<?> checkpointListener,
CheckpointingMode checkpointMode,
IOManager ioManager,
boolean enableWatermarkMultiplexing,
Configuration taskManagerConfig) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<IN> |
GenericWriteAheadSink.serializer |
Constructor and Description |
---|
GenericWriteAheadSink(CheckpointCommitter committer,
TypeSerializer<IN> serializer,
String jobID) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<IN> |
WindowOperator.inputSerializer
This is used to copy the incoming element because it can be put into several window
buffers.
|
protected TypeSerializer<K> |
WindowOperator.keySerializer
For serializing the key in checkpoints.
|
protected TypeSerializer<W> |
WindowOperator.windowSerializer
For serializing the window in checkpoints.
|
Modifier and Type | Method and Description |
---|---|
void |
AbstractKeyedTimePanes.readFromInput(DataInputView input,
TypeSerializer<Key> keySerializer,
TypeSerializer<Aggregate> aggSerializer) |
void |
AbstractKeyedTimePanes.readFromInput(DataInputView input,
TypeSerializer<Key> keySerializer,
TypeSerializer<Aggregate> aggSerializer) |
void |
AbstractKeyedTimePanes.writeToOutput(DataOutputView output,
TypeSerializer<Key> keySerializer,
TypeSerializer<Aggregate> aggSerializer) |
void |
AbstractKeyedTimePanes.writeToOutput(DataOutputView output,
TypeSerializer<Key> keySerializer,
TypeSerializer<Aggregate> aggSerializer) |
Constructor and Description |
---|
AbstractAlignedProcessingTimeWindowOperator(F function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<STATE> stateTypeSerializer,
long windowLength,
long windowSlide) |
AbstractAlignedProcessingTimeWindowOperator(F function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<STATE> stateTypeSerializer,
long windowLength,
long windowSlide) |
AccumulatingProcessingTimeWindowOperator(WindowFunction<IN,OUT,KEY,TimeWindow> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> valueSerializer,
long windowLength,
long windowSlide) |
AccumulatingProcessingTimeWindowOperator(WindowFunction<IN,OUT,KEY,TimeWindow> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> valueSerializer,
long windowLength,
long windowSlide) |
AggregatingProcessingTimeWindowOperator(ReduceFunction<IN> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> aggregateSerializer,
long windowLength,
long windowSlide) |
AggregatingProcessingTimeWindowOperator(ReduceFunction<IN> function,
KeySelector<IN,KEY> keySelector,
TypeSerializer<KEY> keySerializer,
TypeSerializer<IN> aggregateSerializer,
long windowLength,
long windowSlide) |
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness) |
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness) |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness)
Creates a new
WindowOperator based on the given policies and user functions. |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness)
Creates a new
WindowOperator based on the given policies and user functions. |
Modifier and Type | Class and Description |
---|---|
class |
MultiplexingStreamRecordSerializer<T>
Serializer for
StreamRecord and Watermark . |
class |
StreamRecordSerializer<T>
Serializer for
StreamRecord . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
StreamRecordSerializer.getContainedTypeSerializer() |
TypeSerializer<T> |
MultiplexingStreamRecordSerializer.getContainedTypeSerializer() |
Constructor and Description |
---|
MultiplexingStreamRecordSerializer(TypeSerializer<T> serializer) |
StreamRecordSerializer(TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
AbstractStateBackend |
StreamTask.createStateBackend(String operatorIdentifier,
TypeSerializer<?> keySerializer) |
Modifier and Type | Method and Description |
---|---|
static <T> T |
InstantiationUtil.deserializeFromByteArray(TypeSerializer<T> serializer,
byte[] buf) |
static <T> T |
InstantiationUtil.deserializeFromByteArray(TypeSerializer<T> serializer,
T reuse,
byte[] buf) |
static <T> byte[] |
InstantiationUtil.serializeToByteArray(TypeSerializer<T> serializer,
T record) |
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.