Modifier and Type | Method and Description |
---|---|
void |
SerializedListAccumulator.add(T value,
TypeSerializer<T> serializer) |
static <T> List<T> |
SerializedListAccumulator.deserializeList(ArrayList<byte[]> data,
TypeSerializer<T> serializer) |
Constructor and Description |
---|
CopyingIterator(Iterator<E> source,
TypeSerializer<E> serializer) |
CopyingListCollector(List<T> list,
TypeSerializer<T> serializer) |
Constructor and Description |
---|
SimpleListIterable(List<IN> values,
TypeComparator<IN> comparator,
TypeSerializer<IN> serializer) |
SimpleListIterator(List<IN> values,
TypeSerializer<IN> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<BT> |
JoinHashMap.getBuildSerializer() |
Constructor and Description |
---|
JoinHashMap(TypeSerializer<BT> buildSerializer,
TypeComparator<BT> buildComparator) |
ListKeyGroupedIterator(List<E> input,
TypeSerializer<E> serializer,
TypeComparator<E> comparator)
Initializes the ListKeyGroupedIterator..
|
Constructor and Description |
---|
TypeInformationSerializationSchema(TypeInformation<T> typeInfo,
TypeSerializer<T> serializer)
Creates a new de-/serialization schema for the given type.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
ListStateDescriptor.getElementSerializer()
Gets the serializer for the elements contained in the list.
|
TypeSerializer<UK> |
MapStateDescriptor.getKeySerializer()
Gets the serializer for the keys in the state.
|
TypeSerializer<T> |
StateDescriptor.getSerializer()
Returns the
TypeSerializer that can be used to serialize the value in the state. |
TypeSerializer<UV> |
MapStateDescriptor.getValueSerializer()
Gets the serializer for the values in the state.
|
Constructor and Description |
---|
AggregatingStateDescriptor(String name,
AggregateFunction<IN,ACC,OUT> aggFunction,
TypeSerializer<ACC> typeSerializer)
Creates a new
ValueStateDescriptor with the given name and default value. |
FoldingStateDescriptor(String name,
ACC initialValue,
FoldFunction<T,ACC> foldFunction,
TypeSerializer<ACC> typeSerializer)
Deprecated.
Creates a new
ValueStateDescriptor with the given name and default value. |
ListStateDescriptor(String name,
TypeSerializer<T> typeSerializer)
Creates a new
ListStateDescriptor with the given name and list element type. |
MapStateDescriptor(String name,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Create a new
MapStateDescriptor with the given name and the given type serializers. |
MapStateDescriptor(String name,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Create a new
MapStateDescriptor with the given name and the given type serializers. |
ReducingStateDescriptor(String name,
ReduceFunction<T> reduceFunction,
TypeSerializer<T> typeSerializer)
Creates a new
ValueStateDescriptor with the given name and default value. |
StateDescriptor(String name,
TypeSerializer<T> serializer,
T defaultValue)
Create a new
StateDescriptor with the given name and the given type serializer. |
ValueStateDescriptor(String name,
TypeSerializer<T> typeSerializer)
Creates a new
ValueStateDescriptor with the given name and the specific serializer. |
ValueStateDescriptor(String name,
TypeSerializer<T> typeSerializer,
T defaultValue)
Deprecated.
Use
ValueStateDescriptor.ValueStateDescriptor(String, TypeSerializer) instead and manually
manage the default value by checking whether the contents of the state is null . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
BasicArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
abstract TypeSerializer<T> |
TypeInformation.createSerializer(ExecutionConfig config)
Creates a serializer for the type.
|
TypeSerializer<Nothing> |
NothingTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
SqlTimeTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
BasicTypeInfo.createSerializer(ExecutionConfig executionConfig) |
TypeSerializer<T> |
PrimitiveArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
Constructor and Description |
---|
BasicTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
FractionalTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
IntegerTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
NumericTypeInfo(Class<T> clazz,
Class<?>[] possibleCastTargetTypes,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
SqlTimeTypeInfo(Class<T> clazz,
TypeSerializer<T> serializer,
Class<? extends TypeComparator<T>> comparatorClass) |
Modifier and Type | Class and Description |
---|---|
class |
CompositeSerializer<T>
Base class for composite serializers.
|
class |
TypeDeserializerAdapter<T>
A utility class that is used to bridge a
TypeSerializer and TypeDeserializer . |
class |
UnloadableDummyTypeSerializer<T>
Dummy TypeSerializer to avoid that data is lost when checkpointing again a serializer for which we encountered
a
ClassNotFoundException or InvalidClassException . |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<Object>[] |
CompositeSerializer.fieldSerializers
Serializers for fields which constitute T.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
TypeDeserializer.duplicate()
Creates a deep copy of this deserializer if it is necessary, i.e.
|
TypeSerializer<T> |
TypeDeserializerAdapter.duplicate() |
TypeSerializer<T> |
UnloadableDummyTypeSerializer.duplicate() |
abstract TypeSerializer<T> |
TypeSerializer.duplicate()
Creates a deep copy of this serializer if it is necessary, i.e.
|
<T> TypeSerializer<T> |
CompositeSerializerSnapshot.getRestoreSerializer(int pos)
Creates the restore serializer from the pos-th config snapshot.
|
TypeSerializer<?>[] |
CompositeSerializerSnapshot.getRestoreSerializers()
Produces a restore serializer from each contained serializer configuration snapshot.
|
TypeSerializer<T> |
TypeSerializerFactory.getSerializer() |
TypeSerializer<T> |
TypeSerializerSerializationUtil.TypeSerializerSerializationProxy.getTypeSerializer() |
TypeSerializer<T> |
TypeSerializerConfigSnapshot.restoreSerializer()
Deprecated.
Creates a serializer using this configuration, that is capable of reading data
written by the serializer described by this configuration.
|
TypeSerializer<T> |
SimpleTypeSerializerSnapshot.restoreSerializer() |
TypeSerializer<T> |
TypeSerializerSnapshot.restoreSerializer()
Recreates a serializer instance from this snapshot.
|
TypeSerializer<T> |
BackwardsCompatibleSerializerSnapshot.restoreSerializer() |
static <T> TypeSerializer<T> |
TypeSerializerSerializationUtil.tryReadSerializer(DataInputView in,
ClassLoader userCodeClassLoader)
Deprecated.
Reads from a data input view a
TypeSerializer that was previously
written using TypeSerializerSerializationUtil.writeSerializer(DataOutputView, TypeSerializer) . |
static <T> TypeSerializer<T> |
TypeSerializerSerializationUtil.tryReadSerializer(DataInputView in,
ClassLoader userCodeClassLoader,
boolean useDummyPlaceholder)
Deprecated.
Reads from a data input view a
TypeSerializer that was previously
written using TypeSerializerSerializationUtil.writeSerializer(DataOutputView, TypeSerializer) . |
Modifier and Type | Method and Description |
---|---|
List<Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> |
CompositeTypeSerializerConfigSnapshot.getNestedSerializersAndConfigs() |
Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>> |
CompositeTypeSerializerConfigSnapshot.getSingleNestedSerializerAndConfig() |
static List<Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> |
TypeSerializerSerializationUtil.readSerializersAndConfigsWithResilience(DataInputView in,
ClassLoader userCodeClassLoader)
Deprecated.
Reads from a data input view a list of serializers and their corresponding config snapshots
written using
TypeSerializerSerializationUtil.writeSerializersAndConfigsWithResilience(DataOutputView, List) . |
Modifier and Type | Method and Description |
---|---|
protected abstract CompositeSerializer<T> |
CompositeSerializer.createSerializerInstance(CompositeSerializer.PrecomputedParameters precomputed,
TypeSerializer<?>... originalSerializers)
Factory for concrete serializer.
|
static <T> TypeSerializerSnapshot<T> |
TypeSerializerSnapshotSerializationUtil.readSerializerSnapshot(DataInputView in,
ClassLoader userCodeClassLoader,
TypeSerializer<T> existingPriorSerializer)
Reads from a data input view a
TypeSerializerSnapshot that was previously
written using TypeSerializerSnapshotSerializationUtil.writeSerializerSnapshot(DataOutputView, TypeSerializerSnapshot, TypeSerializer) . |
static <T> CompatibilityResult<T> |
CompatibilityResult.requiresMigration(TypeSerializer<T> convertSerializer)
Returns a result that signals migration to be performed, and in the case that the preceding serializer
cannot be found or restored to read the previous data during migration, a provided convert serializer
can be used.
|
static <T> CompatibilityResult<T> |
CompatibilityUtil.resolveCompatibilityResult(TypeSerializer<?> precedingSerializer,
Class<?> dummySerializerClassTag,
TypeSerializerSnapshot<?> precedingSerializerConfigSnapshot,
TypeSerializer<T> newSerializer)
Deprecated.
Resolves the final compatibility result of two serializers by taking into account compound information,
including the preceding serializer, the preceding serializer's configuration snapshot, and the new serializer.
|
static <T> CompatibilityResult<T> |
CompatibilityUtil.resolveCompatibilityResult(TypeSerializer<?> precedingSerializer,
Class<?> dummySerializerClassTag,
TypeSerializerSnapshot<?> precedingSerializerConfigSnapshot,
TypeSerializer<T> newSerializer)
Deprecated.
Resolves the final compatibility result of two serializers by taking into account compound information,
including the preceding serializer, the preceding serializer's configuration snapshot, and the new serializer.
|
static <T> CompatibilityResult<T> |
CompatibilityUtil.resolveCompatibilityResult(TypeSerializerSnapshot<T> precedingSerializerConfigSnapshot,
TypeSerializer<T> newSerializer)
Deprecated.
|
<T> TypeSerializerSchemaCompatibility<T> |
CompositeSerializerSnapshot.resolveCompatibilityWithNested(TypeSerializerSchemaCompatibility<?> outerCompatibility,
TypeSerializer<?>... newNestedSerializers)
Resolves the compatibility of the nested serializer snapshots with the nested
serializers of the new outer serializer.
|
TypeSerializerSchemaCompatibility<T> |
TypeSerializerConfigSnapshot.resolveSchemaCompatibility(TypeSerializer<T> newSerializer)
Deprecated.
|
TypeSerializerSchemaCompatibility<T> |
SimpleTypeSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<T> newSerializer) |
TypeSerializerSchemaCompatibility<T> |
TypeSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<T> newSerializer)
Checks a new serializer's compatibility to read data written by the prior serializer.
|
TypeSerializerSchemaCompatibility<T> |
BackwardsCompatibleSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<T> newSerializer) |
void |
TypeSerializerConfigSnapshot.setPriorSerializer(TypeSerializer<T> serializer)
Deprecated.
Set the originating serializer of this configuration snapshot.
|
static TypeSerializerSnapshot<?>[] |
TypeSerializerUtils.snapshotBackwardsCompatible(TypeSerializer<?>... originatingSerializers)
Takes config snapshots of the given serializers.
|
static <T> void |
TypeSerializerSerializationUtil.writeSerializer(DataOutputView out,
TypeSerializer<T> serializer)
Deprecated.
Writes a
TypeSerializer to the provided data output view. |
static <T> void |
TypeSerializerSnapshotSerializationUtil.writeSerializerSnapshot(DataOutputView out,
TypeSerializerSnapshot<T> serializerSnapshot,
TypeSerializer<T> serializer)
Writes a
TypeSerializerSnapshot to the provided data output view. |
Modifier and Type | Method and Description |
---|---|
static void |
TypeSerializerSerializationUtil.writeSerializersAndConfigsWithResilience(DataOutputView out,
List<Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> serializersAndConfigs)
Deprecated.
Write a list of serializers and their corresponding config snapshots to the provided
data output view.
|
Constructor and Description |
---|
BackwardsCompatibleSerializerSnapshot(TypeSerializer<T> serializerInstance) |
CompositeSerializer(boolean immutableTargetType,
TypeSerializer<?>... fieldSerializers)
Can be used for user facing constructor.
|
CompositeSerializer(CompositeSerializer.PrecomputedParameters precomputed,
TypeSerializer<?>... fieldSerializers)
Can be used in createSerializerInstance for internal operations.
|
CompositeSerializerSnapshot(TypeSerializer<?>... serializers)
Constructor to create a snapshot for writing.
|
CompositeTypeSerializerConfigSnapshot(TypeSerializer<?>... nestedSerializers) |
TypeDeserializerAdapter(TypeSerializer<T> serializer)
Creates a
TypeDeserializerAdapter that wraps a TypeSerializer . |
TypeSerializerSerializationProxy(TypeSerializer<T> typeSerializer) |
Constructor and Description |
---|
SimpleTypeSerializerSnapshot(Class<? extends TypeSerializer<T>> serializerClass)
Constructor to create snapshot from serializer (writing the snapshot).
|
Modifier and Type | Class and Description |
---|---|
class |
BigDecSerializer
Serializer for serializing/deserializing BigDecimal values including null values.
|
class |
BigIntSerializer
Serializer for serializing/deserializing BigInteger values including null values.
|
class |
BooleanSerializer
Type serializer for
Boolean . |
class |
BooleanValueSerializer |
class |
ByteSerializer
Type serializer for
Byte . |
class |
ByteValueSerializer |
class |
CharSerializer
Type serializer for
Character . |
class |
CharValueSerializer |
class |
DateSerializer |
class |
DoubleSerializer
Type serializer for
Double . |
class |
DoubleValueSerializer |
class |
EnumSerializer<T extends Enum<T>> |
class |
FloatSerializer
Type serializer for
Float . |
class |
FloatValueSerializer |
class |
GenericArraySerializer<C>
A serializer for arrays of objects.
|
class |
InstantSerializer
Serializer for serializing/deserializing Instant values including null values.
|
class |
IntSerializer
Type serializer for
Integer (and int , via auto-boxing). |
class |
IntValueSerializer |
class |
ListSerializer<T>
A serializer for
Lists . |
class |
LongSerializer
Type serializer for
Long . |
class |
LongValueSerializer |
class |
MapSerializer<K,V>
A serializer for
Map . |
class |
NullValueSerializer |
class |
ShortSerializer
Type serializer for
Byte . |
class |
ShortValueSerializer |
class |
SqlDateSerializer |
class |
SqlTimeSerializer |
class |
SqlTimestampSerializer |
class |
StringSerializer
Type serializer for
String . |
class |
StringValueSerializer |
class |
TypeSerializerSingleton<T> |
class |
VoidSerializer
Serializer for
Void . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Map<K,V>> |
MapSerializer.duplicate() |
TypeSerializer<List<T>> |
ListSerializer.duplicate() |
TypeSerializer<C> |
GenericArraySerializer.getComponentSerializer() |
TypeSerializer<T> |
ListSerializer.getElementSerializer()
Gets the serializer for the elements of the list.
|
TypeSerializer<K> |
MapSerializer.getKeySerializer() |
TypeSerializer<V> |
MapSerializer.getValueSerializer() |
TypeSerializer<C[]> |
GenericArraySerializerConfigSnapshot.restoreSerializer() |
TypeSerializer<Map<K,V>> |
MapSerializerSnapshot.restoreSerializer() |
TypeSerializer<List<T>> |
ListSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
TypeSerializerSchemaCompatibility<C[]> |
GenericArraySerializerConfigSnapshot.resolveSchemaCompatibility(TypeSerializer<C[]> newSerializer) |
TypeSerializerSchemaCompatibility<C> |
CollectionSerializerConfigSnapshot.resolveSchemaCompatibility(TypeSerializer<C> newSerializer)
Deprecated.
|
TypeSerializerSchemaCompatibility<List<T>> |
ListSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<List<T>> newSerializer) |
TypeSerializerSchemaCompatibility<Map<K,V>> |
MapSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<Map<K,V>> newSerializer) |
TypeSerializerSchemaCompatibility<Map<K,V>> |
MapSerializerConfigSnapshot.resolveSchemaCompatibility(TypeSerializer<Map<K,V>> newSerializer)
Deprecated.
|
Constructor and Description |
---|
CollectionSerializerConfigSnapshot(TypeSerializer<T> elementSerializer)
Deprecated.
|
GenericArraySerializer(Class<C> componentClass,
TypeSerializer<C> componentSerializer) |
ListSerializer(TypeSerializer<T> elementSerializer)
Creates a list serializer that uses the given serializer to serialize the list's elements.
|
ListSerializerSnapshot(TypeSerializer<T> elementSerializer)
Constructor to create the snapshot for writing.
|
MapSerializer(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Creates a map serializer that uses the given serializers to serialize the key-value pairs in the map.
|
MapSerializer(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Creates a map serializer that uses the given serializers to serialize the key-value pairs in the map.
|
MapSerializerConfigSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Deprecated.
|
MapSerializerConfigSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Deprecated.
|
MapSerializerSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Constructor to create the snapshot for writing.
|
MapSerializerSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer)
Constructor to create the snapshot for writing.
|
Modifier and Type | Class and Description |
---|---|
class |
BooleanPrimitiveArraySerializer
A serializer for boolean arrays.
|
class |
BytePrimitiveArraySerializer
A serializer for byte arrays.
|
class |
CharPrimitiveArraySerializer
A serializer for char arrays.
|
class |
DoublePrimitiveArraySerializer
A serializer for double arrays.
|
class |
FloatPrimitiveArraySerializer
A serializer for float arrays.
|
class |
IntPrimitiveArraySerializer
A serializer for int arrays.
|
class |
LongPrimitiveArraySerializer
A serializer for long arrays.
|
class |
ShortPrimitiveArraySerializer
A serializer for short arrays.
|
class |
StringArraySerializer
A serializer for String arrays.
|
Constructor and Description |
---|
CollectHelper(String id,
TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
void |
TypeSerializerOutputFormat.setSerializer(TypeSerializer<T> serializer) |
Constructor and Description |
---|
CollectionInputFormat(Collection<T> dataSet,
TypeSerializer<T> serializer) |
Modifier and Type | Class and Description |
---|---|
class |
CopyableValueSerializer<T extends CopyableValue<T>> |
class |
EitherSerializer<L,R>
A
TypeSerializer for the Either type of the Java class. |
class |
NullableSerializer<T>
Serializer wrapper to add support of
null value serialization. |
class |
PojoSerializer<T> |
class |
RowSerializer
Serializer for
Row . |
class |
Tuple0Serializer |
class |
TupleSerializer<T extends Tuple> |
class |
TupleSerializerBase<T> |
class |
ValueSerializer<T extends Value>
Serializer for
Value types. |
class |
WritableSerializer<T extends org.apache.hadoop.io.Writable>
A
TypeSerializer for Writable . |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<Object>[] |
TupleSerializerBase.fieldSerializers |
protected TypeSerializer[] |
TupleComparatorBase.serializers
serializers to deserialize the first n fields for comparison
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Either<L,R>> |
EitherSerializer.duplicate() |
TypeSerializer<T> |
NullableSerializer.duplicate() |
TypeSerializer<Row> |
RowSerializer.duplicate() |
TypeSerializer<Object>[] |
TupleSerializerBase.getFieldSerializers() |
TypeSerializer<L> |
EitherSerializer.getLeftSerializer() |
TypeSerializer<R> |
EitherSerializer.getRightSerializer() |
TypeSerializer<T> |
RuntimeSerializerFactory.getSerializer() |
TypeSerializer<Either<L,R>> |
EitherSerializerSnapshot.restoreSerializer() |
static <T> TypeSerializer<T> |
NullableSerializer.wrap(TypeSerializer<T> originalSerializer,
boolean padNullValueIfFixedLen)
This method wraps the
originalSerializer with the NullableSerializer if not already wrapped. |
static <T> TypeSerializer<T> |
NullableSerializer.wrapIfNullIsNotSupported(TypeSerializer<T> originalSerializer,
boolean padNullValueIfFixedLen)
This method tries to serialize
null value with the originalSerializer
and wraps it in case of NullPointerException , otherwise it returns the originalSerializer . |
Modifier and Type | Method and Description |
---|---|
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> |
PojoSerializer.PojoSerializerConfigSnapshot.getFieldToSerializerConfigSnapshot() |
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> |
PojoSerializer.PojoSerializerConfigSnapshot.getNonRegisteredSubclassesToSerializerConfigSnapshots() |
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> |
PojoSerializer.PojoSerializerConfigSnapshot.getRegisteredSubclassesToSerializerConfigSnapshots() |
Modifier and Type | Method and Description |
---|---|
static <T> boolean |
NullableSerializer.checkIfNullSupported(TypeSerializer<T> serializer)
This method checks if
serializer supports null value. |
static <T> T |
KryoUtils.copy(T from,
com.esotericsoftware.kryo.Kryo kryo,
TypeSerializer<T> serializer)
Tries to copy the given record from using the provided Kryo instance.
|
static <T> T |
KryoUtils.copy(T from,
T reuse,
com.esotericsoftware.kryo.Kryo kryo,
TypeSerializer<T> serializer)
Tries to copy the given record from using the provided Kryo instance.
|
protected abstract TupleSerializerBase<T> |
TupleSerializerBase.createSerializerInstance(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
protected TupleSerializerBase<T> |
TupleSerializer.createSerializerInstance(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
TypeSerializerSchemaCompatibility<Either<L,R>> |
EitherSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<Either<L,R>> newSerializer) |
TypeSerializerSchemaCompatibility<Either<L,R>> |
EitherSerializerConfigSnapshot.resolveSchemaCompatibility(TypeSerializer<Either<L,R>> newSerializer)
Deprecated.
|
static <T> TypeSerializer<T> |
NullableSerializer.wrap(TypeSerializer<T> originalSerializer,
boolean padNullValueIfFixedLen)
This method wraps the
originalSerializer with the NullableSerializer if not already wrapped. |
static <T> TypeSerializer<T> |
NullableSerializer.wrapIfNullIsNotSupported(TypeSerializer<T> originalSerializer,
boolean padNullValueIfFixedLen)
This method tries to serialize
null value with the originalSerializer
and wraps it in case of NullPointerException , otherwise it returns the originalSerializer . |
Constructor and Description |
---|
EitherSerializer(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer) |
EitherSerializer(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer) |
EitherSerializerSnapshot(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer)
Constructor to create the snapshot for writing.
|
EitherSerializerSnapshot(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer)
Constructor to create the snapshot for writing.
|
GenericTypeComparator(boolean ascending,
TypeSerializer<T> serializer,
Class<T> type) |
PojoComparator(Field[] keyFields,
TypeComparator<?>[] comparators,
TypeSerializer<T> serializer,
Class<T> type) |
PojoSerializer(Class<T> clazz,
Field[] fields,
TypeSerializer<Object>[] fieldSerializers,
LinkedHashMap<Class<?>,Integer> registeredClasses,
TypeSerializer<?>[] registeredSerializers,
HashMap<Class<?>,TypeSerializer<?>> subclassSerializerCache) |
PojoSerializer(Class<T> clazz,
Field[] fields,
TypeSerializer<Object>[] fieldSerializers,
LinkedHashMap<Class<?>,Integer> registeredClasses,
TypeSerializer<?>[] registeredSerializers,
HashMap<Class<?>,TypeSerializer<?>> subclassSerializerCache) |
PojoSerializer(Class<T> clazz,
TypeSerializer<?>[] fieldSerializers,
Field[] fields,
ExecutionConfig executionConfig) |
RowComparator(int arity,
int[] keyPositions,
TypeComparator<Object>[] comparators,
TypeSerializer<Object>[] serializers,
boolean[] orders)
General constructor for RowComparator.
|
RowSerializer(TypeSerializer<?>[] fieldSerializers) |
RowSerializerConfigSnapshot(TypeSerializer[] fieldSerializers) |
RuntimeSerializerFactory(TypeSerializer<T> serializer,
Class<T> clazz) |
TupleComparator(int[] keyPositions,
TypeComparator<?>[] comparators,
TypeSerializer<?>[] serializers) |
TupleComparatorBase(int[] keyPositions,
TypeComparator<?>[] comparators,
TypeSerializer<?>[] serializers) |
TupleSerializer(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
TupleSerializerBase(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
TupleSerializerConfigSnapshot(Class<T> tupleClass,
TypeSerializer<?>[] fieldSerializers) |
Constructor and Description |
---|
PojoSerializer(Class<T> clazz,
Field[] fields,
TypeSerializer<Object>[] fieldSerializers,
LinkedHashMap<Class<?>,Integer> registeredClasses,
TypeSerializer<?>[] registeredSerializers,
HashMap<Class<?>,TypeSerializer<?>> subclassSerializerCache) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots,
boolean ignoreTypeSerializerSerialization) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots,
boolean ignoreTypeSerializerSerialization) |
PojoSerializerConfigSnapshot(Class<T> pojoType,
LinkedHashMap<String,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> fieldToSerializerConfigSnapshot,
LinkedHashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> registeredSubclassesToSerializerConfigSnapshots,
HashMap<Class<?>,Tuple2<TypeSerializer<?>,TypeSerializerSnapshot<?>>> nonRegisteredSubclassesToSerializerConfigSnapshots,
boolean ignoreTypeSerializerSerialization) |
Modifier and Type | Class and Description |
---|---|
class |
KryoSerializer<T>
A type serializer that serializes its type using the Kryo serialization
framework (https://github.com/EsotericSoftware/kryo).
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<scala.util.Either<L,R>> |
ScalaEitherSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
TypeSerializerSchemaCompatibility<scala.util.Either<L,R>> |
ScalaEitherSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<scala.util.Either<L,R>> newSerializer) |
Constructor and Description |
---|
ScalaEitherSerializerSnapshot(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer)
Constructor to create the snapshot for writing.
|
ScalaEitherSerializerSnapshot(TypeSerializer<L> leftSerializer,
TypeSerializer<R> rightSerializer)
Constructor to create the snapshot for writing.
|
ScalaOptionSerializerConfigSnapshot(TypeSerializer<E> elementSerializer) |
ScalaTrySerializerConfigSnapshot(TypeSerializer<E> elementSerializer,
TypeSerializer<Throwable> throwableSerializer) |
ScalaTrySerializerConfigSnapshot(TypeSerializer<E> elementSerializer,
TypeSerializer<Throwable> throwableSerializer) |
TraversableSerializerConfigSnapshot(TypeSerializer<E> elementSerializer) |
Modifier and Type | Class and Description |
---|---|
static class |
DeweyNumber.DeweyNumberSerializer
A
TypeSerializer for the DeweyNumber which serves as a version number. |
static class |
NFA.NFASerializer<T>
Deprecated.
|
class |
NFAStateSerializer
A
TypeSerializer for NFAState that uses Java Serialization. |
static class |
SharedBuffer.SharedBufferSerializer<K,V>
Deprecated.
A
TypeSerializer for the SharedBuffer . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<K> |
SharedBuffer.SharedBufferSerializer.getKeySerializer() |
TypeSerializer<V> |
SharedBuffer.SharedBufferSerializer.getValueSerializer() |
TypeSerializer<DeweyNumber> |
SharedBuffer.SharedBufferSerializer.getVersionSerializer() |
Modifier and Type | Class and Description |
---|---|
static class |
EventId.EventIdSerializer
TypeSerializer for EventId . |
static class |
Lockable.LockableTypeSerializer<E>
Serializer for
Lockable . |
static class |
NodeId.NodeIdSerializer
Serializer for
NodeId . |
static class |
SharedBufferEdge.SharedBufferEdgeSerializer
Serializer for
SharedBufferEdge . |
static class |
SharedBufferNode.SharedBufferNodeSerializer
Serializer for
SharedBufferNode . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Lockable<E>> |
LockableTypeSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
TypeSerializerSchemaCompatibility<Lockable<E>> |
LockableTypeSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<Lockable<E>> newSerializer) |
Constructor and Description |
---|
LockableTypeSerializerSnapshot(TypeSerializer<E> elementSerializer)
Constructor to create the snapshot for writing.
|
SharedBuffer(KeyedStateStore stateStore,
TypeSerializer<V> valueSerializer) |
Modifier and Type | Method and Description |
---|---|
<T extends HeapPriorityQueueElement & PriorityComparable & Keyed> |
RocksDBKeyedStateBackend.create(String stateName,
TypeSerializer<T> byteOrderedElementSerializer) |
<N,SV,SEV,S extends State,IS extends S> |
RocksDBKeyedStateBackend.createInternalState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,SV> stateDesc,
StateSnapshotTransformer.StateSnapshotTransformFactory<SEV> snapshotTransformFactory) |
<K> AbstractKeyedStateBackend<K> |
RocksDBStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup) |
byte[] |
AbstractRocksDBState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer) |
byte[] |
AbstractRocksDBState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer) |
byte[] |
AbstractRocksDBState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer) |
static boolean |
RocksDBKeySerializationUtils.isAmbiguousKeyPossible(TypeSerializer keySerializer,
TypeSerializer namespaceSerializer) |
static boolean |
RocksDBKeySerializationUtils.isAmbiguousKeyPossible(TypeSerializer keySerializer,
TypeSerializer namespaceSerializer) |
void |
AbstractRocksDBState.migrateSerializedValue(DataInputDeserializer serializedOldValueInput,
DataOutputSerializer serializedMigratedValueOutput,
TypeSerializer<V> priorSerializer,
TypeSerializer<V> newSerializer) |
void |
AbstractRocksDBState.migrateSerializedValue(DataInputDeserializer serializedOldValueInput,
DataOutputSerializer serializedMigratedValueOutput,
TypeSerializer<V> priorSerializer,
TypeSerializer<V> newSerializer) |
static <K> K |
RocksDBKeySerializationUtils.readKey(TypeSerializer<K> keySerializer,
DataInputDeserializer inputView,
boolean ambiguousKeyPossible) |
static <N> N |
RocksDBKeySerializationUtils.readNamespace(TypeSerializer<N> namespaceSerializer,
DataInputDeserializer inputView,
boolean ambiguousKeyPossible) |
static <K> void |
RocksDBKeySerializationUtils.writeKey(K key,
TypeSerializer<K> keySerializer,
DataOutputSerializer keySerializationDataOutputView,
boolean ambiguousKeyPossible) |
protected void |
AbstractRocksDBState.writeKeyWithGroupAndNamespace(int keyGroup,
K key,
TypeSerializer<K> keySerializer,
N namespace,
TypeSerializer<N> namespaceSerializer,
DataOutputSerializer keySerializationDataOutputView) |
protected void |
AbstractRocksDBState.writeKeyWithGroupAndNamespace(int keyGroup,
K key,
TypeSerializer<K> keySerializer,
N namespace,
TypeSerializer<N> namespaceSerializer,
DataOutputSerializer keySerializationDataOutputView) |
static <N> void |
RocksDBKeySerializationUtils.writeNameSpace(N namespace,
TypeSerializer<N> namespaceSerializer,
DataOutputSerializer keySerializationDataOutputView,
boolean ambiguousKeyPossible) |
Constructor and Description |
---|
AbstractRocksDBState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> valueSerializer,
V defaultValue,
RocksDBKeyedStateBackend<K> backend)
Creates a new RocksDB backed state.
|
AbstractRocksDBState(org.rocksdb.ColumnFamilyHandle columnFamily,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> valueSerializer,
V defaultValue,
RocksDBKeyedStateBackend<K> backend)
Creates a new RocksDB backed state.
|
RocksDBKeyedStateBackend(String operatorIdentifier,
ClassLoader userCodeClassLoader,
File instanceBasePath,
org.rocksdb.DBOptions dbOptions,
org.rocksdb.ColumnFamilyOptions columnFamilyOptions,
TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
ExecutionConfig executionConfig,
boolean enableIncrementalCheckpointing,
LocalRecoveryConfig localRecoveryConfig,
RocksDBStateBackend.PriorityQueueStateType priorityQueueStateType,
TtlTimeProvider ttlTimeProvider,
RocksDBNativeMetricOptions metricOptions,
MetricGroup metricGroup) |
Constructor and Description |
---|
RocksStateKeysIterator(RocksIteratorWrapper iterator,
String state,
TypeSerializer<K> keySerializer,
int keyGroupPrefixBytes,
boolean ambiguousKeyPossible,
byte[] namespaceBytes) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
RocksDBSnapshotStrategyBase.keySerializer
The key serializer of the backend.
|
Constructor and Description |
---|
RocksDBSnapshotStrategyBase(String description,
org.rocksdb.RocksDB db,
ResourceGuard rocksDBResourceGuard,
TypeSerializer<K> keySerializer,
LinkedHashMap<String,Tuple2<org.rocksdb.ColumnFamilyHandle,RegisteredStateMetaInfoBase>> kvStateInformation,
KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
LocalRecoveryConfig localRecoveryConfig,
CloseableRegistry cancelStreamRegistry) |
RocksFullSnapshotStrategy(org.rocksdb.RocksDB db,
ResourceGuard rocksDBResourceGuard,
TypeSerializer<K> keySerializer,
LinkedHashMap<String,Tuple2<org.rocksdb.ColumnFamilyHandle,RegisteredStateMetaInfoBase>> kvStateInformation,
KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
LocalRecoveryConfig localRecoveryConfig,
CloseableRegistry cancelStreamRegistry,
StreamCompressionDecorator keyGroupCompressionDecorator) |
RocksIncrementalSnapshotStrategy(org.rocksdb.RocksDB db,
ResourceGuard rocksDBResourceGuard,
TypeSerializer<K> keySerializer,
LinkedHashMap<String,Tuple2<org.rocksdb.ColumnFamilyHandle,RegisteredStateMetaInfoBase>> kvStateInformation,
KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
LocalRecoveryConfig localRecoveryConfig,
CloseableRegistry cancelStreamRegistry,
File instanceBasePath,
UUID backendUID,
SortedMap<Long,Set<StateHandleID>> materializedSstFiles,
long lastCompletedCheckpointId) |
Modifier and Type | Class and Description |
---|---|
class |
AvroSerializer<T>
A serializer that serializes types via Avro.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
AvroTypeInfo.createSerializer(ExecutionConfig config) |
TypeSerializer<org.apache.avro.generic.GenericRecord> |
GenericRecordAvroTypeInfo.createSerializer(ExecutionConfig config) |
TypeSerializer<T> |
AvroSerializer.duplicate() |
TypeSerializer<T> |
AvroSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
TypeSerializerSchemaCompatibility<T> |
AvroSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<T> newSerializer) |
Modifier and Type | Method and Description |
---|---|
<T> TypeSerializer<T> |
AvroKryoSerializerUtils.createAvroSerializer(Class<T> type) |
Modifier and Type | Class and Description |
---|---|
static class |
LongValueWithProperHashCode.LongValueWithProperHashCodeSerializer
Serializer for
LongValueWithProperHashCode . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<LongValueWithProperHashCode> |
LongValueWithProperHashCode.LongValueWithProperHashCodeTypeInfo.createSerializer(ExecutionConfig executionConfig) |
Modifier and Type | Class and Description |
---|---|
class |
ByteValueArraySerializer
Specialized serializer for
ByteValueArray . |
class |
CharValueArraySerializer
Specialized serializer for
CharValueArray . |
class |
DoubleValueArraySerializer
Specialized serializer for
DoubleValueArray . |
class |
FloatValueArraySerializer
Specialized serializer for
FloatValueArray . |
class |
IntValueArraySerializer
Specialized serializer for
IntValueArray . |
class |
LongValueArraySerializer
Specialized serializer for
LongValueArray . |
class |
NullValueArraySerializer
Specialized serializer for
NullValueArray . |
class |
ShortValueArraySerializer
Specialized serializer for
ShortValueArray . |
class |
StringValueArraySerializer
Specialized serializer for
StringValueArray . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<ValueArray<T>> |
ValueArrayTypeInfo.createSerializer(ExecutionConfig executionConfig) |
Constructor and Description |
---|
HadoopTupleUnwrappingIterator(TypeSerializer<KEY> keySerializer) |
Modifier and Type | Class and Description |
---|---|
class |
VoidNamespaceSerializer
Serializer for
VoidNamespace . |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<VoidNamespace> |
VoidNamespaceTypeInfo.createSerializer(ExecutionConfig config) |
Modifier and Type | Method and Description |
---|---|
static <K,N> Tuple2<K,N> |
KvStateSerializer.deserializeKeyAndNamespace(byte[] serializedKeyAndNamespace,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer)
Deserializes the key and namespace into a
Tuple2 . |
static <K,N> Tuple2<K,N> |
KvStateSerializer.deserializeKeyAndNamespace(byte[] serializedKeyAndNamespace,
TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer)
Deserializes the key and namespace into a
Tuple2 . |
static <T> List<T> |
KvStateSerializer.deserializeList(byte[] serializedValue,
TypeSerializer<T> serializer)
Deserializes all values with the given serializer.
|
static <UK,UV> Map<UK,UV> |
KvStateSerializer.deserializeMap(byte[] serializedValue,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Deserializes all kv pairs with the given serializer.
|
static <UK,UV> Map<UK,UV> |
KvStateSerializer.deserializeMap(byte[] serializedValue,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Deserializes all kv pairs with the given serializer.
|
static <T> T |
KvStateSerializer.deserializeValue(byte[] serializedValue,
TypeSerializer<T> serializer)
Deserializes the value with the given serializer.
|
static <K,N> byte[] |
KvStateSerializer.serializeKeyAndNamespace(K key,
TypeSerializer<K> keySerializer,
N namespace,
TypeSerializer<N> namespaceSerializer)
Serializes the key and namespace into a
ByteBuffer . |
static <K,N> byte[] |
KvStateSerializer.serializeKeyAndNamespace(K key,
TypeSerializer<K> keySerializer,
N namespace,
TypeSerializer<N> namespaceSerializer)
Serializes the key and namespace into a
ByteBuffer . |
static <UK,UV> byte[] |
KvStateSerializer.serializeMap(Iterable<Map.Entry<UK,UV>> entries,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Serializes all values of the Iterable with the given serializer.
|
static <UK,UV> byte[] |
KvStateSerializer.serializeMap(Iterable<Map.Entry<UK,UV>> entries,
TypeSerializer<UK> keySerializer,
TypeSerializer<UV> valueSerializer)
Serializes all values of the Iterable with the given serializer.
|
static <T> byte[] |
KvStateSerializer.serializeValue(T value,
TypeSerializer<T> serializer)
Serializes the value with the given serializer.
|
Constructor and Description |
---|
ChannelReaderInputViewIterator(BlockChannelReader<MemorySegment> reader,
LinkedBlockingQueue<MemorySegment> returnQueue,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
ChannelReaderInputViewIterator(ChannelReaderInputView inView,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors) |
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
LinkedBlockingQueue<MemorySegment> returnQueue,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
List<MemorySegment> segments,
List<MemorySegment> freeMemTarget,
TypeSerializer<E> accessors,
int numBlocks) |
InputViewIterator(DataInputView inputView,
TypeSerializer<E> serializer) |
Constructor and Description |
---|
HashPartitionIterator(Iterator<HashPartition<BT,PT>> partitions,
TypeSerializer<BT> serializer) |
WorksetUpdateOutputCollector(DataOutputView outputView,
TypeSerializer<T> serializer) |
WorksetUpdateOutputCollector(DataOutputView outputView,
TypeSerializer<T> serializer,
Collector<T> delegate) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<BT> |
MutableHashTable.buildSideSerializer
The utilities to serialize the build side data types.
|
protected TypeSerializer<T> |
AbstractMutableHashTable.buildSideSerializer
The utilities to serialize the build side data types.
|
protected TypeSerializer<V2> |
NonReusingBuildFirstHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V1> |
ReusingBuildSecondHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V2> |
ReusingBuildFirstHashJoinIterator.probeSideSerializer |
protected TypeSerializer<V1> |
NonReusingBuildSecondHashJoinIterator.probeSideSerializer |
protected TypeSerializer<PT> |
MutableHashTable.probeSideSerializer
The utilities to serialize the probe side data types.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
AbstractMutableHashTable.getBuildSideSerializer() |
Modifier and Type | Method and Description |
---|---|
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
HashJoinIteratorBase.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBloomFilters) |
<BT,PT> MutableHashTable<BT,PT> |
HashJoinIteratorBase.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBloomFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(TypeSerializer<BT> buildSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
Constructor and Description |
---|
AbstractMutableHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator) |
CompactingHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator,
List<MemorySegment> memorySegments) |
CompactingHashTable(TypeSerializer<T> buildSideSerializer,
TypeComparator<T> buildSideComparator,
List<MemorySegment> memorySegments,
int avgRecordLen) |
InMemoryPartition(TypeSerializer<T> serializer,
int partitionNumber,
ListMemorySegmentSource memSource,
int pageSize,
int pageSizeInBits)
Creates a new partition, in memory, with one buffer.
|
InPlaceMutableHashTable(TypeSerializer<T> serializer,
TypeComparator<T> comparator,
List<MemorySegment> memory) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
int avgRecordLen,
boolean useBloomFilters) |
MutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
int avgRecordLen,
boolean useBloomFilters) |
NonReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReOpenableMutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBitmapFilters) |
ReOpenableMutableHashTable(TypeSerializer<BT> buildSideSerializer,
TypeSerializer<PT> probeSideSerializer,
TypeComparator<BT> buildSideComparator,
TypeComparator<PT> probeSideComparator,
TypePairComparator<PT,BT> comparator,
List<MemorySegment> memorySegments,
IOManager ioManager,
boolean useBitmapFilters) |
ReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondReOpenableHashJoinIterator(MutableObjectIterator<V1> firstInput,
MutableObjectIterator<V2> secondInput,
TypeSerializer<V1> serializer1,
TypeComparator<V1> comparator1,
TypeSerializer<V2> serializer2,
TypeComparator<V2> comparator2,
TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<T> |
SpillingResettableMutableObjectIterator.serializer |
protected TypeSerializer<T> |
SpillingResettableIterator.serializer |
Constructor and Description |
---|
OutputCollector(List<RecordWriter<SerializationDelegate<T>>> writers,
TypeSerializer<T> serializer)
Initializes the output collector with a set of writers.
|
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<E> |
UnilateralSortMerger.SpillingThread.serializer |
protected TypeSerializer<T1> |
AbstractMergeIterator.serializer1 |
protected TypeSerializer<T2> |
AbstractMergeIterator.serializer2 |
Modifier and Type | Method and Description |
---|---|
protected <T> T |
NonReusingMergeInnerJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected abstract <T> T |
AbstractMergeIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse)
Copies an instance of the given type, potentially reusing the object passed as the reuse parameter, which may be null.
|
protected <T> T |
NonReusingMergeOuterJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> T |
ReusingMergeInnerJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> T |
ReusingMergeOuterJoinIterator.createCopy(TypeSerializer<T> serializer,
T value,
T reuse) |
protected <T> KeyGroupedIterator<T> |
NonReusingMergeInnerJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected abstract <T> KeyGroupedIterator<T> |
AbstractMergeIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
NonReusingMergeOuterJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
ReusingMergeInnerJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected <T> KeyGroupedIterator<T> |
ReusingMergeOuterJoinIterator.createKeyGroupedIterator(MutableObjectIterator<T> input,
TypeSerializer<T> serializer,
TypeComparator<T> comparator) |
protected UnilateralSortMerger.ThreadBase<E> |
UnilateralSortMerger.getReadingThread(ExceptionHandler<IOException> exceptionHandler,
MutableObjectIterator<E> reader,
UnilateralSortMerger.CircularQueues<E> queues,
LargeRecordHandler<E> largeRecordHandler,
AbstractInvokable parentTask,
TypeSerializer<E> serializer,
long startSpillingBytes)
Creates the reading thread.
|
Constructor and Description |
---|
ReaderIterator(MutableReader<DeserializationDelegate<T>> reader,
TypeSerializer<T> serializer)
Creates a new iterator, wrapping the given reader.
|
Constructor and Description |
---|
NonReusingDeserializationDelegate(TypeSerializer<T> serializer) |
ReusingDeserializationDelegate(TypeSerializer<T> serializer) |
SerializationDelegate(TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<K> |
KvStateInfo.getKeySerializer() |
TypeSerializer<N> |
KvStateInfo.getNamespaceSerializer() |
TypeSerializer<V> |
KvStateInfo.getStateValueSerializer() |
Constructor and Description |
---|
KvStateInfo(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateValueSerializer) |
KvStateInfo(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateValueSerializer) |
KvStateInfo(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
TypeSerializer<V> stateValueSerializer) |
Modifier and Type | Class and Description |
---|---|
class |
ArrayListSerializer<T> |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
AbstractKeyedStateBackend.keySerializer
TypeSerializer for our key. |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<VoidNamespace> |
VoidNamespaceTypeInfo.createSerializer(ExecutionConfig config) |
abstract TypeSerializer<T> |
StateSerializerProvider.currentSchemaSerializer()
Gets the serializer that recognizes the current serialization schema of the state.
|
TypeSerializer<ArrayList<T>> |
ArrayListSerializer.duplicate() |
TypeSerializer<T> |
ArrayListSerializer.getElementSerializer() |
TypeSerializer<T> |
RegisteredPriorityQueueStateBackendMetaInfo.getElementSerializer() |
TypeSerializer<K> |
RegisteredBroadcastStateBackendMetaInfo.getKeySerializer() |
TypeSerializer<K> |
AbstractKeyedStateBackend.getKeySerializer() |
TypeSerializer<N> |
RegisteredKeyValueStateBackendMetaInfo.getNamespaceSerializer() |
TypeSerializer<S> |
RegisteredOperatorStateBackendMetaInfo.getPartitionStateSerializer() |
TypeSerializer<T> |
RegisteredPriorityQueueStateBackendMetaInfo.getPreviousElementSerializer() |
TypeSerializer<K> |
RegisteredBroadcastStateBackendMetaInfo.getPreviousKeySerializer() |
TypeSerializer<N> |
RegisteredKeyValueStateBackendMetaInfo.getPreviousNamespaceSerializer() |
TypeSerializer<S> |
RegisteredOperatorStateBackendMetaInfo.getPreviousPartitionStateSerializer() |
TypeSerializer<S> |
RegisteredKeyValueStateBackendMetaInfo.getPreviousStateSerializer() |
TypeSerializer<V> |
RegisteredBroadcastStateBackendMetaInfo.getPreviousValueSerializer() |
TypeSerializer<S> |
RegisteredKeyValueStateBackendMetaInfo.getStateSerializer() |
TypeSerializer<V> |
RegisteredBroadcastStateBackendMetaInfo.getValueSerializer() |
abstract TypeSerializer<T> |
StateSerializerProvider.previousSchemaSerializer()
Gets the serializer that recognizes the previous serialization schema of the state.
|
TypeSerializer<ArrayList<T>> |
ArrayListSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
<N,S extends State,T> |
KeyedStateBackend.applyToAllKeys(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,T> stateDescriptor,
KeyedStateFunction<K,S> function)
Applies the provided
KeyedStateFunction to the state with the provided
StateDescriptor of all the currently active keys. |
<N,S extends State,T> |
AbstractKeyedStateBackend.applyToAllKeys(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,T> stateDescriptor,
KeyedStateFunction<K,S> function) |
<T extends HeapPriorityQueueElement & PriorityComparable & Keyed> |
PriorityQueueSetFactory.create(String stateName,
TypeSerializer<T> byteOrderedElementSerializer)
Creates a
KeyGroupedInternalPriorityQueue . |
default <N,SV,S extends State,IS extends S> |
KeyedStateFactory.createInternalState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,SV> stateDesc)
Creates and returns a new
InternalKvState . |
<N,SV,SEV,S extends State,IS extends S> |
KeyedStateFactory.createInternalState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,SV> stateDesc,
StateSnapshotTransformer.StateSnapshotTransformFactory<SEV> snapshotTransformFactory)
Creates and returns a new
InternalKvState . |
default <K> AbstractKeyedStateBackend<K> |
StateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry)
Creates a new
AbstractKeyedStateBackend that is responsible for holding keyed state
and checkpointing it. |
default <K> AbstractKeyedStateBackend<K> |
StateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider)
Creates a new
AbstractKeyedStateBackend that is responsible for holding keyed state
and checkpointing it. |
<K> AbstractKeyedStateBackend<K> |
StateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup)
Creates a new
AbstractKeyedStateBackend that is responsible for holding keyed state
and checkpointing it. |
abstract <K> AbstractKeyedStateBackend<K> |
AbstractStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup) |
static <T> StateSerializerProvider<T> |
StateSerializerProvider.fromNewState(TypeSerializer<T> registeredStateSerializer)
Creates a
StateSerializerProvider for new state from the registered state serializer. |
<N,S extends State,T> |
KeyedStateBackend.getOrCreateKeyedState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,T> stateDescriptor)
Creates or retrieves a keyed state backed by this state backend.
|
<N,S extends State,V> |
AbstractKeyedStateBackend.getOrCreateKeyedState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,V> stateDescriptor) |
<N,S extends State> |
KeyedStateBackend.getPartitionedState(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor)
Creates or retrieves a partitioned state backed by this state backend.
|
<N,S extends State> |
AbstractKeyedStateBackend.getPartitionedState(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor)
TODO: NOTE: This method does a lot of work caching / retrieving states just to update the namespace.
|
abstract TypeSerializerSchemaCompatibility<T> |
StateSerializerProvider.registerNewSerializerForRestoredState(TypeSerializer<T> newSerializer)
For restored state, register a new serializer that potentially has a new serialization schema.
|
TypeSerializerSchemaCompatibility<ArrayList<T>> |
ArrayListSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<ArrayList<T>> newSerializer) |
TypeSerializerSchemaCompatibility<T> |
RegisteredPriorityQueueStateBackendMetaInfo.updateElementSerializer(TypeSerializer<T> newElementSerializer) |
TypeSerializerSchemaCompatibility<K> |
RegisteredBroadcastStateBackendMetaInfo.updateKeySerializer(TypeSerializer<K> newKeySerializer) |
TypeSerializerSchemaCompatibility<N> |
RegisteredKeyValueStateBackendMetaInfo.updateNamespaceSerializer(TypeSerializer<N> newNamespaceSerializer) |
TypeSerializerSchemaCompatibility<S> |
RegisteredOperatorStateBackendMetaInfo.updatePartitionStateSerializer(TypeSerializer<S> newPartitionStateSerializer) |
TypeSerializerSchemaCompatibility<S> |
RegisteredKeyValueStateBackendMetaInfo.updateStateSerializer(TypeSerializer<S> newStateSerializer) |
TypeSerializerSchemaCompatibility<V> |
RegisteredBroadcastStateBackendMetaInfo.updateValueSerializer(TypeSerializer<V> newValueSerializer) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
FsStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
AbstractHeapState.keySerializer |
protected TypeSerializer<N> |
AbstractHeapState.namespaceSerializer |
protected TypeSerializer<SV> |
AbstractHeapState.valueSerializer |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<K> |
InternalKeyContext.getKeySerializer()
TypeSerializer for the state backend key type. |
TypeSerializer<N> |
StateTable.getNamespaceSerializer() |
TypeSerializer<N> |
CopyOnWriteStateTable.getNamespaceSerializer() |
TypeSerializer<S> |
StateTable.getStateSerializer() |
TypeSerializer<S> |
CopyOnWriteStateTable.getStateSerializer() |
Modifier and Type | Method and Description |
---|---|
<N,S extends State,T> |
HeapKeyedStateBackend.applyToAllKeys(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,T> stateDescriptor,
KeyedStateFunction<K,S> function) |
<T extends HeapPriorityQueueElement & PriorityComparable & Keyed> |
HeapKeyedStateBackend.create(String stateName,
TypeSerializer<T> byteOrderedElementSerializer) |
<T extends HeapPriorityQueueElement & PriorityComparable & Keyed> |
HeapPriorityQueueSetFactory.create(String stateName,
TypeSerializer<T> byteOrderedElementSerializer) |
<N,SV,SEV,S extends State,IS extends S> |
HeapKeyedStateBackend.createInternalState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,SV> stateDesc,
StateSnapshotTransformer.StateSnapshotTransformFactory<SEV> snapshotTransformFactory) |
HeapPriorityQueueSnapshotRestoreWrapper<T> |
HeapPriorityQueueSnapshotRestoreWrapper.forUpdatedSerializer(TypeSerializer<T> updatedSerializer)
Returns a deep copy of the snapshot, where the serializer is changed to the given serializer.
|
byte[] |
AbstractHeapState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<SV> safeValueSerializer) |
byte[] |
AbstractHeapState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<SV> safeValueSerializer) |
byte[] |
AbstractHeapState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<SV> safeValueSerializer) |
Constructor and Description |
---|
HeapKeyedStateBackend(TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
ClassLoader userCodeClassLoader,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
boolean asynchronousSnapshots,
ExecutionConfig executionConfig,
LocalRecoveryConfig localRecoveryConfig,
HeapPriorityQueueSetFactory priorityQueueSetFactory,
TtlTimeProvider ttlTimeProvider) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<K> |
InternalKvState.getKeySerializer()
Returns the
TypeSerializer for the type of key this state is associated to. |
TypeSerializer<N> |
InternalKvState.getNamespaceSerializer()
Returns the
TypeSerializer for the type of namespace this state is associated to. |
TypeSerializer<V> |
InternalKvState.getValueSerializer()
Returns the
TypeSerializer for the type of value this state holds. |
Modifier and Type | Method and Description |
---|---|
byte[] |
InternalKvState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer)
Returns the serialized value for the given key and namespace.
|
byte[] |
InternalKvState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer)
Returns the serialized value for the given key and namespace.
|
byte[] |
InternalKvState.getSerializedValue(byte[] serializedKeyAndNamespace,
TypeSerializer<K> safeKeySerializer,
TypeSerializer<N> safeNamespaceSerializer,
TypeSerializer<V> safeValueSerializer)
Returns the serialized value for the given key and namespace.
|
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
MemoryStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<?> |
StateMetaInfoSnapshot.getTypeSerializer(String key)
TODO this method should be removed once the serializer map is removed.
|
Constructor and Description |
---|
StateMetaInfoSnapshot(String name,
StateMetaInfoSnapshot.BackendStateType backendStateType,
Map<String,String> options,
Map<String,TypeSerializerSnapshot<?>> serializerSnapshots,
Map<String,TypeSerializer<?>> serializers)
TODO this variant, which requires providing the serializers,
TODO should actually be removed, leaving only
StateMetaInfoSnapshot.StateMetaInfoSnapshot(String, BackendStateType, Map, Map) . |
Modifier and Type | Class and Description |
---|---|
static class |
TtlStateFactory.TtlSerializer<T>
Serializer for user state value with TTL.
|
Modifier and Type | Method and Description |
---|---|
protected CompositeSerializer<TtlValue<T>> |
TtlStateFactory.TtlSerializer.createSerializerInstance(CompositeSerializer.PrecomputedParameters precomputed,
TypeSerializer<?>... originalSerializers) |
static <N,SV,S extends State,IS extends S> |
TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,SV> stateDesc,
KeyedStateFactory originalStateFactory,
TtlTimeProvider timeProvider) |
Constructor and Description |
---|
TtlSerializer(CompositeSerializer.PrecomputedParameters precomputed,
TypeSerializer<?>... fieldSerializers) |
TtlSerializer(TypeSerializer<T> userValueSerializer) |
Constructor and Description |
---|
NonReusingMutableToRegularIteratorWrapper(MutableObjectIterator<T> source,
TypeSerializer<T> serializer) |
RegularToMutableObjectIterator(Iterator<T> iterator,
TypeSerializer<T> serializer) |
ReusingKeyGroupedIterator(MutableObjectIterator<E> iterator,
TypeSerializer<E> serializer,
TypeComparator<E> comparator)
Initializes the KeyGroupedIterator.
|
ReusingMutableToRegularIteratorWrapper(MutableObjectIterator<T> source,
TypeSerializer<T> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<K> |
QueryableStateStream.getKeySerializer()
Returns the key serializer for the queryable state instance.
|
Constructor and Description |
---|
QueryableStateStream(String queryableStateName,
StateDescriptor<?,V> stateDescriptor,
TypeSerializer<K> keySerializer)
Creates a queryable state stream.
|
UnionSerializerConfigSnapshot(TypeSerializer<T1> oneSerializer,
TypeSerializer<T2> twoSerializer) |
UnionSerializerConfigSnapshot(TypeSerializer<T1> oneSerializer,
TypeSerializer<T2> twoSerializer) |
Modifier and Type | Class and Description |
---|---|
static class |
TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>
Custom
TypeSerializer for the sink state. |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>> |
TwoPhaseCommitSinkFunction.StateSerializer.duplicate() |
Constructor and Description |
---|
StateSerializer(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer) |
StateSerializer(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer) |
StateSerializerConfigSnapshot(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer) |
StateSerializerConfigSnapshot(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer) |
TwoPhaseCommitSinkFunction(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer)
Use default
ListStateDescriptor for internal state serialization. |
TwoPhaseCommitSinkFunction(TypeSerializer<TXN> transactionSerializer,
TypeSerializer<CONTEXT> contextSerializer)
Use default
ListStateDescriptor for internal state serialization. |
Constructor and Description |
---|
FromElementsFunction(TypeSerializer<T> serializer,
Iterable<T> elements) |
FromElementsFunction(TypeSerializer<T> serializer,
T... elements) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<?> |
StreamNode.getStateKeySerializer() |
<K> TypeSerializer<K> |
StreamConfig.getStateKeySerializer(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerIn1() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerIn1(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerIn2() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerIn2(ClassLoader cl) |
TypeSerializer<?> |
StreamNode.getTypeSerializerOut() |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerOut(ClassLoader cl) |
<T> TypeSerializer<T> |
StreamConfig.getTypeSerializerSideOut(OutputTag<?> outputTag,
ClassLoader cl) |
Modifier and Type | Method and Description |
---|---|
void |
StreamGraph.setOneInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector,
TypeSerializer<?> keySerializer) |
void |
StreamNode.setSerializerIn1(TypeSerializer<?> typeSerializerIn1) |
void |
StreamNode.setSerializerIn2(TypeSerializer<?> typeSerializerIn2) |
void |
StreamNode.setSerializerOut(TypeSerializer<?> typeSerializerOut) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamGraph.setSerializers(Integer vertexID,
TypeSerializer<?> in1,
TypeSerializer<?> in2,
TypeSerializer<?> out) |
void |
StreamNode.setStateKeySerializer(TypeSerializer<?> stateKeySerializer) |
void |
StreamConfig.setStateKeySerializer(TypeSerializer<?> serializer) |
void |
StreamGraph.setTwoInputStateKey(Integer vertexID,
KeySelector<?,?> keySelector1,
KeySelector<?,?> keySelector2,
TypeSerializer<?> keySerializer) |
void |
StreamConfig.setTypeSerializerIn1(TypeSerializer<?> serializer) |
void |
StreamConfig.setTypeSerializerIn2(TypeSerializer<?> serializer) |
void |
StreamConfig.setTypeSerializerOut(TypeSerializer<?> serializer) |
void |
StreamConfig.setTypeSerializerSideOut(OutputTag<?> outputTag,
TypeSerializer<?> serializer) |
Modifier and Type | Class and Description |
---|---|
static class |
InternalTimersSnapshotReaderWriters.LegacyTimerSerializer<K,N>
A
TypeSerializer used to serialize/deserialize a TimerHeapInternalTimer . |
class |
TimerSerializer<K,N>
A serializer for
TimerHeapInternalTimer objects that produces a serialization format that is
lexicographically aligned the priority of the timers. |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<TimerHeapInternalTimer<K,N>> |
InternalTimersSnapshotReaderWriters.LegacyTimerSerializer.duplicate() |
TypeSerializer<K> |
TimerSerializer.getKeySerializer() |
TypeSerializer<K> |
InternalTimersSnapshot.getKeySerializer() |
TypeSerializer<N> |
TimerSerializer.getNamespaceSerializer() |
TypeSerializer<N> |
InternalTimersSnapshot.getNamespaceSerializer() |
Modifier and Type | Method and Description |
---|---|
<K,N> InternalTimerService<N> |
AbstractStreamOperator.getInternalTimerService(String name,
TypeSerializer<N> namespaceSerializer,
Triggerable<K,N> triggerable)
Returns a
InternalTimerService that can be used to query current processing time
and event time and to set timers. |
protected <N,S extends State,T> |
AbstractStreamOperator.getOrCreateKeyedState(TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,T> stateDescriptor) |
protected <S extends State,N> |
AbstractStreamOperator.getPartitionedState(N namespace,
TypeSerializer<N> namespaceSerializer,
StateDescriptor<S,?> stateDescriptor)
Creates a partitioned state handle, using the state backend configured for this task.
|
protected <K> AbstractKeyedStateBackend<K> |
StreamTaskStateInitializerImpl.keyedStatedBackend(TypeSerializer<K> keySerializer,
String operatorIdentifierText,
PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates,
CloseableRegistry backendCloseableRegistry,
MetricGroup metricGroup) |
void |
InternalTimersSnapshot.setKeySerializer(TypeSerializer<K> keySerializer) |
void |
InternalTimersSnapshot.setNamespaceSerializer(TypeSerializer<N> namespaceSerializer) |
void |
InternalTimerServiceImpl.startTimerService(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
Triggerable<K,N> triggerTarget)
Starts the local
InternalTimerServiceImpl by:
Setting the keySerialized and namespaceSerializer for the timers it will contain.
Setting the triggerTarget which contains the action to be performed when a timer fires.
Re-registering timers that were retrieved after recovering from a node failure, if any.
This method can be called multiple times, as long as it is called with the same serializers. |
void |
InternalTimerServiceImpl.startTimerService(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer,
Triggerable<K,N> triggerTarget)
Starts the local
InternalTimerServiceImpl by:
Setting the keySerialized and namespaceSerializer for the timers it will contain.
Setting the triggerTarget which contains the action to be performed when a timer fires.
Re-registering timers that were retrieved after recovering from a node failure, if any.
This method can be called multiple times, as long as it is called with the same serializers. |
StreamOperatorStateContext |
StreamTaskStateInitializerImpl.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup) |
StreamOperatorStateContext |
StreamTaskStateInitializer.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup)
Returns the
StreamOperatorStateContext for an AbstractStreamOperator that runs in the stream
task that owns this manager. |
Constructor and Description |
---|
InternalTimersSnapshot(TypeSerializer<K> keySerializer,
TypeSerializerSnapshot<K> keySerializerConfigSnapshot,
TypeSerializer<N> namespaceSerializer,
TypeSerializerSnapshot<N> namespaceSerializerConfigSnapshot,
Set<TimerHeapInternalTimer<K,N>> eventTimeTimers,
Set<TimerHeapInternalTimer<K,N>> processingTimeTimers)
Constructor to use when snapshotting the timers.
|
InternalTimersSnapshot(TypeSerializer<K> keySerializer,
TypeSerializerSnapshot<K> keySerializerConfigSnapshot,
TypeSerializer<N> namespaceSerializer,
TypeSerializerSnapshot<N> namespaceSerializerConfigSnapshot,
Set<TimerHeapInternalTimer<K,N>> eventTimeTimers,
Set<TimerHeapInternalTimer<K,N>> processingTimeTimers)
Constructor to use when snapshotting the timers.
|
StreamGroupedReduce(ReduceFunction<IN> reducer,
TypeSerializer<IN> serializer) |
StreamProject(int[] fields,
TypeSerializer<OUT> outSerializer) |
TimerSerializerConfigSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer) |
TimerSerializerConfigSnapshot(TypeSerializer<K> keySerializer,
TypeSerializer<N> namespaceSerializer) |
Constructor and Description |
---|
BufferSerializerConfigSnapshot(TypeSerializer<T> userTypeSerializer) |
IntervalJoinOperator(long lowerBound,
long upperBound,
boolean lowerBoundInclusive,
boolean upperBoundInclusive,
TypeSerializer<T1> leftTypeSerializer,
TypeSerializer<T2> rightTypeSerializer,
ProcessJoinFunction<T1,T2,OUT> udf)
Creates a new IntervalJoinOperator.
|
IntervalJoinOperator(long lowerBound,
long upperBound,
boolean lowerBoundInclusive,
boolean upperBoundInclusive,
TypeSerializer<T1> leftTypeSerializer,
TypeSerializer<T2> rightTypeSerializer,
ProcessJoinFunction<T1,T2,OUT> udf)
Creates a new IntervalJoinOperator.
|
Modifier and Type | Method and Description |
---|---|
static <T,W extends Window> |
DeltaTrigger.of(double threshold,
DeltaFunction<T> deltaFunction,
TypeSerializer<T> stateSerializer)
Creates a delta trigger from the given threshold and
DeltaFunction . |
Modifier and Type | Class and Description |
---|---|
static class |
GlobalWindow.Serializer
A
TypeSerializer for GlobalWindow . |
static class |
TimeWindow.Serializer
The serializer used to write the TimeWindow type.
|
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<IN> |
CassandraSink.CassandraSinkBuilder.serializer |
Constructor and Description |
---|
CassandraPojoSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraRowSinkBuilder(DataStream<Row> input,
TypeInformation<Row> typeInfo,
TypeSerializer<Row> serializer) |
CassandraRowWriteAheadSink(String insertQuery,
TypeSerializer<Row> serializer,
ClusterBuilder builder,
CheckpointCommitter committer) |
CassandraScalaProductSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraTupleSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraTupleWriteAheadSink(String insertQuery,
TypeSerializer<IN> serializer,
ClusterBuilder builder,
CheckpointCommitter committer) |
Modifier and Type | Class and Description |
---|---|
static class |
FlinkKafkaProducer.ContextStateSerializer
|
static class |
FlinkKafkaProducer.TransactionStateSerializer
TypeSerializer for
FlinkKafkaProducer.KafkaTransactionState . |
static class |
FlinkKafkaProducer011.ContextStateSerializer
|
static class |
FlinkKafkaProducer011.TransactionStateSerializer
TypeSerializer for
KafkaTransactionState . |
Constructor and Description |
---|
CollectSink(InetAddress hostIp,
int port,
TypeSerializer<IN> serializer)
Creates a CollectSink that will send the data to the specified host.
|
SocketStreamIterator(int port,
InetAddress address,
TypeSerializer<T> serializer)
Creates an iterator that returns the data from a socket stream with custom port and bind address.
|
SocketStreamIterator(TypeSerializer<T> serializer)
Creates an iterator that returns the data from a socket stream with automatic port and bind address.
|
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<IN> |
GenericWriteAheadSink.serializer |
Constructor and Description |
---|
GenericWriteAheadSink(CheckpointCommitter committer,
TypeSerializer<IN> serializer,
String jobID) |
Modifier and Type | Field and Description |
---|---|
protected TypeSerializer<K> |
WindowOperator.keySerializer
For serializing the key in checkpoints.
|
protected TypeSerializer<W> |
WindowOperator.windowSerializer
For serializing the window in checkpoints.
|
Constructor and Description |
---|
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness,
OutputTag<IN> lateDataOutputTag) |
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness,
OutputTag<IN> lateDataOutputTag) |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness,
OutputTag<IN> lateDataOutputTag)
Creates a new
WindowOperator based on the given policies and user functions. |
WindowOperator(WindowAssigner<? super IN,W> windowAssigner,
TypeSerializer<W> windowSerializer,
KeySelector<IN,K> keySelector,
TypeSerializer<K> keySerializer,
StateDescriptor<? extends AppendingState<IN,ACC>,?> windowStateDescriptor,
InternalWindowFunction<ACC,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
long allowedLateness,
OutputTag<IN> lateDataOutputTag)
Creates a new
WindowOperator based on the given policies and user functions. |
Modifier and Type | Class and Description |
---|---|
class |
StreamElementSerializer<T>
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
StreamElementSerializer.getContainedTypeSerializer() |
Constructor and Description |
---|
StreamElementSerializer(TypeSerializer<T> serializer) |
StreamElementSerializerConfigSnapshot(TypeSerializer<T> typeSerializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<T> |
SingleThreadAccessCheckingTypeInfo.createSerializer(ExecutionConfig config) |
Modifier and Type | Class and Description |
---|---|
class |
StatefulComplexPayloadSerializer
A custom stateful serializer to test that serializers are not used concurrently.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<ComplexPayload> |
StatefulComplexPayloadSerializer.duplicate() |
Constructor and Description |
---|
ArtificialMapStateBuilder(String stateName,
JoinFunction<IN,Iterator<Map.Entry<K,V>>,Iterator<Map.Entry<K,V>>> stateValueGenerator,
TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer) |
ArtificialMapStateBuilder(String stateName,
JoinFunction<IN,Iterator<Map.Entry<K,V>>,Iterator<Map.Entry<K,V>>> stateValueGenerator,
TypeSerializer<K> keySerializer,
TypeSerializer<V> valueSerializer) |
Modifier and Type | Class and Description |
---|---|
static class |
ValueWithTs.Serializer
Serializer for Serializer.
|
Modifier and Type | Method and Description |
---|---|
TypeSerializer<UV> |
TtlStateVerifier.getUpdateSerializer() |
Modifier and Type | Method and Description |
---|---|
protected CompositeSerializer<ValueWithTs<?>> |
ValueWithTs.Serializer.createSerializerInstance(CompositeSerializer.PrecomputedParameters precomputed,
TypeSerializer<?>... originalSerializers) |
Constructor and Description |
---|
Serializer(TypeSerializer<?> userValueSerializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<Row> |
CollectBatchTableSink.getSerializer()
Returns the serializer for deserializing the collected result.
|
Constructor and Description |
---|
CollectBatchTableSink(String accumulatorName,
TypeSerializer<Row> serializer) |
CollectStreamTableSink(InetAddress targetAddress,
int targetPort,
TypeSerializer<Tuple2<Boolean,Row>> serializer) |
Modifier and Type | Method and Description |
---|---|
TypeSerializer<org.apache.flink.table.api.dataview.ListView<T>> |
ListViewSerializerSnapshot.restoreSerializer() |
TypeSerializer<org.apache.flink.table.api.dataview.MapView<K,V>> |
MapViewSerializerSnapshot.restoreSerializer() |
Modifier and Type | Method and Description |
---|---|
TypeSerializerSchemaCompatibility<org.apache.flink.table.api.dataview.ListView<T>> |
ListViewSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<org.apache.flink.table.api.dataview.ListView<T>> newSerializer) |
TypeSerializerSchemaCompatibility<org.apache.flink.table.api.dataview.MapView<K,V>> |
MapViewSerializerSnapshot.resolveSchemaCompatibility(TypeSerializer<org.apache.flink.table.api.dataview.MapView<K,V>> newSerializer) |
Constructor and Description |
---|
ListViewSerializerSnapshot(TypeSerializer<List<T>> listSerializer)
Constructor to create the snapshot for writing.
|
MapViewSerializerSnapshot(TypeSerializer<Map<K,V>> mapSerializer)
Constructor to create the snapshot for writing.
|
Modifier and Type | Method and Description |
---|---|
static <L,R> Either.Left<L,R> |
Either.obtainLeft(Either<L,R> input,
TypeSerializer<L> leftSerializer)
Utility function for
EitherSerializer to support object reuse. |
static <L,R> Either.Right<L,R> |
Either.obtainRight(Either<L,R> input,
TypeSerializer<R> rightSerializer)
Utility function for
EitherSerializer to support object reuse. |
Modifier and Type | Method and Description |
---|---|
static <T> T |
InstantiationUtil.deserializeFromByteArray(TypeSerializer<T> serializer,
byte[] buf) |
static <T> T |
InstantiationUtil.deserializeFromByteArray(TypeSerializer<T> serializer,
T reuse,
byte[] buf) |
static <T> byte[] |
InstantiationUtil.serializeToByteArray(TypeSerializer<T> serializer,
T record) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.