Package | Description |
---|---|
org.apache.flink.contrib.streaming.state | |
org.apache.flink.runtime.checkpoint | |
org.apache.flink.runtime.query |
This package contains all KvState query related classes.
|
org.apache.flink.runtime.state | |
org.apache.flink.runtime.state.filesystem | |
org.apache.flink.runtime.state.filesystem.async | |
org.apache.flink.runtime.state.heap | |
org.apache.flink.runtime.state.heap.async | |
org.apache.flink.runtime.state.memory | |
org.apache.flink.runtime.state.memory.async | |
org.apache.flink.runtime.taskmanager | |
org.apache.flink.streaming.runtime.tasks |
This package contains classes that realize streaming tasks.
|
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
RocksDBStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry) |
Constructor and Description |
---|
RocksDBKeyedStateBackend(JobID jobId,
String operatorIdentifier,
ClassLoader userCodeClassLoader,
File instanceBasePath,
org.rocksdb.DBOptions dbOptions,
org.rocksdb.ColumnFamilyOptions columnFamilyOptions,
TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange) |
Modifier and Type | Method and Description |
---|---|
static List<KeyGroupRange> |
StateAssignmentOperation.createKeyGroupPartitions(int numberKeyGroups,
int parallelism)
Groups the available set of key groups into key group partitions.
|
Modifier and Type | Method and Description |
---|---|
static List<KeyGroupsStateHandle> |
StateAssignmentOperation.getKeyGroupsStateHandles(Collection<KeyGroupsStateHandle> allKeyGroupsHandles,
KeyGroupRange subtaskKeyGroupIds)
Determine the subset of
KeyGroupsStateHandles with correct
key group index for the given subtask KeyGroupRange . |
Modifier and Type | Method and Description |
---|---|
KeyGroupRange |
KvStateMessage.NotifyKvStateRegistered.getKeyGroupRange()
Returns the key group index the KvState instance belongs to.
|
KeyGroupRange |
KvStateMessage.NotifyKvStateUnregistered.getKeyGroupRange()
Returns the key group index the KvState instance belongs to.
|
Modifier and Type | Method and Description |
---|---|
void |
KvStateRegistryListener.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId)
Notifies the listener about a registered KvState instance.
|
void |
KvStateLocationRegistry.notifyKvStateRegistered(JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
KvStateServerAddress kvStateServerAddress)
Notifies the registry about a registered KvState instance.
|
void |
KvStateRegistryListener.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName)
Notifies the listener about an unregistered KvState instance.
|
void |
KvStateLocationRegistry.notifyKvStateUnregistered(JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName)
Notifies the registry about an unregistered KvState instance.
|
KvStateID |
KvStateRegistry.registerKvState(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvState<?> kvState)
Registers the KvState instance and returns the assigned ID.
|
void |
TaskKvStateRegistry.registerKvState(KeyGroupRange keyGroupRange,
String registrationName,
KvState<?> kvState)
Registers the KvState instance at the KvStateRegistry.
|
void |
KvStateRegistry.unregisterKvState(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId)
Unregisters the KvState instance identified by the given KvStateID.
|
Constructor and Description |
---|
NotifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId,
KvStateServerAddress kvStateServerAddress)
Notifies the JobManager about a registered
KvState instance. |
NotifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName)
Notifies the JobManager about an unregistered
KvState instance. |
Modifier and Type | Field and Description |
---|---|
static KeyGroupRange |
KeyGroupRange.EMPTY_KEY_GROUP_RANGE
The empty key-group
|
protected KeyGroupRange |
AbstractKeyedStateBackend.keyGroupRange
Range of key-groups for which this backend is responsible
|
Modifier and Type | Method and Description |
---|---|
static KeyGroupRange |
KeyGroupRangeAssignment.computeKeyGroupRangeForOperatorIndex(int maxParallelism,
int parallelism,
int operatorIndex)
Computes the range of key-groups that are assigned to a given operator under the given parallelism and maximum
parallelism.
|
KeyGroupRange |
KeyGroupRange.getIntersection(KeyGroupRange other)
Create a range that represent the intersection between this range and the given range.
|
KeyGroupRange |
KeyGroupRangeOffsets.getKeyGroupRange() |
KeyGroupRange |
AbstractKeyedStateBackend.getKeyGroupRange() |
static KeyGroupRange |
KeyGroupRange.of(int startKeyGroup,
int endKeyGroup)
Factory method that also handles creation of empty key-groups.
|
Modifier and Type | Method and Description |
---|---|
abstract <K> AbstractKeyedStateBackend<K> |
AbstractStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry)
Creates a new
AbstractKeyedStateBackend that is responsible for keeping keyed state
and can be checkpointed to checkpoint streams. |
KeyGroupRangeOffsets |
KeyGroupRangeOffsets.getIntersection(KeyGroupRange keyGroupRange)
Returns a key-group range with offsets which is the intersection of the internal key-group range with the given
key-group range.
|
KeyGroupRange |
KeyGroupRange.getIntersection(KeyGroupRange other)
Create a range that represent the intersection between this range and the given range.
|
KeyGroupsStateHandle |
KeyGroupsStateHandle.getKeyGroupIntersection(KeyGroupRange keyGroupRange) |
Constructor and Description |
---|
AbstractKeyedStateBackend(TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
ClassLoader userCodeClassLoader,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange) |
KeyedStateCheckpointOutputStream(CheckpointStreamFactory.CheckpointStateOutputStream delegate,
KeyGroupRange keyGroupRange) |
KeyGroupRangeOffsets(KeyGroupRange keyGroupRange)
Creates key-group range with offsets for the given key-group range, where all offsets are initially zero.
|
KeyGroupRangeOffsets(KeyGroupRange keyGroupRange,
long[] offsets)
Creates key-group range with offsets from the given key-group range.
|
StateSnapshotContextSynchronousImpl(long checkpointId,
long checkpointTimestamp,
CheckpointStreamFactory streamFactory,
KeyGroupRange keyGroupRange,
CloseableRegistry closableRegistry) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
FsStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
AsyncFsStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry) |
Modifier and Type | Field and Description |
---|---|
protected KeyGroupRange |
StateTable.keyGroupRange |
Constructor and Description |
---|
HeapKeyedStateBackend(TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
ClassLoader userCodeClassLoader,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange) |
StateTable(RegisteredBackendStateMetaInfo<N,ST> metaInfo,
KeyGroupRange keyGroupRange) |
Modifier and Type | Method and Description |
---|---|
KeyGroupRange |
InternalKeyContext.getKeyGroupRange()
Returns the key groups for this backend.
|
Constructor and Description |
---|
AsyncHeapKeyedStateBackend(TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
ClassLoader userCodeClassLoader,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
MemoryStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
AsyncMemoryStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry) |
Modifier and Type | Method and Description |
---|---|
void |
ActorGatewayKvStateRegistryListener.notifyKvStateRegistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName,
KvStateID kvStateId) |
void |
ActorGatewayKvStateRegistryListener.notifyKvStateUnregistered(JobID jobId,
JobVertexID jobVertexId,
KeyGroupRange keyGroupRange,
String registrationName) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
StreamTask.createKeyedStateBackend(TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange) |
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.