Modifier and Type | Method and Description |
---|---|
void |
StateAssignmentOperation.checkParallelismPreconditions(List<OperatorState> operatorStates,
ExecutionJobVertex executionJobVertex) |
Modifier and Type | Method and Description |
---|---|
static CompletedCheckpoint |
Checkpoints.loadAndValidateCheckpoint(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> tasks,
CompletedCheckpointStorageLocation location,
ClassLoader classLoader,
boolean allowNonRestoredState) |
boolean |
CheckpointCoordinator.restoreLatestCheckpointedState(Map<JobVertexID,ExecutionJobVertex> tasks,
boolean errorIfNoCheckpoint,
boolean allowNonRestoredState)
Restores the latest checkpointed state.
|
boolean |
CheckpointCoordinator.restoreSavepoint(String savepointPointer,
boolean allowNonRestored,
Map<JobVertexID,ExecutionJobVertex> tasks,
ClassLoader userClassLoader)
Restore the state with given savepoint.
|
Constructor and Description |
---|
CheckpointStatsTracker(int numRememberedCheckpoints,
List<ExecutionJobVertex> jobVertices,
CheckpointCoordinatorConfiguration jobCheckpointingConfiguration,
MetricGroup metricGroup)
Creates a new checkpoint stats tracker.
|
StateAssignmentOperation(long restoreCheckpointId,
Map<JobVertexID,ExecutionJobVertex> tasks,
Map<OperatorID,OperatorState> operatorStates,
boolean allowNonRestoredState) |
Modifier and Type | Method and Description |
---|---|
static Savepoint |
SavepointV2.convertToOperatorStateSavepointV2(Map<JobVertexID,ExecutionJobVertex> tasks,
Savepoint savepoint)
Deprecated.
Only kept for backwards-compatibility with versions < 1.3. Will be removed in the future.
|
Modifier and Type | Method and Description |
---|---|
ExecutionJobVertex |
ExecutionVertex.getJobVertex() |
ExecutionJobVertex |
ExecutionGraph.getJobVertex(JobVertexID id) |
ExecutionJobVertex |
IntermediateResult.getProducer() |
Modifier and Type | Method and Description |
---|---|
Map<JobVertexID,ExecutionJobVertex> |
ExecutionGraph.getAllVertices() |
Iterable<ExecutionJobVertex> |
ExecutionGraph.getVerticesTopologically() |
static Map<OperatorID,ExecutionJobVertex> |
ExecutionJobVertex.includeAlternativeOperatorIDs(Map<OperatorID,ExecutionJobVertex> operatorMapping) |
static Map<JobVertexID,ExecutionJobVertex> |
ExecutionJobVertex.includeLegacyJobVertexIDs(Map<JobVertexID,ExecutionJobVertex> tasks) |
Modifier and Type | Method and Description |
---|---|
void |
ExecutionGraph.enableCheckpointing(long interval,
long checkpointTimeout,
long minPauseBetweenCheckpoints,
int maxConcurrentCheckpoints,
CheckpointRetentionPolicy retentionPolicy,
List<ExecutionJobVertex> verticesToTrigger,
List<ExecutionJobVertex> verticesToWaitFor,
List<ExecutionJobVertex> verticesToCommitTo,
List<MasterTriggerRestoreHook<?>> masterHooks,
CheckpointIDCounter checkpointIDCounter,
CompletedCheckpointStore checkpointStore,
StateBackend checkpointStateBackend,
CheckpointStatsTracker statsTracker) |
void |
ExecutionGraph.enableCheckpointing(long interval,
long checkpointTimeout,
long minPauseBetweenCheckpoints,
int maxConcurrentCheckpoints,
CheckpointRetentionPolicy retentionPolicy,
List<ExecutionJobVertex> verticesToTrigger,
List<ExecutionJobVertex> verticesToWaitFor,
List<ExecutionJobVertex> verticesToCommitTo,
List<MasterTriggerRestoreHook<?>> masterHooks,
CheckpointIDCounter checkpointIDCounter,
CompletedCheckpointStore checkpointStore,
StateBackend checkpointStateBackend,
CheckpointStatsTracker statsTracker) |
void |
ExecutionGraph.enableCheckpointing(long interval,
long checkpointTimeout,
long minPauseBetweenCheckpoints,
int maxConcurrentCheckpoints,
CheckpointRetentionPolicy retentionPolicy,
List<ExecutionJobVertex> verticesToTrigger,
List<ExecutionJobVertex> verticesToWaitFor,
List<ExecutionJobVertex> verticesToCommitTo,
List<MasterTriggerRestoreHook<?>> masterHooks,
CheckpointIDCounter checkpointIDCounter,
CompletedCheckpointStore checkpointStore,
StateBackend checkpointStateBackend,
CheckpointStatsTracker statsTracker) |
static Map<OperatorID,ExecutionJobVertex> |
ExecutionJobVertex.includeAlternativeOperatorIDs(Map<OperatorID,ExecutionJobVertex> operatorMapping) |
static Map<JobVertexID,ExecutionJobVertex> |
ExecutionJobVertex.includeLegacyJobVertexIDs(Map<JobVertexID,ExecutionJobVertex> tasks) |
Constructor and Description |
---|
ArchivedExecutionJobVertex(ExecutionJobVertex jobVertex) |
ExecutionVertex(ExecutionJobVertex jobVertex,
int subTaskIndex,
IntermediateResult[] producedDataSets,
Time timeout,
long initialGlobalModVersion,
long createTimestamp,
int maxPriorExecutionHistoryLength)
Creates an ExecutionVertex.
|
IntermediateResult(IntermediateDataSetID id,
ExecutionJobVertex producer,
int numParallelProducers,
ResultPartitionType resultType) |
Modifier and Type | Method and Description |
---|---|
void |
RestartAllStrategy.notifyNewVertices(List<ExecutionJobVertex> newJobVerticesTopological) |
void |
RestartIndividualStrategy.notifyNewVertices(List<ExecutionJobVertex> newJobVerticesTopological) |
abstract void |
FailoverStrategy.notifyNewVertices(List<ExecutionJobVertex> newJobVerticesTopological)
Called whenever new vertices are added to the ExecutionGraph.
|
void |
RestartPipelinedRegionStrategy.notifyNewVertices(List<ExecutionJobVertex> newJobVerticesTopological) |
Constructor and Description |
---|
KvStateLocationRegistry(JobID jobId,
Map<JobVertexID,ExecutionJobVertex> jobVertices)
Creates the registry for the job.
|
Modifier and Type | Method and Description |
---|---|
Optional<OperatorBackPressureStats> |
BackPressureStatsTrackerImpl.getOperatorBackPressureStats(ExecutionJobVertex vertex)
Returns back pressure statistics for a operator.
|
Optional<OperatorBackPressureStats> |
BackPressureStatsTracker.getOperatorBackPressureStats(ExecutionJobVertex vertex)
Returns back pressure statistics for a operator.
|
boolean |
BackPressureStatsTrackerImpl.triggerStackTraceSample(ExecutionJobVertex vertex)
Deprecated.
BackPressureStatsTrackerImpl.getOperatorBackPressureStats(ExecutionJobVertex) will trigger
stack trace sampling automatically. |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.