JobManager
and
TaskManager
to coordinate the distributed operations.See: Description
Interface | Description |
---|---|
JobManagerMessages.CancellationResponse | |
JobManagerMessages.JobManagerStatus |
Response to RequestJobManagerStatus
|
JobManagerMessages.JobResponse | |
JobManagerMessages.JobResultMessage |
Denotes messages which contain the result of a completed job execution
|
JobManagerMessages.JobStatusResponse | |
JobManagerMessages.StoppingResponse | |
MessageDecorator |
Interface for message decorators
|
RegistrationMessages.RegistrationMessage |
Marker trait for registration messages.
|
RequiresLeaderSessionID |
Marks messages to be sent wrapped in a
JobManagerMessages.LeaderSessionMessage |
StackTraceSampleMessages.StackTraceSampleMessages | |
TaskManagerMessages.LogTypeRequest |
Trait do differentiate which log file is requested
|
TaskMessages.TaskMessage |
Marker trait for task messages.
|
Class | Description |
---|---|
Acknowledge |
A generic acknowledgement message.
|
ArchiveMessages |
This object contains the archive specific messages.
|
ArchiveMessages.ArchivedJob | |
ArchiveMessages.ArchivedJob$ | |
ArchiveMessages.ArchivedJobs |
Response to
RequestArchivedJobs message. |
ArchiveMessages.ArchivedJobs$ | |
ArchiveMessages.ArchiveExecutionGraph | |
ArchiveMessages.ArchiveExecutionGraph$ | |
ArchiveMessages.RequestArchivedJob |
Reqeuest a specific ExecutionGraph by JobID.
|
ArchiveMessages.RequestArchivedJob$ | |
ArchiveMessages.RequestArchivedJobs$ |
Request the currently archived jobs in the archiver.
|
ArchiveMessages.RequestJobCounts$ |
Requests the number of finished, canceled, and failed jobs
|
ArchiveMessages$ |
This object contains the archive specific messages.
|
ExecutionGraphMessages |
This object contains the execution graph specific messages.
|
ExecutionGraphMessages.ExecutionStateChanged |
Denotes the execution state change of an
ExecutionVertex |
ExecutionGraphMessages.ExecutionStateChanged$ | |
ExecutionGraphMessages.JobStatusChanged |
Denotes the job state change of a job.
|
ExecutionGraphMessages.JobStatusChanged$ | |
ExecutionGraphMessages$ |
This object contains the execution graph specific messages.
|
JobClientMessages |
This object contains the
JobClient specific messages |
JobClientMessages.AttachToJobAndWait |
This message is sent to the JobClientActor to ask it to register at the JobManager
and then return once the job execution is complete.
|
JobClientMessages.AttachToJobAndWait$ | |
JobClientMessages.ConnectionTimeout |
Message which is triggered when the connection timeout has been reached.
|
JobClientMessages.ConnectionTimeout$ | |
JobClientMessages.JobManagerActorRef |
Notifies the JobClientActor about the ActorRef of the new leader.
|
JobClientMessages.JobManagerActorRef$ | |
JobClientMessages.JobManagerLeaderAddress |
Notifies the JobClientActor about a new leader address and a leader session ID.
|
JobClientMessages.JobManagerLeaderAddress$ | |
JobClientMessages.RegistrationTimeout$ |
Message which is triggered when the JobClient registration at the JobManager times out
|
JobClientMessages.SubmissionTimeout$ |
Message which is triggered when the submission timeout has been reached.
|
JobClientMessages.SubmitJobAndWait |
This message is sent to the JobClientActor (via ask) to submit a job and
get a response when the job execution has finished.
|
JobClientMessages.SubmitJobAndWait$ | |
JobClientMessages$ |
This object contains the
JobClient specific messages |
JobManagerMessages |
The job manager specific actor messages
|
JobManagerMessages.CancelJob |
Cancels a job with the given
jobID at the JobManager. |
JobManagerMessages.CancelJob$ | |
JobManagerMessages.CancelJobWithSavepoint |
Cancels the job with the given
jobID at the JobManager. |
JobManagerMessages.CancelJobWithSavepoint$ | |
JobManagerMessages.CancellationFailure |
Denotes a failed job cancellation
param: jobID
param: cause
|
JobManagerMessages.CancellationFailure$ | |
JobManagerMessages.CancellationSuccess |
Denotes a successful job cancellation
param: jobID
|
JobManagerMessages.CancellationSuccess$ | |
JobManagerMessages.ClassloadingProps |
Response to
JobManagerMessages.RequestClassloadingProps
param: blobManagerPort The port of the blobManager
param: requiredJarFiles The blob keys of the required jar files
param: requiredClasspaths The urls of the required classpaths |
JobManagerMessages.ClassloadingProps$ | |
JobManagerMessages.CurrentJobStatus |
Denotes the current
JobStatus of the job with jobID . |
JobManagerMessages.CurrentJobStatus$ | |
JobManagerMessages.DisposeSavepoint |
Disposes a savepoint.
|
JobManagerMessages.DisposeSavepoint$ | |
JobManagerMessages.DisposeSavepointFailure |
Response after a failed savepoint dispose containing the failure cause.
|
JobManagerMessages.DisposeSavepointFailure$ | |
JobManagerMessages.DisposeSavepointSuccess$ |
Response after a successful savepoint dispose.
|
JobManagerMessages.GrantLeadership |
Grants leadership to the receiver.
|
JobManagerMessages.GrantLeadership$ | |
JobManagerMessages.JobFound |
Contains the
executionGraph of a job with jobID . |
JobManagerMessages.JobFound$ | |
JobManagerMessages.JobManagerStatusAlive$ | |
JobManagerMessages.JobNotFound |
Denotes that there is no job with
jobID retrievable. |
JobManagerMessages.JobNotFound$ | |
JobManagerMessages.JobResultFailure |
Denotes an unsuccessful job execution.
|
JobManagerMessages.JobResultFailure$ | |
JobManagerMessages.JobResultSuccess |
Denotes a successful job execution.
|
JobManagerMessages.JobResultSuccess$ | |
JobManagerMessages.JobSubmitSuccess |
Denotes a successful job submission.
|
JobManagerMessages.JobSubmitSuccess$ | |
JobManagerMessages.LeaderSessionMessage |
Wrapper class for leader session messages.
|
JobManagerMessages.LeaderSessionMessage$ | |
JobManagerMessages.NextInputSplit |
Contains the next input split for a task.
|
JobManagerMessages.NextInputSplit$ | |
JobManagerMessages.RecoverAllJobs$ |
Triggers recovery of all available jobs.
|
JobManagerMessages.RecoverJob |
Triggers the recovery of the job with the given ID.
|
JobManagerMessages.RecoverJob$ | |
JobManagerMessages.RecoverSubmittedJob |
Triggers the submission of the recovered job
|
JobManagerMessages.RecoverSubmittedJob$ | |
JobManagerMessages.RegisteredTaskManagers |
Contains the
Instance objects of all registered task managers. |
JobManagerMessages.RegisteredTaskManagers$ | |
JobManagerMessages.RegisterJobClient |
Registers the sender of the message as the client for the provided job identifier.
|
JobManagerMessages.RegisterJobClient$ | |
JobManagerMessages.RegisterJobClientSuccess |
Denotes a successful registration of a JobClientActor for a running job
param: jobId The job id of the registered job
|
JobManagerMessages.RegisterJobClientSuccess$ | |
JobManagerMessages.RemoveCachedJob |
Removes the job belonging to the job identifier from the job manager and archives it.
|
JobManagerMessages.RemoveCachedJob$ | |
JobManagerMessages.RemoveJob |
Triggers the removal of the job with the given job ID
|
JobManagerMessages.RemoveJob$ | |
JobManagerMessages.RequestArchive$ |
Requests the ActorRef of the archiver
|
JobManagerMessages.RequestBlobManagerPort$ |
Requests the port of the blob manager from the job manager.
|
JobManagerMessages.RequestClassloadingProps |
Requests all entities necessary for reconstructing a job class loader
May respond with
JobManagerMessages.ClassloadingProps or JobManagerMessages.JobNotFound
param: jobId The job id of the registered job |
JobManagerMessages.RequestClassloadingProps$ | |
JobManagerMessages.RequestJob |
Requests the execution graph of a specific job identified by
jobID . |
JobManagerMessages.RequestJob$ | |
JobManagerMessages.RequestJobManagerStatus$ |
Requests the current state of the job manager
|
JobManagerMessages.RequestJobStatus |
Requests the current
JobStatus of the job identified by jobID . |
JobManagerMessages.RequestJobStatus$ | |
JobManagerMessages.RequestLeaderSessionID$ |
Requests the current leader session ID of the job manager.
|
JobManagerMessages.RequestNextInputSplit |
Requesting next input split for the
ExecutionJobVertex
of the job specified by jobID . |
JobManagerMessages.RequestNextInputSplit$ | |
JobManagerMessages.RequestNumberRegisteredTaskManager$ |
Requests the number of currently registered task manager at the job manager.
|
JobManagerMessages.RequestPartitionProducerState |
Requests the execution state of the execution producing a result partition.
|
JobManagerMessages.RequestPartitionProducerState$ | |
JobManagerMessages.RequestRegisteredTaskManagers$ |
Requests the instances of all registered task managers.
|
JobManagerMessages.RequestRunningJobs$ |
Requests all currently running jobs from the job manager.
|
JobManagerMessages.RequestRunningJobsStatus$ |
Requests the status of all currently running jobs from the job manager.
|
JobManagerMessages.RequestStackTrace |
Requests stack trace messages of the task manager
|
JobManagerMessages.RequestStackTrace$ | |
JobManagerMessages.RequestTaskManagerInstance |
Requests the
Instance object of the task manager with the given instance ID |
JobManagerMessages.RequestTaskManagerInstance$ | |
JobManagerMessages.RequestTotalNumberOfSlots$ |
Requests the maximum number of slots available to the job manager.
|
JobManagerMessages.RequestWebMonitorPort$ |
Request for the
WebMonitor port. |
JobManagerMessages.ResponseArchive |
Response containing the ActorRef of the archiver
|
JobManagerMessages.ResponseArchive$ | |
JobManagerMessages.ResponseLeaderSessionID |
Response to the
RequestLeaderSessionID message. |
JobManagerMessages.ResponseLeaderSessionID$ | |
JobManagerMessages.ResponseWebMonitorPort |
Response containing the
WebMonitor port. |
JobManagerMessages.ResponseWebMonitorPort$ | |
JobManagerMessages.RevokeLeadership$ |
Revokes leadership of the receiver.
|
JobManagerMessages.RunningJobs |
This message is the response to the
RequestRunningJobs message. |
JobManagerMessages.RunningJobs$ | |
JobManagerMessages.RunningJobsStatus | |
JobManagerMessages.RunningJobsStatus$ | |
JobManagerMessages.ScheduleOrUpdateConsumers |
Notifies the
JobManager about available data for a
produced partition. |
JobManagerMessages.ScheduleOrUpdateConsumers$ | |
JobManagerMessages.StopJob |
Stops a (streaming) job with the given
jobID at the JobManager. |
JobManagerMessages.StopJob$ | |
JobManagerMessages.StoppingFailure |
Denotes a failed (streaming) job stopping
param: jobID
param: cause
|
JobManagerMessages.StoppingFailure$ | |
JobManagerMessages.StoppingSuccess |
Denotes a successful (streaming) job stopping
param: jobID
|
JobManagerMessages.StoppingSuccess$ | |
JobManagerMessages.SubmitJob |
Submits a job to the job manager.
|
JobManagerMessages.SubmitJob$ | |
JobManagerMessages.TaskManagerInstance |
Returns the
Instance object of the requested task manager. |
JobManagerMessages.TaskManagerInstance$ | |
JobManagerMessages.TriggerSavepoint |
Triggers a savepoint for the specified job.
|
JobManagerMessages.TriggerSavepoint$ | |
JobManagerMessages.TriggerSavepointFailure |
Response after a failed savepoint trigger containing the failure cause.
|
JobManagerMessages.TriggerSavepointFailure$ | |
JobManagerMessages.TriggerSavepointSuccess |
Response after a successful savepoint trigger containing the savepoint path.
|
JobManagerMessages.TriggerSavepointSuccess$ | |
JobManagerMessages$ |
The job manager specific actor messages
|
LeaderSessionMessageDecorator |
Message decorator which wraps message which implement
RequiresLeaderSessionID into
a JobManagerMessages.LeaderSessionMessage . |
Messages |
Generic messages between JobManager, TaskManager, JobClient.
|
Messages.Disconnect |
Signals that the receiver (JobManager/TaskManager) shall disconnect the sender.
|
Messages.Disconnect$ | |
Messages$ |
Generic messages between JobManager, TaskManager, JobClient.
|
RegistrationMessages |
A set of messages between TaskManager and JobManager to handle the
registration of the TaskManager at the JobManager.
|
RegistrationMessages.AcknowledgeRegistration |
Denotes the successful registration of a task manager at the JobManager.
|
RegistrationMessages.AcknowledgeRegistration$ | |
RegistrationMessages.AlreadyRegistered |
Denotes that the TaskManager has already been registered at the JobManager.
|
RegistrationMessages.AlreadyRegistered$ | |
RegistrationMessages.RefuseRegistration |
Denotes the unsuccessful registration of a task manager at the JobManager.
|
RegistrationMessages.RefuseRegistration$ | |
RegistrationMessages.RegisterTaskManager |
Registers a task manager at the JobManager.
|
RegistrationMessages.RegisterTaskManager$ | |
RegistrationMessages.TriggerTaskManagerRegistration |
Triggers the TaskManager to attempt a registration at the JobManager.
|
RegistrationMessages.TriggerTaskManagerRegistration$ | |
RegistrationMessages$ |
A set of messages between TaskManager and JobManager to handle the
registration of the TaskManager at the JobManager.
|
StackTrace | |
StackTraceSampleMessages |
A set of messages exchanged with task manager instances in order to sample
the stack traces of running tasks.
|
StackTraceSampleMessages.SampleTaskStackTrace |
Task manager internal sample message.
|
StackTraceSampleMessages.SampleTaskStackTrace$ | |
StackTraceSampleMessages.TriggerStackTraceSample |
Triggers the sampling of a running task (sent by the job manager to the
task managers).
|
StackTraceSampleMessages.TriggerStackTraceSample$ | |
StackTraceSampleMessages$ |
A set of messages exchanged with task manager instances in order to sample
the stack traces of running tasks.
|
StackTraceSampleResponse |
Response to the TriggerStackTraceSample message.
|
TaskManagerMessages |
Miscellaneous actor messages exchanged with the TaskManager.
|
TaskManagerMessages.FatalError |
This message informs the TaskManager about a fatal error that prevents
it from continuing.
|
TaskManagerMessages.FatalError$ | |
TaskManagerMessages.Heartbeat |
Reports liveliness of the TaskManager instance with the given instance ID to the
This message is sent to the job.
|
TaskManagerMessages.Heartbeat$ | |
TaskManagerMessages.JobManagerLeaderAddress |
Tells the address of the new leading
JobManager
and the new leader session ID. |
TaskManagerMessages.JobManagerLeaderAddress$ | |
TaskManagerMessages.LogFileRequest$ |
Indicates a request for the .log file
|
TaskManagerMessages.NotifyWhenRegisteredAtJobManager$ |
Requests a notification from the task manager as soon as the task manager has been
registered at a job manager.
|
TaskManagerMessages.RegisteredAtJobManager |
Acknowledges that the task manager has been successfully registered at any job manager.
|
TaskManagerMessages.RegisteredAtJobManager$ | |
TaskManagerMessages.RequestBroadcastVariablesWithReferences$ |
Requests the number of broadcast variables with references
|
TaskManagerMessages.RequestNumActiveConnections$ |
Requests the number of active connections at the ConnectionManager
|
TaskManagerMessages.RequestTaskManagerLog |
Requests the TaskManager to upload either his log/stdout file to the Blob store
param requestType LogTypeRequest indicating which file is requested
|
TaskManagerMessages.RequestTaskManagerLog$ | |
TaskManagerMessages.ResponseBroadcastVariablesWithReferences | |
TaskManagerMessages.ResponseBroadcastVariablesWithReferences$ | |
TaskManagerMessages.ResponseNumActiveConnections | |
TaskManagerMessages.ResponseNumActiveConnections$ | |
TaskManagerMessages.SendHeartbeat$ |
Tells the task manager to send a heartbeat message to the job manager.
|
TaskManagerMessages.SendStackTrace$ |
Tells the TaskManager to send a stack trace of all threads to the sender.
|
TaskManagerMessages.StackTrace |
Communicates the stack trace of the TaskManager with the given ID.
|
TaskManagerMessages.StackTrace$ | |
TaskManagerMessages.StdOutFileRequest$ |
Indicates a request for the .out file
|
TaskManagerMessages$ |
Miscellaneous actor messages exchanged with the TaskManager.
|
TaskMessages |
A set of messages that control the deployment and the state of Tasks executed
on the TaskManager.
|
TaskMessages.CancelTask |
Cancels the task associated with
attemptID . |
TaskMessages.CancelTask$ | |
TaskMessages.FailIntermediateResultPartitions |
Fails (and releases) all intermediate result partitions identified by
executionID from the task manager. |
TaskMessages.FailIntermediateResultPartitions$ | |
TaskMessages.FailTask |
Triggers a fail of specified task from the outside (as opposed to the task throwing
an exception itself) with the given exception as the cause.
|
TaskMessages.FailTask$ | |
TaskMessages.StopTask |
Stops the task associated with
attemptID . |
TaskMessages.StopTask$ | |
TaskMessages.SubmitTask |
Submits a task to the task manager.
|
TaskMessages.SubmitTask$ | |
TaskMessages.TaskInFinalState |
Notifies the TaskManager that the task has reached its final state,
either FINISHED, CANCELED, or FAILED.
|
TaskMessages.TaskInFinalState$ | |
TaskMessages.UpdatePartitionInfo |
Base class for messages that update the information about location of input partitions
|
TaskMessages.UpdateTaskExecutionState |
Denotes a state change of a task at the JobManager.
|
TaskMessages.UpdateTaskExecutionState$ | |
TaskMessages.UpdateTaskMultiplePartitionInfos |
param: executionID The task's execution attempt ID.
|
TaskMessages.UpdateTaskMultiplePartitionInfos$ | |
TaskMessages.UpdateTaskSinglePartitionInfo |
param: executionID The task's execution attempt ID.
|
TaskMessages.UpdateTaskSinglePartitionInfo$ | |
TaskMessages$ |
A set of messages that control the deployment and the state of Tasks executed
on the TaskManager.
|
JobManager
and
TaskManager
to coordinate the distributed operations.Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.