public class JobManager$ extends Object
Modifier and Type | Field and Description |
---|---|
static JobManager$ |
MODULE$
Static reference to the singleton instance of this Scala object.
|
Constructor and Description |
---|
JobManager$() |
Modifier and Type | Method and Description |
---|---|
scala.Tuple9<InstanceManager,Scheduler,BlobLibraryCacheManager,RestartStrategyFactory,scala.concurrent.duration.FiniteDuration,Object,scala.Option<Path>,scala.concurrent.duration.FiniteDuration,scala.Option<MetricRegistry>> |
createJobManagerComponents(Configuration configuration,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
BlobStore blobStore)
Create the job manager components as (instanceManager, scheduler, libraryCacheManager,
archiverProps, defaultExecutionRetries,
delayBetweenRetries, timeout)
|
akka.actor.Props |
getArchiveProps(Class<? extends MemoryArchivist> archiveClass,
int archiveCount,
scala.Option<Path> archivePath) |
akka.actor.Props |
getJobManagerProps(Class<? extends JobManager> jobManagerClass,
Configuration configuration,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
InstanceManager instanceManager,
Scheduler scheduler,
LibraryCacheManager libraryCacheManager,
akka.actor.ActorRef archive,
RestartStrategyFactory restartStrategyFactory,
scala.concurrent.duration.FiniteDuration timeout,
LeaderElectionService leaderElectionService,
SubmittedJobGraphStore submittedJobGraphStore,
CheckpointRecoveryFactory checkpointRecoveryFactory,
scala.concurrent.duration.FiniteDuration jobRecoveryTimeout,
scala.Option<MetricRegistry> metricsRegistry) |
grizzled.slf4j.Logger |
LOG() |
void |
main(String[] args)
Entry point (main method) to run the JobManager in a standalone fashion.
|
scala.Tuple4<Configuration,JobManagerMode,String,Iterator<Integer>> |
parseArgs(String[] args)
Loads the configuration, execution mode and the listening address from the provided command
line arguments.
|
<T> scala.util.Try<T> |
retryOnBindException(scala.Function0<T> fn,
scala.Function0<Object> stopCond,
long maxSleepBetweenRetries)
Retries a function if it fails because of a
BindException . |
void |
runJobManager(Configuration configuration,
JobManagerMode executionMode,
String listeningAddress,
int listeningPort)
Starts and runs the JobManager with all its components.
|
void |
runJobManager(Configuration configuration,
JobManagerMode executionMode,
String listeningAddress,
Iterator<Integer> listeningPortRange)
Starts and runs the JobManager with all its components trying to bind to
a port in the specified range.
|
int |
RUNTIME_FAILURE_RETURN_CODE() |
akka.actor.ActorSystem |
startActorSystem(Configuration configuration,
String externalHostname,
int port)
Starts the JobManager actor system.
|
scala.Tuple4<akka.actor.ActorRef,akka.actor.ActorRef,scala.Option<WebMonitor>,scala.Option<akka.actor.ActorRef>> |
startJobManagerActors(akka.actor.ActorSystem jobManagerSystem,
Configuration configuration,
JobManagerMode executionMode,
String externalHostname,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass,
scala.Option<Class<? extends FlinkResourceManager<?>>> resourceManagerClass)
Starts the JobManager and all its components including the WebMonitor.
|
scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in
the given actor system.
|
scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> |
startJobManagerActors(Configuration configuration,
akka.actor.ActorSystem actorSystem,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
HighAvailabilityServices highAvailabilityServices,
scala.Option<String> jobManagerActorName,
scala.Option<String> archiveActorName,
Class<? extends JobManager> jobManagerClass,
Class<? extends MemoryArchivist> archiveClass)
Starts the JobManager and job archiver based on the given configuration, in the
given actor system.
|
int |
STARTUP_FAILURE_RETURN_CODE() |
public static final JobManager$ MODULE$
public grizzled.slf4j.Logger LOG()
public int STARTUP_FAILURE_RETURN_CODE()
public int RUNTIME_FAILURE_RETURN_CODE()
public void main(String[] args)
args
- The command line arguments.public void runJobManager(Configuration configuration, JobManagerMode executionMode, String listeningAddress, int listeningPort)
This method blocks indefinitely (or until the JobManager's actor system is shut down).
configuration
- The configuration object for the JobManager.executionMode
- The execution mode in which to run. Execution mode LOCAL will spawn an
an additional TaskManager in the same process.listeningAddress
- The hostname where the JobManager should listen for messages.listeningPort
- The port where the JobManager should listen for messages.public void runJobManager(Configuration configuration, JobManagerMode executionMode, String listeningAddress, Iterator<Integer> listeningPortRange)
configuration
- The configuration object for the JobManager.executionMode
- The execution mode in which to run. Execution mode LOCAL will spawn an
an additional TaskManager in the same process.listeningAddress
- The hostname where the JobManager should listen for messages.listeningPortRange
- The port range where the JobManager should listen for messages.public <T> scala.util.Try<T> retryOnBindException(scala.Function0<T> fn, scala.Function0<Object> stopCond, long maxSleepBetweenRetries)
BindException
.
fn
- The function to retrystopCond
- Flag to signal terminationmaxSleepBetweenRetries
- Max random sleep time between retriespublic akka.actor.ActorSystem startActorSystem(Configuration configuration, String externalHostname, int port)
configuration
- Configuration to use for the job manager actor systemexternalHostname
- External hostname to bind toport
- Port to bind topublic scala.Tuple4<akka.actor.ActorRef,akka.actor.ActorRef,scala.Option<WebMonitor>,scala.Option<akka.actor.ActorRef>> startJobManagerActors(akka.actor.ActorSystem jobManagerSystem, Configuration configuration, JobManagerMode executionMode, String externalHostname, ScheduledExecutorService futureExecutor, Executor ioExecutor, HighAvailabilityServices highAvailabilityServices, Class<? extends JobManager> jobManagerClass, Class<? extends MemoryArchivist> archiveClass, scala.Option<Class<? extends FlinkResourceManager<?>>> resourceManagerClass)
configuration
- The configuration object for the JobManagerexecutionMode
- The execution mode in which to run. Execution mode LOCAL with spawn an
additional TaskManager in the same process.externalHostname
- The hostname where the JobManager is reachable for rpc communicationfutureExecutor
- to run the JobManager's futuresioExecutor
- to run blocking io operationshighAvailabilityServices
- to instantiate high availability servicesjobManagerClass
- The class of the JobManager to be startedarchiveClass
- The class of the Archivist to be startedresourceManagerClass
- Optional class of resource manager if one should be startedjobManagerSystem
- (undocumented)public scala.Tuple4<Configuration,JobManagerMode,String,Iterator<Integer>> parseArgs(String[] args)
args
- command line argumentspublic scala.Tuple9<InstanceManager,Scheduler,BlobLibraryCacheManager,RestartStrategyFactory,scala.concurrent.duration.FiniteDuration,Object,scala.Option<Path>,scala.concurrent.duration.FiniteDuration,scala.Option<MetricRegistry>> createJobManagerComponents(Configuration configuration, ScheduledExecutorService futureExecutor, Executor ioExecutor, BlobStore blobStore)
configuration
- The configuration from which to parse the config values.futureExecutor
- to run JobManager's futuresioExecutor
- to run blocking io operationsblobStore
- to store blobs persistentlypublic scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> startJobManagerActors(Configuration configuration, akka.actor.ActorSystem actorSystem, ScheduledExecutorService futureExecutor, Executor ioExecutor, HighAvailabilityServices highAvailabilityServices, Class<? extends JobManager> jobManagerClass, Class<? extends MemoryArchivist> archiveClass)
configuration
- The configuration for the JobManageractorSystem
- The actor system running the JobManagerfutureExecutor
- to run JobManager's futuresioExecutor
- to run blocking io operationsjobManagerClass
- The class of the JobManager to be startedarchiveClass
- The class of the MemoryArchivist to be startedhighAvailabilityServices
- (undocumented)public scala.Tuple2<akka.actor.ActorRef,akka.actor.ActorRef> startJobManagerActors(Configuration configuration, akka.actor.ActorSystem actorSystem, ScheduledExecutorService futureExecutor, Executor ioExecutor, HighAvailabilityServices highAvailabilityServices, scala.Option<String> jobManagerActorName, scala.Option<String> archiveActorName, Class<? extends JobManager> jobManagerClass, Class<? extends MemoryArchivist> archiveClass)
configuration
- The configuration for the JobManageractorSystem
- The actor system running the JobManagerfutureExecutor
- to run JobManager's futuresioExecutor
- to run blocking io operationsjobManagerActorName
- Optionally the name of the JobManager actor. If none is given,
the actor will have the name generated by the actor system.archiveActorName
- Optionally the name of the archive actor. If none is given,
the actor will have the name generated by the actor system.jobManagerClass
- The class of the JobManager to be startedarchiveClass
- The class of the MemoryArchivist to be startedhighAvailabilityServices
- (undocumented)public akka.actor.Props getArchiveProps(Class<? extends MemoryArchivist> archiveClass, int archiveCount, scala.Option<Path> archivePath)
public akka.actor.Props getJobManagerProps(Class<? extends JobManager> jobManagerClass, Configuration configuration, ScheduledExecutorService futureExecutor, Executor ioExecutor, InstanceManager instanceManager, Scheduler scheduler, LibraryCacheManager libraryCacheManager, akka.actor.ActorRef archive, RestartStrategyFactory restartStrategyFactory, scala.concurrent.duration.FiniteDuration timeout, LeaderElectionService leaderElectionService, SubmittedJobGraphStore submittedJobGraphStore, CheckpointRecoveryFactory checkpointRecoveryFactory, scala.concurrent.duration.FiniteDuration jobRecoveryTimeout, scala.Option<MetricRegistry> metricsRegistry)
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.