public class MiniCluster extends Object
Constructor and Description |
---|
MiniCluster()
Creates a new mini cluster with the default configuration:
One JobManager
One TaskManager
One task slot in the TaskManager
All components share the same RPC subsystem (minimizes communication overhead)
|
MiniCluster(Configuration config)
Deprecated.
Use
MiniCluster(MiniClusterConfiguration) instead. |
MiniCluster(Configuration config,
boolean singleRpcService)
Deprecated.
Use
MiniCluster(MiniClusterConfiguration) instead. |
MiniCluster(MiniClusterConfiguration config)
Creates a new Flink mini cluster based on the given configuration.
|
Modifier and Type | Method and Description |
---|---|
protected MetricRegistry |
createMetricRegistry(Configuration config)
Factory method to create the metric registry for the mini cluster
|
protected RpcService |
createRpcService(Configuration configuration,
Time askTimeout,
boolean remoteEnabled,
String bindAddress)
Factory method to instantiate the RPC service.
|
boolean |
isRunning()
Checks if the mini cluster was started and is running.
|
void |
runDetached(JobGraph job)
This method executes a job in detached mode.
|
JobExecutionResult |
runJobBlocking(JobGraph job)
This method runs a job in blocking mode.
|
void |
shutdown()
Shuts down the mini cluster, failing all currently executing jobs.
|
void |
start()
Starts the mini cluster, based on the configured properties.
|
protected ResourceManagerRunner[] |
startResourceManagers(Configuration configuration,
HighAvailabilityServices haServices,
HeartbeatServices heartbeatServices,
MetricRegistry metricRegistry,
int numResourceManagers,
RpcService[] resourceManagerRpcServices) |
protected TaskManagerRunner[] |
startTaskManagers(Configuration configuration,
HighAvailabilityServices haServices,
MetricRegistry metricRegistry,
int numTaskManagers,
RpcService[] taskManagerRpcServices) |
void |
waitUntilTaskManagerRegistrationsComplete() |
public MiniCluster()
public MiniCluster(MiniClusterConfiguration config)
config
- The configuration for the mini cluster@Deprecated public MiniCluster(Configuration config)
MiniCluster(MiniClusterConfiguration)
instead.MiniCluster(MiniClusterConfiguration)
@Deprecated public MiniCluster(Configuration config, boolean singleRpcService)
MiniCluster(MiniClusterConfiguration)
instead.MiniCluster(MiniClusterConfiguration)
public boolean isRunning()
public void start() throws Exception
Exception
- This method passes on any exception that occurs during the startup of
the mini cluster.public void shutdown() throws Exception
start()
method again.
This method shuts down all started services and components, even if an exception occurs in the process of shutting down some component.
Exception
- Thrown, if the shutdown did not complete cleanly.public void waitUntilTaskManagerRegistrationsComplete() throws Exception
Exception
public void runDetached(JobGraph job) throws JobExecutionException
job
- The Flink job to executeJobExecutionException
- Thrown if anything went amiss during initial job launch,
or if the job terminally failed.public JobExecutionResult runJobBlocking(JobGraph job) throws JobExecutionException, InterruptedException
job
- The Flink job to executeJobExecutionException
- Thrown if anything went amiss during initial job launch,
or if the job terminally failed.InterruptedException
protected MetricRegistry createMetricRegistry(Configuration config)
config
- The configuration of the mini clusterprotected RpcService createRpcService(Configuration configuration, Time askTimeout, boolean remoteEnabled, String bindAddress)
configuration
- The configuration of the mini clusteraskTimeout
- The default RPC timeout for asynchronous "ask" requests.remoteEnabled
- True, if the RPC service should be reachable from other (remote) RPC services.bindAddress
- The address to bind the RPC service to. Only relevant when "remoteEnabled" is true.protected ResourceManagerRunner[] startResourceManagers(Configuration configuration, HighAvailabilityServices haServices, HeartbeatServices heartbeatServices, MetricRegistry metricRegistry, int numResourceManagers, RpcService[] resourceManagerRpcServices) throws Exception
Exception
protected TaskManagerRunner[] startTaskManagers(Configuration configuration, HighAvailabilityServices haServices, MetricRegistry metricRegistry, int numTaskManagers, RpcService[] taskManagerRpcServices) throws Exception
Exception
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.