public class YarnClusterDescriptor extends AbstractYarnClusterDescriptor
AbstractYarnClusterDescriptor
which is used to start the
application master.shipFiles
Constructor and Description |
---|
YarnClusterDescriptor(Configuration flinkConfiguration,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration,
String configurationDirectory,
org.apache.hadoop.yarn.client.api.YarnClient yarnClient,
boolean sharedYarnClient) |
Modifier and Type | Method and Description |
---|---|
protected ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> |
createYarnClusterClient(AbstractYarnClusterDescriptor descriptor,
int numberTaskManagers,
int slotsPerTaskManager,
org.apache.hadoop.yarn.api.records.ApplicationReport report,
Configuration flinkConfiguration,
boolean perJobCluster)
Creates a YarnClusterClient; may be overriden in tests.
|
ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> |
deployJobCluster(ClusterSpecification clusterSpecification,
JobGraph jobGraph,
boolean detached)
Deploys a per-job cluster with the given job on the cluster.
|
protected String |
getYarnJobClusterEntrypoint()
The class to start the application master with.
|
protected String |
getYarnSessionClusterEntrypoint()
The class to start the application master with.
|
addLibFolderToShipFiles, addShipFiles, close, deployInternal, deploySessionCluster, getClusterDescription, getDynamicPropertiesEncoded, getFlinkConfiguration, getYarnClient, getZookeeperNamespace, hasUserJarFiles, isDetachedMode, killCluster, retrieve, setDetachedMode, setDynamicPropertiesEncoded, setLocalJarPath, setName, setProvidedUserJarFiles, setQueue, setupApplicationMasterContainer, setZookeeperNamespace, startAppMaster, validateClusterResources
public YarnClusterDescriptor(Configuration flinkConfiguration, org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration, String configurationDirectory, org.apache.hadoop.yarn.client.api.YarnClient yarnClient, boolean sharedYarnClient)
protected String getYarnSessionClusterEntrypoint()
AbstractYarnClusterDescriptor
getYarnSessionClusterEntrypoint
in class AbstractYarnClusterDescriptor
protected String getYarnJobClusterEntrypoint()
AbstractYarnClusterDescriptor
getYarnJobClusterEntrypoint
in class AbstractYarnClusterDescriptor
public ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> deployJobCluster(ClusterSpecification clusterSpecification, JobGraph jobGraph, boolean detached) throws ClusterDeploymentException
ClusterDescriptor
clusterSpecification
- Initial cluster specification with which the Flink cluster is launchedjobGraph
- JobGraph with which the job cluster is starteddetached
- true if the cluster should be stopped after the job completion without serving the result,
otherwise falseClusterDeploymentException
- if the cluster could not be deployedprotected ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> createYarnClusterClient(AbstractYarnClusterDescriptor descriptor, int numberTaskManagers, int slotsPerTaskManager, org.apache.hadoop.yarn.api.records.ApplicationReport report, Configuration flinkConfiguration, boolean perJobCluster) throws Exception
AbstractYarnClusterDescriptor
createYarnClusterClient
in class AbstractYarnClusterDescriptor
Exception
Copyright © 2014–2019 The Apache Software Foundation. All rights reserved.