public class LegacyYarnClusterDescriptor extends AbstractYarnClusterDescriptor
AbstractYarnClusterDescriptor
which starts an YarnApplicationMasterRunner
.shipFiles
Constructor and Description |
---|
LegacyYarnClusterDescriptor(Configuration flinkConfiguration,
org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration,
String configurationDirectory,
org.apache.hadoop.yarn.client.api.YarnClient yarnClient,
boolean sharedYarnClient) |
Modifier and Type | Method and Description |
---|---|
protected ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> |
createYarnClusterClient(AbstractYarnClusterDescriptor descriptor,
int numberTaskManagers,
int slotsPerTaskManager,
org.apache.hadoop.yarn.api.records.ApplicationReport report,
Configuration flinkConfiguration,
boolean perJobCluster)
Creates a YarnClusterClient; may be overriden in tests.
|
YarnClusterClient |
deployJobCluster(ClusterSpecification clusterSpecification,
JobGraph jobGraph,
boolean detached)
Deploys a per-job cluster with the given job on the cluster.
|
protected String |
getYarnJobClusterEntrypoint()
The class to start the application master with.
|
protected String |
getYarnSessionClusterEntrypoint()
The class to start the application master with.
|
addLibFolderToShipFiles, addShipFiles, close, deployInternal, deploySessionCluster, getClusterDescription, getDynamicPropertiesEncoded, getFlinkConfiguration, getYarnClient, getZookeeperNamespace, hasUserJarFiles, isDetachedMode, killCluster, retrieve, setDetachedMode, setDynamicPropertiesEncoded, setLocalJarPath, setName, setProvidedUserJarFiles, setQueue, setupApplicationMasterContainer, setZookeeperNamespace, startAppMaster, validateClusterResources
public LegacyYarnClusterDescriptor(Configuration flinkConfiguration, org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration, String configurationDirectory, org.apache.hadoop.yarn.client.api.YarnClient yarnClient, boolean sharedYarnClient)
protected String getYarnSessionClusterEntrypoint()
AbstractYarnClusterDescriptor
getYarnSessionClusterEntrypoint
in class AbstractYarnClusterDescriptor
protected String getYarnJobClusterEntrypoint()
AbstractYarnClusterDescriptor
getYarnJobClusterEntrypoint
in class AbstractYarnClusterDescriptor
public YarnClusterClient deployJobCluster(ClusterSpecification clusterSpecification, JobGraph jobGraph, boolean detached)
ClusterDescriptor
clusterSpecification
- Initial cluster specification with which the Flink cluster is launchedjobGraph
- JobGraph with which the job cluster is starteddetached
- true if the cluster should be stopped after the job completion without serving the result,
otherwise falseprotected ClusterClient<org.apache.hadoop.yarn.api.records.ApplicationId> createYarnClusterClient(AbstractYarnClusterDescriptor descriptor, int numberTaskManagers, int slotsPerTaskManager, org.apache.hadoop.yarn.api.records.ApplicationReport report, Configuration flinkConfiguration, boolean perJobCluster) throws Exception
AbstractYarnClusterDescriptor
createYarnClusterClient
in class AbstractYarnClusterDescriptor
Exception
Copyright © 2014–2019 The Apache Software Foundation. All rights reserved.