public class PythonConfigUtil extends Object
StreamExecutionEnvironment
configuration and merged configuration
with environment settings.Modifier and Type | Field and Description |
---|---|
static String |
KEYED_STREAM_VALUE_OPERATOR_NAME |
static String |
STREAM_KEY_BY_MAP_OPERATOR_NAME |
static String |
STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME |
Constructor and Description |
---|
PythonConfigUtil() |
public static final String KEYED_STREAM_VALUE_OPERATOR_NAME
public static final String STREAM_KEY_BY_MAP_OPERATOR_NAME
public static final String STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME
public static Configuration getEnvConfigWithDependencies(StreamExecutionEnvironment env) throws InvocationTargetException, IllegalAccessException, NoSuchMethodException
StreamExecutionEnvironment
configuration merged with
python dependency management configurations.public static Configuration getEnvironmentConfig(StreamExecutionEnvironment env) throws InvocationTargetException, IllegalAccessException, NoSuchMethodException
StreamExecutionEnvironment.getConfiguration()
by reflection
recursively. Then access the method to get the configuration of the given
StreamExecutionEnvironment.public static void declareManagedMemory(Transformation<?> transformation, StreamExecutionEnvironment env, TableConfig tableConfig)
public static StreamGraph generateStreamGraphWithDependencies(StreamExecutionEnvironment env, boolean clearTransformations) throws IllegalAccessException, NoSuchMethodException, InvocationTargetException, NoSuchFieldException
StreamGraph
for transformations maintained by current StreamExecutionEnvironment
, and reset the merged env configurations with dependencies to
every OneInputPythonFunctionOperator
. It is an idempotent operation that can be call
multiple times. Remember that only when need to execute the StreamGraph can we set the
clearTransformations to be True.public static void configPythonOperator(StreamExecutionEnvironment env) throws IllegalAccessException, NoSuchMethodException, InvocationTargetException, NoSuchFieldException
public static Configuration getMergedConfig(StreamExecutionEnvironment env, TableConfig tableConfig)
public static Configuration getMergedConfig(ExecutionEnvironment env, TableConfig tableConfig)
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.