Modifier and Type | Class and Description |
---|---|
class |
StreamContextEnvironment
Special
StreamExecutionEnvironment that will be used in cases where the CLI client or
testing utilities create a StreamExecutionEnvironment that should be used when getExecutionEnvironment() is called. |
class |
StreamPlanEnvironment
A special
StreamExecutionEnvironment that is used in the web frontend when generating a
user-inspectable graph of a streaming job. |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
FlinkContainerTestEnvironment.createExecutionEnvironment(TestEnvironmentSettings envOptions) |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
MiniClusterTestEnvironment.createExecutionEnvironment(TestEnvironmentSettings envOptions) |
StreamExecutionEnvironment |
TestEnvironment.createExecutionEnvironment(TestEnvironmentSettings envOptions)
Get an instance of
StreamExecutionEnvironment for building and executing Flink jobs
based on the provided configuration. |
Modifier and Type | Method and Description |
---|---|
protected JobClient |
SourceTestSuiteBase.submitJob(StreamExecutionEnvironment env,
String jobName) |
Modifier and Type | Method and Description |
---|---|
protected DataStream<RowData> |
HiveTableSource.getDataStream(ProviderContext providerContext,
StreamExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
static void |
PythonOperatorChainingOptimizer.apply(StreamExecutionEnvironment env)
Perform chaining optimization.
|
static Transformation<?> |
PythonOperatorChainingOptimizer.apply(StreamExecutionEnvironment env,
Transformation<?> transformation)
Perform chaining optimization.
|
Modifier and Type | Method and Description |
---|---|
static void |
PythonConfigUtil.configPythonOperator(StreamExecutionEnvironment env) |
static SingleOutputStreamOperator<?> |
PythonConfigUtil.createSingleOutputStreamOperator(StreamExecutionEnvironment env,
Transformation<?> transformation) |
static Configuration |
PythonConfigUtil.getEnvironmentConfig(StreamExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
DataStream<Row> |
StreamSQLTestProgram.GeneratorTableSource.getDataStream(StreamExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
static SavepointReader |
SavepointReader.read(StreamExecutionEnvironment env,
String path)
Loads an existing savepoint.
|
static SavepointReader |
SavepointReader.read(StreamExecutionEnvironment env,
String path,
StateBackend stateBackend)
Loads an existing savepoint.
|
Modifier and Type | Method and Description |
---|---|
static <OUT> DataStreamSource<OUT> |
SourceBuilder.fromFormat(StreamExecutionEnvironment env,
InputFormat<OUT,?> inputFormat,
TypeInformation<OUT> typeInfo)
Creates a new source that is bounded.
|
Modifier and Type | Field and Description |
---|---|
protected StreamExecutionEnvironment |
DataStream.environment |
protected StreamExecutionEnvironment |
ConnectedStreams.environment |
protected StreamExecutionEnvironment |
MultipleConnectedStreams.environment |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
BroadcastStream.getEnvironment() |
StreamExecutionEnvironment |
DataStream.getExecutionEnvironment()
Returns the
StreamExecutionEnvironment that was used to create this DataStream . |
StreamExecutionEnvironment |
AllWindowedStream.getExecutionEnvironment() |
StreamExecutionEnvironment |
ConnectedStreams.getExecutionEnvironment() |
StreamExecutionEnvironment |
WindowedStream.getExecutionEnvironment() |
StreamExecutionEnvironment |
BroadcastConnectedStream.getExecutionEnvironment() |
StreamExecutionEnvironment |
MultipleConnectedStreams.getExecutionEnvironment() |
Constructor and Description |
---|
BroadcastConnectedStream(StreamExecutionEnvironment env,
DataStream<IN1> input1,
BroadcastStream<IN2> input2,
List<MapStateDescriptor<?,?>> broadcastStateDescriptors) |
BroadcastStream(StreamExecutionEnvironment env,
DataStream<T> input,
MapStateDescriptor<?,?>... broadcastStateDescriptors) |
CachedDataStream(StreamExecutionEnvironment environment,
Transformation<T> transformation)
Create a new
CachedDataStream in the given execution environment that wrap the given
physical transformation to indicates that the transformation should be cached. |
ConnectedStreams(StreamExecutionEnvironment env,
DataStream<IN1> input1,
DataStream<IN2> input2) |
DataStream(StreamExecutionEnvironment environment,
Transformation<T> transformation)
Create a new
DataStream in the given execution environment with partitioning set to
forward by default. |
DataStreamSource(StreamExecutionEnvironment environment,
Source<T,?,?> source,
WatermarkStrategy<T> watermarkStrategy,
TypeInformation<T> outTypeInfo,
String sourceName)
Constructor for new Sources (FLIP-27).
|
DataStreamSource(StreamExecutionEnvironment environment,
TypeInformation<T> outTypeInfo,
StreamSource<T,?> operator,
boolean isParallel,
String sourceName) |
DataStreamSource(StreamExecutionEnvironment environment,
TypeInformation<T> outTypeInfo,
StreamSource<T,?> operator,
boolean isParallel,
String sourceName,
Boundedness boundedness)
The constructor used to create legacy sources.
|
MultipleConnectedStreams(StreamExecutionEnvironment env) |
SideOutputDataStream(StreamExecutionEnvironment environment,
SideOutputTransformation<T> transformation)
Creates a new
SideOutputDataStream in the given execution environment. |
SingleOutputStreamOperator(StreamExecutionEnvironment environment,
Transformation<T> transformation) |
Modifier and Type | Class and Description |
---|---|
class |
LocalStreamEnvironment
The LocalStreamEnvironment is a StreamExecutionEnvironment that runs the program locally,
multi-threaded, in the JVM where the environment is instantiated.
|
class |
RemoteStreamEnvironment
A
StreamExecutionEnvironment for executing on a cluster. |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
StreamExecutionEnvironmentFactory.createExecutionEnvironment(Configuration configuration)
Creates a StreamExecutionEnvironment from this factory.
|
static StreamExecutionEnvironment |
StreamExecutionEnvironment.createLocalEnvironmentWithWebUI(Configuration conf)
Creates a
LocalStreamEnvironment for local program execution that also starts the web
monitoring UI. |
static StreamExecutionEnvironment |
StreamExecutionEnvironment.createRemoteEnvironment(String host,
int port,
Configuration clientConfig,
String... jarFiles)
Creates a
RemoteStreamEnvironment . |
static StreamExecutionEnvironment |
StreamExecutionEnvironment.createRemoteEnvironment(String host,
int port,
int parallelism,
String... jarFiles)
Creates a
RemoteStreamEnvironment . |
static StreamExecutionEnvironment |
StreamExecutionEnvironment.createRemoteEnvironment(String host,
int port,
String... jarFiles)
Creates a
RemoteStreamEnvironment . |
StreamExecutionEnvironment |
StreamExecutionEnvironment.disableOperatorChaining()
Disables operator chaining for streaming operators.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.enableChangelogStateBackend(boolean enabled)
Enable the change log for current state backend.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.enableCheckpointing()
Deprecated.
Use
enableCheckpointing(long) instead. |
StreamExecutionEnvironment |
StreamExecutionEnvironment.enableCheckpointing(long interval)
Enables checkpointing for the streaming job.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.enableCheckpointing(long interval,
CheckpointingMode mode)
Enables checkpointing for the streaming job.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.enableCheckpointing(long interval,
CheckpointingMode mode,
boolean force)
Deprecated.
Use
enableCheckpointing(long, CheckpointingMode) instead. Forcing
checkpoints will be removed in the future. |
static StreamExecutionEnvironment |
StreamExecutionEnvironment.getExecutionEnvironment()
Creates an execution environment that represents the context in which the program is
currently executed.
|
static StreamExecutionEnvironment |
StreamExecutionEnvironment.getExecutionEnvironment(Configuration configuration)
Creates an execution environment that represents the context in which the program is
currently executed.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.registerSlotSharingGroup(SlotSharingGroup slotSharingGroup)
Register a slot sharing group with its resource spec.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setBufferTimeout(long timeoutMillis)
Sets the maximum time frequency (milliseconds) for the flushing of the output buffers.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setDefaultSavepointDirectory(Path savepointDirectory)
Sets the default savepoint directory, where savepoints will be written to if no is explicitly
provided when triggered.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setDefaultSavepointDirectory(String savepointDirectory)
Sets the default savepoint directory, where savepoints will be written to if no is explicitly
provided when triggered.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setDefaultSavepointDirectory(URI savepointDirectory)
Sets the default savepoint directory, where savepoints will be written to if no is explicitly
provided when triggered.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setMaxParallelism(int maxParallelism)
Sets the maximum degree of parallelism defined for the program.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setParallelism(int parallelism)
Sets the parallelism for operations executed through this environment.
|
StreamExecutionEnvironment |
StreamExecutionEnvironment.setRuntimeMode(RuntimeExecutionMode executionMode)
Sets the runtime execution mode for the application (see
RuntimeExecutionMode ). |
StreamExecutionEnvironment |
StreamExecutionEnvironment.setStateBackend(StateBackend backend)
Sets the state backend that describes how to store operator.
|
Modifier and Type | Method and Description |
---|---|
static <T,K> KeyedStream<T,K> |
FlinkKafkaShuffle.readKeyBy(String topic,
StreamExecutionEnvironment env,
TypeInformation<T> typeInformation,
Properties kafkaProperties,
KeySelector<T,K> keySelector)
|
Modifier and Type | Method and Description |
---|---|
static DataStream<Tuple2<String,Integer>> |
WindowJoinSampleData.GradeSource.getSource(StreamExecutionEnvironment env,
long rate) |
static DataStream<Tuple2<String,Integer>> |
WindowJoinSampleData.SalarySource.getSource(StreamExecutionEnvironment env,
long rate) |
Modifier and Type | Method and Description |
---|---|
static StreamExecutionEnvironment |
KafkaExampleUtil.prepareExecutionEnv(ParameterTool parameterTool) |
Modifier and Type | Method and Description |
---|---|
static void |
DataStreamAllroundTestJobFactory.setupEnvironment(StreamExecutionEnvironment env,
ParameterTool pt) |
Modifier and Type | Class and Description |
---|---|
class |
TestStreamEnvironment
A
StreamExecutionEnvironment that executes its jobs on MiniCluster . |
Modifier and Type | Field and Description |
---|---|
protected StreamExecutionEnvironment |
AbstractStreamTableEnvironmentImpl.executionEnvironment |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
AbstractStreamTableEnvironmentImpl.execEnv()
This is a temporary workaround for Python API.
|
Modifier and Type | Method and Description |
---|---|
static Executor |
AbstractStreamTableEnvironmentImpl.lookupExecutor(ClassLoader classLoader,
StreamExecutionEnvironment executionEnvironment) |
Constructor and Description |
---|
AbstractStreamTableEnvironmentImpl(CatalogManager catalogManager,
ModuleManager moduleManager,
ResourceManager resourceManager,
TableConfig tableConfig,
Executor executor,
FunctionCatalog functionCatalog,
Planner planner,
boolean isStreamingMode,
StreamExecutionEnvironment executionEnvironment) |
Modifier and Type | Method and Description |
---|---|
static StreamTableEnvironment |
StreamTableEnvironment.create(StreamExecutionEnvironment executionEnvironment)
Creates a table environment that is the entry point and central context for creating Table
and SQL API programs that integrate with the Java-specific
DataStream API. |
static StreamTableEnvironment |
StreamTableEnvironment.create(StreamExecutionEnvironment executionEnvironment,
EnvironmentSettings settings)
Creates a table environment that is the entry point and central context for creating Table
and SQL API programs that integrate with the Java-specific
DataStream API. |
Modifier and Type | Method and Description |
---|---|
static StreamTableEnvironment |
StreamTableEnvironmentImpl.create(StreamExecutionEnvironment executionEnvironment,
EnvironmentSettings settings) |
Constructor and Description |
---|
StreamTableEnvironmentImpl(CatalogManager catalogManager,
ModuleManager moduleManager,
ResourceManager resourceManager,
FunctionCatalog functionCatalog,
TableConfig tableConfig,
StreamExecutionEnvironment executionEnvironment,
Planner planner,
Executor executor,
boolean isStreamingMode) |
Modifier and Type | Method and Description |
---|---|
default DataStream<RowData> |
DataStreamScanProvider.produceDataStream(ProviderContext providerContext,
StreamExecutionEnvironment execEnv)
Creates a scan Java
DataStream from a StreamExecutionEnvironment . |
default DataStream<RowData> |
DataStreamScanProvider.produceDataStream(StreamExecutionEnvironment execEnv)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
Executor |
StreamExecutorFactory.create(StreamExecutionEnvironment streamExecutionEnvironment)
Creates a corresponding
Executor . |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
DefaultExecutor.getExecutionEnvironment() |
Modifier and Type | Method and Description |
---|---|
Executor |
DefaultExecutorFactory.create(StreamExecutionEnvironment executionEnvironment) |
Constructor and Description |
---|
DefaultExecutor(StreamExecutionEnvironment executionEnvironment) |
Modifier and Type | Method and Description |
---|---|
Executor |
DelegateExecutorFactory.create(StreamExecutionEnvironment streamExecutionEnvironment) |
Modifier and Type | Method and Description |
---|---|
protected Transformation<RowData> |
BatchExecLegacyTableSourceScan.createConversionTransformationIfNeeded(StreamExecutionEnvironment streamExecEnv,
ExecNodeConfig config,
ClassLoader classLoader,
Transformation<?> sourceTransform,
org.apache.calcite.rex.RexNode rowtimeExpression) |
protected <IN> Transformation<IN> |
BatchExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> inputFormat,
TypeInformation<IN> typeInfo) |
Transformation<RowData> |
BatchExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName) |
Modifier and Type | Method and Description |
---|---|
protected abstract Transformation<RowData> |
CommonExecLegacyTableSourceScan.createConversionTransformationIfNeeded(StreamExecutionEnvironment streamExecEnv,
ExecNodeConfig config,
ClassLoader classLoader,
Transformation<?> sourceTransform,
org.apache.calcite.rex.RexNode rowtimeExpression) |
protected abstract <IN> Transformation<IN> |
CommonExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> inputFormat,
TypeInformation<IN> typeInfo) |
protected abstract Transformation<RowData> |
CommonExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName)
Creates a
Transformation based on the given InputFormat . |
protected Transformation<Object> |
CommonExecSink.createSinkTransformation(StreamExecutionEnvironment streamExecEnv,
ExecNodeConfig config,
ClassLoader classLoader,
Transformation<RowData> inputTransform,
DynamicTableSink tableSink,
int rowtimeFieldIndex,
boolean upsertMaterialize,
int[] inputUpsertKey) |
protected Transformation<RowData> |
CommonExecTableSourceScan.createSourceFunctionTransformation(StreamExecutionEnvironment env,
SourceFunction<RowData> function,
boolean isBounded,
String operatorName,
TypeInformation<RowData> outputTypeInfo)
Adopted from
addSource(SourceFunction, String,
TypeInformation) but with custom Boundedness . |
Modifier and Type | Method and Description |
---|---|
protected Transformation<RowData> |
StreamExecLegacyTableSourceScan.createConversionTransformationIfNeeded(StreamExecutionEnvironment streamExecEnv,
ExecNodeConfig config,
ClassLoader classLoader,
Transformation<?> sourceTransform,
org.apache.calcite.rex.RexNode rowtimeExpression) |
protected <IN> Transformation<IN> |
StreamExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> format,
TypeInformation<IN> typeInfo) |
Transformation<RowData> |
StreamExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName) |
Modifier and Type | Method and Description |
---|---|
static Configuration |
CommonPythonUtil.extractPythonConfiguration(StreamExecutionEnvironment env,
ReadableConfig tableConfig,
ClassLoader classLoader) |
Modifier and Type | Class and Description |
---|---|
class |
DummyStreamExecutionEnvironment
This is dummy
StreamExecutionEnvironment , which holds a real StreamExecutionEnvironment , shares all configurations of the real environment, and disables all
configuration setting methods. |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.disableOperatorChaining() |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.enableCheckpointing() |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.enableCheckpointing(long interval) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.enableCheckpointing(long interval,
CheckpointingMode mode) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.enableCheckpointing(long interval,
CheckpointingMode mode,
boolean force) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.setBufferTimeout(long timeoutMillis) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.setMaxParallelism(int maxParallelism) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.setParallelism(int parallelism) |
StreamExecutionEnvironment |
DummyStreamExecutionEnvironment.setStateBackend(StateBackend backend) |
Constructor and Description |
---|
DummyStreamExecutionEnvironment(StreamExecutionEnvironment realExecEnv) |
Modifier and Type | Method and Description |
---|---|
DataStream<RowData> |
ArrowTableSource.getDataStream(StreamExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
DataStream<T> |
InputFormatTableSource.getDataStream(StreamExecutionEnvironment execEnv)
Deprecated.
|
DataStream<T> |
StreamTableSource.getDataStream(StreamExecutionEnvironment execEnv)
Deprecated.
Returns the data of the table as a
DataStream . |
DataStream<Row> |
CsvTableSource.getDataStream(StreamExecutionEnvironment execEnv)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
static void |
TestUtils.tryExecute(StreamExecutionEnvironment see,
String name)
Execute the job and wait for the job result synchronously.
|
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.