IN
- Type of the input elements.OUT
- Type of the output elements.UDTFIN
- Type of the UDTF input type.@Internal public abstract class AbstractPythonTableFunctionOperator<IN,OUT,UDTFIN> extends AbstractStatelessFunctionOperator<IN,OUT,UDTFIN>
Modifier and Type | Field and Description |
---|---|
protected FlinkJoinType |
joinType
The correlate join type.
|
protected PythonFunctionInfo |
tableFunction
The Python
TableFunction to be executed. |
bais, baisWrapper, baos, baosWrapper, forwardedInputQueue, inputType, outputType, userDefinedFunctionInputOffsets, userDefinedFunctionInputType, userDefinedFunctionOutputType
elementCount, maxBundleSize, pythonFunctionRunner
chainingStrategy, latencyStats, LOG, metrics, output, processingTimeService
Constructor and Description |
---|
AbstractPythonTableFunctionOperator(Configuration config,
PythonFunctionInfo tableFunction,
RowType inputType,
RowType outputType,
int[] udtfInputOffsets,
FlinkJoinType joinType) |
Modifier and Type | Method and Description |
---|---|
String |
getFunctionUrn() |
String |
getInputOutputCoderUrn() |
PythonEnv |
getPythonEnv()
Returns the
PythonEnv used to create PythonEnvironmentManager.. |
FlinkFnApi.UserDefinedFunctions |
getUserDefinedFunctionsProto()
Gets the proto representation of the Python user-defined functions to be executed.
|
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g.
|
bufferInput, createPythonFunctionRunner, getFunctionInput, processElement, processElementInternal
endInput
checkInvokeFinishBundleByCount, close, createPythonEnvironmentManager, dispose, emitResult, emitResults, getConfig, getFlinkMetricContainer, getPythonConfig, invokeFinishBundle, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey, setPythonConfig
getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
setKeyContextElement
close, dispose, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState
notifyCheckpointAborted, notifyCheckpointComplete
getCurrentKey, setCurrentKey
processLatencyMarker, processWatermark
protected final PythonFunctionInfo tableFunction
TableFunction
to be executed.protected final FlinkJoinType joinType
public AbstractPythonTableFunctionOperator(Configuration config, PythonFunctionInfo tableFunction, RowType inputType, RowType outputType, int[] udtfInputOffsets, FlinkJoinType joinType)
public void open() throws Exception
AbstractStreamOperator
The default implementation does nothing.
open
in interface StreamOperator<OUT>
open
in class AbstractStatelessFunctionOperator<IN,OUT,UDTFIN>
Exception
- An exception in this method causes the operator to fail.public PythonEnv getPythonEnv()
AbstractPythonFunctionOperator
PythonEnv
used to create PythonEnvironmentManager..getPythonEnv
in class AbstractPythonFunctionOperator<OUT>
public String getInputOutputCoderUrn()
getInputOutputCoderUrn
in class AbstractStatelessFunctionOperator<IN,OUT,UDTFIN>
public String getFunctionUrn()
getFunctionUrn
in class AbstractStatelessFunctionOperator<IN,OUT,UDTFIN>
public FlinkFnApi.UserDefinedFunctions getUserDefinedFunctionsProto()
AbstractStatelessFunctionOperator
getUserDefinedFunctionsProto
in class AbstractStatelessFunctionOperator<IN,OUT,UDTFIN>
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.