@Internal public class RowDataArrowPythonScalarFunctionRunner extends AbstractArrowPythonScalarFunctionRunner<RowData>
PythonFunctionRunner
used to execute Arrow Python ScalarFunction
s. It takes
RowData
as the input type.root
baos, baosWrapper, flinkMetricContainer, mainInputReceiver, resultReceiver
Constructor and Description |
---|
RowDataArrowPythonScalarFunctionRunner(String taskName,
org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver,
PythonFunctionInfo[] scalarFunctions,
PythonEnvironmentManager environmentManager,
RowType inputType,
RowType outputType,
int maxBatchSize,
Map<String,String> jobOptions,
FlinkMetricContainer flinkMetricContainer) |
Modifier and Type | Method and Description |
---|---|
ArrowWriter<RowData> |
createArrowWriter()
Creates an
ArrowWriter . |
close, createOutputReceiverFactory, finishBundle, getInputOutputCoderUrn, open, processElement
getUserDefinedFunctionsProto
createExecutableStage, getInputType, getOutputType, getUserDefinedFunctionProto
createJobBundleFactory, createPythonExecutionEnvironment, startBundle
public RowDataArrowPythonScalarFunctionRunner(String taskName, org.apache.beam.sdk.fn.data.FnDataReceiver<byte[]> resultReceiver, PythonFunctionInfo[] scalarFunctions, PythonEnvironmentManager environmentManager, RowType inputType, RowType outputType, int maxBatchSize, Map<String,String> jobOptions, FlinkMetricContainer flinkMetricContainer)
public ArrowWriter<RowData> createArrowWriter()
AbstractArrowPythonScalarFunctionRunner
ArrowWriter
.createArrowWriter
in class AbstractArrowPythonScalarFunctionRunner<RowData>
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.