public class ProcTimeMiniBatchAssignerOperator extends AbstractStreamOperator<RowData> implements OneInputStreamOperator<RowData,RowData>, ProcessingTimeCallback
NOTE: currently, we use
Watermark to represents the mini-batch marker.
The difference between this operator and
RowTimeMiniBatchAssginerOperator is that,
this operator generates watermarks by itself using processing time, but the other forwards
watermarks from upstream.
|Constructor and Description|
|Modifier and Type||Method and Description|
This method is invoked with the timestamp for which the trigger was scheduled.
This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g.
Processes one element that arrived on this input of the
Override the base implementation to completely ignore watermarks propagated from upstream (we rely only on the
close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
close, finish, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState
public ProcTimeMiniBatchAssignerOperator(long intervalMs)
public void open() throws Exception
The default implementation does nothing.
public void processElement(StreamRecord<RowData> element) throws Exception
MultipleInputStreamOperator. This method is guaranteed to not be called concurrently with other methods of the operator.
public void onProcessingTime(long timestamp) throws Exception
If the triggering is delayed for whatever reason (trigger timer was blocked, JVM stalled due to a garbage collection), the timestamp supplied to this function will still be the original timestamp for which the trigger was scheduled.
AssignerWithPeriodicWatermarksto emit watermarks from here).
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.