@Internal public class FlinkKafkaShuffleProducer<IN,KEY> extends FlinkKafkaProducer<IN>
FlinkKafkaProducer
in the way
handling elements and watermarksModifier and Type | Class and Description |
---|---|
static class |
FlinkKafkaShuffleProducer.KafkaSerializer<IN>
Flink Kafka Shuffle Serializer.
|
FlinkKafkaProducer.ContextStateSerializer, FlinkKafkaProducer.KafkaTransactionContext, FlinkKafkaProducer.KafkaTransactionState, FlinkKafkaProducer.NextTransactionalIdHint, FlinkKafkaProducer.NextTransactionalIdHintSerializer, FlinkKafkaProducer.Semantic, FlinkKafkaProducer.TransactionStateSerializer
TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.StateSerializerConfigSnapshot<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>, TwoPhaseCommitSinkFunction.TransactionHolder<TXN>
SinkFunction.Context
asyncException, callback, DEFAULT_KAFKA_PRODUCERS_POOL_SIZE, DEFAULT_KAFKA_TRANSACTION_TIMEOUT, defaultTopicId, KEY_DISABLE_METRICS, pendingRecords, producerConfig, SAFE_SCALE_DOWN_FACTOR, semantic, topicPartitionsMap, writeTimestampToKafka
pendingCommitTransactions, state, userContext
Modifier and Type | Method and Description |
---|---|
void |
invoke(FlinkKafkaProducer.KafkaTransactionState transaction,
IN next,
SinkFunction.Context context)
This is the function invoked to handle each element.
|
void |
invoke(Watermark watermark)
This is the function invoked to handle each watermark.
|
abort, acknowledgeMessage, beginTransaction, checkErroneous, close, commit, createProducer, finishRecoveringContext, getPartitionsByTopic, ignoreFailuresAfterTransactionTimeout, initializeState, initializeUserContext, open, preCommit, recoverAndAbort, recoverAndCommit, setLogFailuresOnly, setWriteTimestampToKafka, snapshotState
currentTransaction, enableTransactionTimeoutWarnings, getUserContext, invoke, invoke, notifyCheckpointAborted, notifyCheckpointComplete, pendingTransactions, setTransactionTimeout
getIterationRuntimeContext, getRuntimeContext, setRuntimeContext
public void invoke(FlinkKafkaProducer.KafkaTransactionState transaction, IN next, SinkFunction.Context context) throws FlinkKafkaException
invoke
in class FlinkKafkaProducer<IN>
transaction
- Transaction state; elements are written to Kafka in transactions to
guarantee different level of data consistencynext
- Element to handlecontext
- Context needed to handle the elementFlinkKafkaException
- for kafka errorpublic void invoke(Watermark watermark) throws FlinkKafkaException
watermark
- Watermark to handleFlinkKafkaException
- For kafka errorCopyright © 2014–2021 The Apache Software Foundation. All rights reserved.