T
- The type of elements produced by the fetcher.public class Kafka09Fetcher<T> extends AbstractFetcher<T,org.apache.kafka.common.TopicPartition> implements Runnable
useMetrics
Constructor and Description |
---|
Kafka09Fetcher(SourceFunction.SourceContext<T> sourceContext,
List<KafkaTopicPartition> assignedPartitions,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
KeyedDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
boolean useMetrics) |
Modifier and Type | Method and Description |
---|---|
void |
cancel() |
void |
commitSpecificOffsetsToKafka(Map<KafkaTopicPartition,Long> offsets)
Commits the given partition offsets to the Kafka brokers (or to ZooKeeper for
older Kafka versions).
|
static List<org.apache.kafka.common.TopicPartition> |
convertKafkaPartitions(KafkaTopicPartitionState<org.apache.kafka.common.TopicPartition>[] partitions) |
org.apache.kafka.common.TopicPartition |
createKafkaPartitionHandle(KafkaTopicPartition partition)
Creates the Kafka version specific representation of the given
topic partition.
|
void |
run() |
void |
runFetchLoop() |
addOffsetStateGauge, emitRecord, restoreOffsets, snapshotCurrentState, subscribedPartitions
public Kafka09Fetcher(SourceFunction.SourceContext<T> sourceContext, List<KafkaTopicPartition> assignedPartitions, SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic, SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated, StreamingRuntimeContext runtimeContext, KeyedDeserializationSchema<T> deserializer, Properties kafkaProperties, long pollTimeout, boolean useMetrics) throws Exception
Exception
public void runFetchLoop() throws Exception
runFetchLoop
in class AbstractFetcher<T,org.apache.kafka.common.TopicPartition>
Exception
public void cancel()
cancel
in class AbstractFetcher<T,org.apache.kafka.common.TopicPartition>
public org.apache.kafka.common.TopicPartition createKafkaPartitionHandle(KafkaTopicPartition partition)
AbstractFetcher
createKafkaPartitionHandle
in class AbstractFetcher<T,org.apache.kafka.common.TopicPartition>
partition
- The Flink representation of the Kafka topic partition.public void commitSpecificOffsetsToKafka(Map<KafkaTopicPartition,Long> offsets) throws Exception
AbstractFetcher
commitSpecificOffsetsToKafka
in class AbstractFetcher<T,org.apache.kafka.common.TopicPartition>
offsets
- The offsets to commit to Kafka.Exception
- This method forwards exceptions.public static List<org.apache.kafka.common.TopicPartition> convertKafkaPartitions(KafkaTopicPartitionState<org.apache.kafka.common.TopicPartition>[] partitions)
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.