Package | Description |
---|---|
org.apache.flink.streaming.connectors.kinesis.internals | |
org.apache.flink.streaming.connectors.kinesis.model |
Modifier and Type | Method and Description |
---|---|
HashMap<StreamShardMetadata,SequenceNumber> |
KinesisDataFetcher.snapshotState()
Creates a snapshot of the current last processed sequence numbers of each subscribed shard.
|
Modifier and Type | Method and Description |
---|---|
protected ShardConsumer |
DynamoDBStreamsDataFetcher.createShardConsumer(Integer subscribedShardStateIndex,
StreamShardHandle handle,
SequenceNumber lastSeqNum,
ShardMetricsReporter shardMetricsReporter)
Create a new DynamoDB streams shard consumer.
|
protected ShardConsumer |
KinesisDataFetcher.createShardConsumer(Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
ShardMetricsReporter shardMetricsReporter)
Create a new shard consumer.
|
protected void |
KinesisDataFetcher.emitRecordAndUpdateState(T record,
long recordTimestamp,
int shardStateIndex,
SequenceNumber lastSequenceNumber)
Prepare a record and hand it over to the
RecordEmitter , which may collect it asynchronously. |
protected String |
ShardConsumer.getShardIterator(SequenceNumber sequenceNumber)
Returns a shard iterator for the given
SequenceNumber . |
protected String |
ShardConsumer.getShardIteratorForAggregatedSequenceNumber(SequenceNumber sequenceNumber) |
protected String |
ShardConsumer.getShardIteratorForRealSequenceNumber(SequenceNumber sequenceNumber) |
protected String |
ShardConsumer.getShardIteratorForSentinel(SequenceNumber sentinelSequenceNumber) |
protected void |
KinesisDataFetcher.updateState(int shardStateIndex,
SequenceNumber lastSequenceNumber)
Update the shard to last processed sequence number state.
|
Constructor and Description |
---|
ShardConsumer(KinesisDataFetcher<T> fetcherRef,
Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
KinesisProxyInterface kinesis,
ShardMetricsReporter shardMetricsReporter)
Creates a shard consumer.
|
Modifier and Type | Method and Description |
---|---|
SequenceNumber |
SentinelSequenceNumber.get() |
SequenceNumber |
KinesisStreamShardState.getLastProcessedSequenceNum() |
Modifier and Type | Method and Description |
---|---|
static boolean |
SentinelSequenceNumber.isSentinelSequenceNumber(SequenceNumber candidateSequenceNumber)
Returns
true if the given SequenceNumber is a sentinel. |
void |
KinesisStreamShardState.setLastProcessedSequenceNum(SequenceNumber update) |
Constructor and Description |
---|
KinesisStreamShardState(StreamShardMetadata streamShardMetadata,
StreamShardHandle streamShardHandle,
SequenceNumber lastProcessedSequenceNum) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.