@PublicEvolving public class ConsumerConfigConstants extends AWSConfigConstants
FlinkKinesisConsumer
.Modifier and Type | Class and Description |
---|---|
static class |
ConsumerConfigConstants.InitialPosition
The initial position to start reading shards from.
|
AWSConfigConstants.CredentialProvider
Modifier and Type | Field and Description |
---|---|
static long |
DEFAULT_LIST_SHARDS_BACKOFF_BASE |
static double |
DEFAULT_LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT |
static long |
DEFAULT_LIST_SHARDS_BACKOFF_MAX |
static int |
DEFAULT_LIST_SHARDS_RETRIES |
static long |
DEFAULT_SHARD_DISCOVERY_INTERVAL_MILLIS |
static long |
DEFAULT_SHARD_GETITERATOR_BACKOFF_BASE |
static double |
DEFAULT_SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT |
static long |
DEFAULT_SHARD_GETITERATOR_BACKOFF_MAX |
static int |
DEFAULT_SHARD_GETITERATOR_RETRIES |
static long |
DEFAULT_SHARD_GETRECORDS_BACKOFF_BASE |
static double |
DEFAULT_SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT |
static long |
DEFAULT_SHARD_GETRECORDS_BACKOFF_MAX |
static long |
DEFAULT_SHARD_GETRECORDS_INTERVAL_MILLIS |
static int |
DEFAULT_SHARD_GETRECORDS_MAX |
static int |
DEFAULT_SHARD_GETRECORDS_RETRIES |
static long |
DEFAULT_SHARD_IDLE_INTERVAL_MILLIS |
static boolean |
DEFAULT_SHARD_USE_ADAPTIVE_READS |
static long |
DEFAULT_STREAM_DESCRIBE_BACKOFF_BASE |
static double |
DEFAULT_STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT |
static long |
DEFAULT_STREAM_DESCRIBE_BACKOFF_MAX |
static String |
DEFAULT_STREAM_INITIAL_POSITION |
static String |
DEFAULT_STREAM_TIMESTAMP_DATE_FORMAT |
static long |
DEFAULT_WATERMARK_SYNC_MILLIS |
static String |
LIST_SHARDS_BACKOFF_BASE
The base backoff time between each listShards attempt.
|
static String |
LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT
The power constant for exponential backoff between each listShards attempt.
|
static String |
LIST_SHARDS_BACKOFF_MAX
The maximum backoff time between each listShards attempt.
|
static String |
LIST_SHARDS_RETRIES
The maximum number of listShards attempts if we get a recoverable exception.
|
static long |
MAX_SHARD_GETRECORDS_INTERVAL_MILLIS
To avoid shard iterator expires in
ShardConsumer s, the value for the configured
getRecords interval can not exceed 5 minutes, which is the expire time for retrieved
iterators. |
static String |
SHARD_DISCOVERY_INTERVAL_MILLIS
The interval between each attempt to discover new shards.
|
static String |
SHARD_GETITERATOR_BACKOFF_BASE
The base backoff time between getShardIterator attempts if we get a
ProvisionedThroughputExceededException.
|
static String |
SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT
The power constant for exponential backoff between each getShardIterator attempt.
|
static String |
SHARD_GETITERATOR_BACKOFF_MAX
The maximum backoff time between getShardIterator attempts if we get a
ProvisionedThroughputExceededException.
|
static String |
SHARD_GETITERATOR_RETRIES
The maximum number of getShardIterator attempts if we get
ProvisionedThroughputExceededException.
|
static String |
SHARD_GETRECORDS_BACKOFF_BASE
The base backoff time between getRecords attempts if we get a
ProvisionedThroughputExceededException.
|
static String |
SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT
The power constant for exponential backoff between each getRecords attempt.
|
static String |
SHARD_GETRECORDS_BACKOFF_MAX
The maximum backoff time between getRecords attempts if we get a
ProvisionedThroughputExceededException.
|
static String |
SHARD_GETRECORDS_INTERVAL_MILLIS
The interval between each getRecords request to a AWS Kinesis shard in milliseconds.
|
static String |
SHARD_GETRECORDS_MAX
The maximum number of records to try to get each time we fetch records from a AWS Kinesis
shard.
|
static String |
SHARD_GETRECORDS_RETRIES
The maximum number of getRecords attempts if we get a recoverable exception.
|
static String |
SHARD_IDLE_INTERVAL_MILLIS
The interval after which to consider a shard idle for purposes of watermark generation.
|
static String |
SHARD_USE_ADAPTIVE_READS
The config to turn on adaptive reads from a shard.
|
static String |
STREAM_DESCRIBE_BACKOFF_BASE
The base backoff time between each describeStream attempt (for consuming from DynamoDB
streams).
|
static String |
STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT
The power constant for exponential backoff between each describeStream attempt (for consuming
from DynamoDB streams).
|
static String |
STREAM_DESCRIBE_BACKOFF_MAX
The maximum backoff time between each describeStream attempt (for consuming from DynamoDB
streams).
|
static String |
STREAM_INITIAL_POSITION
The initial position to start reading Kinesis streams from (LATEST is used if not set).
|
static String |
STREAM_INITIAL_TIMESTAMP
The initial timestamp to start reading Kinesis stream from (when AT_TIMESTAMP is set for
STREAM_INITIAL_POSITION).
|
static String |
STREAM_TIMESTAMP_DATE_FORMAT
The date format of initial timestamp to start reading Kinesis stream from (when AT_TIMESTAMP
is set for STREAM_INITIAL_POSITION).
|
static String |
WATERMARK_LOOKAHEAD_MILLIS
The maximum delta allowed for the reader to advance ahead of the shared global watermark.
|
static String |
WATERMARK_SYNC_MILLIS
The interval for periodically synchronizing the shared watermark state.
|
static String |
WATERMARK_SYNC_QUEUE_CAPACITY
The maximum number of records that will be buffered before suspending consumption of a shard.
|
AWS_ACCESS_KEY_ID, AWS_CREDENTIALS_PROVIDER, AWS_ENDPOINT, AWS_PROFILE_NAME, AWS_PROFILE_PATH, AWS_REGION, AWS_ROLE_ARN, AWS_ROLE_CREDENTIALS_PROVIDER, AWS_ROLE_EXTERNAL_ID, AWS_ROLE_SESSION_NAME, AWS_SECRET_ACCESS_KEY, AWS_WEB_IDENTITY_TOKEN_FILE
Constructor and Description |
---|
ConsumerConfigConstants() |
accessKeyId, externalId, profileName, profilePath, roleArn, roleCredentialsProvider, roleSessionName, secretKey, webIdentityTokenFile
public static final String STREAM_INITIAL_POSITION
public static final String STREAM_INITIAL_TIMESTAMP
public static final String STREAM_TIMESTAMP_DATE_FORMAT
public static final String STREAM_DESCRIBE_BACKOFF_BASE
public static final String STREAM_DESCRIBE_BACKOFF_MAX
public static final String STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT
public static final String LIST_SHARDS_RETRIES
public static final String LIST_SHARDS_BACKOFF_BASE
public static final String LIST_SHARDS_BACKOFF_MAX
public static final String LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT
public static final String SHARD_GETRECORDS_MAX
public static final String SHARD_GETRECORDS_RETRIES
public static final String SHARD_GETRECORDS_BACKOFF_BASE
public static final String SHARD_GETRECORDS_BACKOFF_MAX
public static final String SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT
public static final String SHARD_GETRECORDS_INTERVAL_MILLIS
public static final String SHARD_GETITERATOR_RETRIES
public static final String SHARD_GETITERATOR_BACKOFF_BASE
public static final String SHARD_GETITERATOR_BACKOFF_MAX
public static final String SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT
public static final String SHARD_DISCOVERY_INTERVAL_MILLIS
public static final String SHARD_USE_ADAPTIVE_READS
public static final String SHARD_IDLE_INTERVAL_MILLIS
public static final String WATERMARK_SYNC_MILLIS
public static final String WATERMARK_LOOKAHEAD_MILLIS
public static final String WATERMARK_SYNC_QUEUE_CAPACITY
public static final String DEFAULT_STREAM_INITIAL_POSITION
public static final String DEFAULT_STREAM_TIMESTAMP_DATE_FORMAT
public static final long DEFAULT_STREAM_DESCRIBE_BACKOFF_BASE
public static final long DEFAULT_STREAM_DESCRIBE_BACKOFF_MAX
public static final double DEFAULT_STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT
public static final long DEFAULT_LIST_SHARDS_BACKOFF_BASE
public static final long DEFAULT_LIST_SHARDS_BACKOFF_MAX
public static final double DEFAULT_LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT
public static final int DEFAULT_LIST_SHARDS_RETRIES
public static final int DEFAULT_SHARD_GETRECORDS_MAX
public static final int DEFAULT_SHARD_GETRECORDS_RETRIES
public static final long DEFAULT_SHARD_GETRECORDS_BACKOFF_BASE
public static final long DEFAULT_SHARD_GETRECORDS_BACKOFF_MAX
public static final double DEFAULT_SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT
public static final long DEFAULT_SHARD_GETRECORDS_INTERVAL_MILLIS
public static final int DEFAULT_SHARD_GETITERATOR_RETRIES
public static final long DEFAULT_SHARD_GETITERATOR_BACKOFF_BASE
public static final long DEFAULT_SHARD_GETITERATOR_BACKOFF_MAX
public static final double DEFAULT_SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT
public static final long DEFAULT_SHARD_DISCOVERY_INTERVAL_MILLIS
public static final boolean DEFAULT_SHARD_USE_ADAPTIVE_READS
public static final long DEFAULT_SHARD_IDLE_INTERVAL_MILLIS
public static final long DEFAULT_WATERMARK_SYNC_MILLIS
public static final long MAX_SHARD_GETRECORDS_INTERVAL_MILLIS
ShardConsumer
s, the value for the configured
getRecords interval can not exceed 5 minutes, which is the expire time for retrieved
iterators.Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.