Modifier and Type | Method and Description |
---|---|
MetricGroup |
RuntimeContext.getMetricGroup()
Returns the metric group for this parallel subtask.
|
Modifier and Type | Method and Description |
---|---|
MetricGroup |
AbstractRuntimeUDFContext.getMetricGroup() |
Constructor and Description |
---|
AbstractRuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Accumulator<?,?>> accumulators,
Map<String,Future<Path>> cpTasks,
MetricGroup metrics) |
RuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Future<Path>> cpTasks,
Map<String,Accumulator<?,?>> accumulators,
MetricGroup metrics) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
RocksDBStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Constructor and Description |
---|
RocksDBKeyedStateBackendBuilder(String operatorIdentifier,
ClassLoader userCodeClassLoader,
File instanceBasePath,
RocksDBResourceContainer optionsContainer,
java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
TaskKvStateRegistry kvStateRegistry,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
ExecutionConfig executionConfig,
LocalRecoveryConfig localRecoveryConfig,
RocksDBStateBackend.PriorityQueueStateType priorityQueueStateType,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
StreamCompressionDecorator keyGroupCompressionDecorator,
CloseableRegistry cancelStreamRegistry) |
RocksDBNativeMetricMonitor(RocksDBNativeMetricOptions options,
MetricGroup metricGroup,
org.rocksdb.RocksDB rocksDB) |
Modifier and Type | Field and Description |
---|---|
protected MetricGroup |
AbstractRocksDBRestoreOperation.metricGroup |
Constructor and Description |
---|
AbstractRocksDBRestoreOperation(KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
int numberOfTransferringThreads,
CloseableRegistry cancelStreamRegistry,
ClassLoader userCodeClassLoader,
Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
StateSerializerProvider<K> keySerializerProvider,
File instanceBasePath,
File instanceRocksDBPath,
org.rocksdb.DBOptions dbOptions,
java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
RocksDBNativeMetricOptions nativeMetricOptions,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
RocksDbTtlCompactFiltersManager ttlCompactFiltersManager) |
RocksDBFullRestoreOperation(KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
int numberOfTransferringThreads,
CloseableRegistry cancelStreamRegistry,
ClassLoader userCodeClassLoader,
Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
StateSerializerProvider<K> keySerializerProvider,
File instanceBasePath,
File instanceRocksDBPath,
org.rocksdb.DBOptions dbOptions,
java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
RocksDBNativeMetricOptions nativeMetricOptions,
MetricGroup metricGroup,
Collection<KeyedStateHandle> restoreStateHandles,
RocksDbTtlCompactFiltersManager ttlCompactFiltersManager,
long writeBatchSize) |
RocksDBIncrementalRestoreOperation(String operatorIdentifier,
KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
int numberOfTransferringThreads,
CloseableRegistry cancelStreamRegistry,
ClassLoader userCodeClassLoader,
Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
StateSerializerProvider<K> keySerializerProvider,
File instanceBasePath,
File instanceRocksDBPath,
org.rocksdb.DBOptions dbOptions,
java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
RocksDBNativeMetricOptions nativeMetricOptions,
MetricGroup metricGroup,
Collection<KeyedStateHandle> restoreStateHandles,
RocksDbTtlCompactFiltersManager ttlCompactFiltersManager,
long writeBatchSize) |
RocksDBNoneRestoreOperation(KeyGroupRange keyGroupRange,
int keyGroupPrefixBytes,
int numberOfTransferringThreads,
CloseableRegistry cancelStreamRegistry,
ClassLoader userCodeClassLoader,
Map<String,RocksDBKeyedStateBackend.RocksDbKvStateInfo> kvStateInformation,
StateSerializerProvider<K> keySerializerProvider,
File instanceBasePath,
File instanceRocksDBPath,
org.rocksdb.DBOptions dbOptions,
java.util.function.Function<String,org.rocksdb.ColumnFamilyOptions> columnFamilyOptionsFactory,
RocksDBNativeMetricOptions nativeMetricOptions,
MetricGroup metricGroup,
Collection<KeyedStateHandle> restoreStateHandles,
RocksDbTtlCompactFiltersManager ttlCompactFiltersManager) |
Modifier and Type | Method and Description |
---|---|
void |
ScheduledDropwizardReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
ScheduledDropwizardReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group) |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
MetricGroup.addGroup(int name)
Creates a new MetricGroup and adds it to this groups sub-groups.
|
MetricGroup |
MetricGroup.addGroup(String name)
Creates a new MetricGroup and adds it to this groups sub-groups.
|
MetricGroup |
MetricGroup.addGroup(String key,
String value)
Creates a new key-value MetricGroup pair.
|
Modifier and Type | Method and Description |
---|---|
void |
DatadogHttpReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
DatadogHttpReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group) |
Modifier and Type | Class and Description |
---|---|
class |
UnregisteredMetricsGroup
A special
MetricGroup that does not register any metrics at the metrics registry
and any reporters. |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
UnregisteredMetricsGroup.addGroup(int name) |
MetricGroup |
UnregisteredMetricsGroup.addGroup(String name) |
MetricGroup |
UnregisteredMetricsGroup.addGroup(String key,
String value) |
Modifier and Type | Method and Description |
---|---|
void |
JMXReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
JMXReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group) |
Modifier and Type | Method and Description |
---|---|
void |
AbstractPrometheusReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
AbstractPrometheusReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group) |
Modifier and Type | Method and Description |
---|---|
void |
AbstractReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
MetricReporter.notifyOfAddedMetric(Metric metric,
String metricName,
MetricGroup group)
Called when a new
Metric was added. |
void |
AbstractReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group) |
void |
MetricReporter.notifyOfRemovedMetric(Metric metric,
String metricName,
MetricGroup group)
Called when a
Metric was should be removed. |
Constructor and Description |
---|
CheckpointStatsTracker(int numRememberedCheckpoints,
List<ExecutionJobVertex> jobVertices,
CheckpointCoordinatorConfiguration jobCheckpointingConfiguration,
MetricGroup metricGroup)
Creates a new checkpoint stats tracker.
|
Modifier and Type | Method and Description |
---|---|
static ExecutionGraph |
ExecutionGraphBuilder.buildGraph(ExecutionGraph prior,
JobGraph jobGraph,
Configuration jobManagerConfig,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
SlotProvider slotProvider,
ClassLoader classLoader,
CheckpointRecoveryFactory recoveryFactory,
Time rpcTimeout,
RestartStrategy restartStrategy,
MetricGroup metrics,
BlobWriter blobWriter,
Time allocationTimeout,
org.slf4j.Logger log,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker)
Builds the ExecutionGraph from the JobGraph.
|
static ExecutionGraph |
ExecutionGraphBuilder.buildGraph(ExecutionGraph prior,
JobGraph jobGraph,
Configuration jobManagerConfig,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
SlotProvider slotProvider,
ClassLoader classLoader,
CheckpointRecoveryFactory recoveryFactory,
Time rpcTimeout,
RestartStrategy restartStrategy,
MetricGroup metrics,
BlobWriter blobWriter,
Time allocationTimeout,
org.slf4j.Logger log,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
FailoverStrategy.Factory failoverStrategyFactory) |
Modifier and Type | Method and Description |
---|---|
void |
RestartIndividualStrategy.registerMetrics(MetricGroup metricGroup) |
void |
FailoverStrategy.registerMetrics(MetricGroup metricGroup)
Tells the FailoverStrategy to register its metrics.
|
Modifier and Type | Method and Description |
---|---|
ShuffleIOOwnerContext |
NettyShuffleEnvironment.createShuffleIOOwnerContext(String ownerName,
ExecutionAttemptID executionAttemptID,
MetricGroup parentGroup) |
void |
NettyShuffleEnvironment.registerLegacyNetworkMetrics(MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
Modifier and Type | Method and Description |
---|---|
static MetricGroup |
NettyShuffleMetricFactory.createShuffleIOOwnerMetricGroup(MetricGroup parentGroup) |
Modifier and Type | Method and Description |
---|---|
static MetricGroup |
NettyShuffleMetricFactory.createShuffleIOOwnerMetricGroup(MetricGroup parentGroup) |
static void |
NettyShuffleMetricFactory.registerInputMetrics(boolean isDetailedMetrics,
MetricGroup inputGroup,
SingleInputGate[] inputGates) |
static void |
NettyShuffleMetricFactory.registerLegacyNetworkMetrics(boolean isDetailedMetrics,
MetricGroup metricGroup,
ResultPartitionWriter[] producedPartitions,
InputGate[] inputGates)
Deprecated.
should be removed in future
|
static void |
NettyShuffleMetricFactory.registerOutputMetrics(boolean isDetailedMetrics,
MetricGroup outputGroup,
ResultPartition[] resultPartitions) |
static void |
ResultPartitionMetrics.registerQueueLengthMetrics(MetricGroup parent,
ResultPartition[] partitions) |
static void |
InputGateMetrics.registerQueueLengthMetrics(MetricGroup parent,
SingleInputGate[] gates) |
static void |
NettyShuffleMetricFactory.registerShuffleMetrics(MetricGroup metricGroup,
NetworkBufferPool networkBufferPool) |
Constructor and Description |
---|
InputChannelMetrics(MetricGroup... parents) |
Modifier and Type | Method and Description |
---|---|
DistributedRuntimeUDFContext |
AbstractIterativeTask.createRuntimeContext(MetricGroup metrics) |
Modifier and Type | Class and Description |
---|---|
class |
ProxyMetricGroup<P extends MetricGroup>
Metric group which forwards all registration calls to its parent metric group.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractMetricGroup<A extends AbstractMetricGroup<?>>
Abstract
MetricGroup that contains key functionality for adding metrics and groups. |
class |
ComponentMetricGroup<P extends AbstractMetricGroup<?>>
Abstract
MetricGroup for system components (e.g.,
TaskManager, Job, Task, Operator). |
class |
FrontMetricGroup<P extends AbstractMetricGroup<?>>
Metric group which forwards all registration calls to a variable parent metric group that injects a variable reporter
index into calls to
getMetricIdentifier(String)
or getMetricIdentifier(String, CharacterFilter) . |
class |
GenericKeyMetricGroup
A
GenericMetricGroup for representing the key part of a key-value metric group pair. |
class |
GenericMetricGroup
A simple named
MetricGroup that is used to hold
subgroups of metrics. |
class |
GenericValueMetricGroup
A
GenericMetricGroup for representing the value part of a key-value metric group pair. |
class |
JobManagerJobMetricGroup
Special
MetricGroup representing everything belonging to
a specific job, running on the JobManager. |
class |
JobManagerMetricGroup
Special
MetricGroup representing a JobManager. |
class |
JobMetricGroup<C extends ComponentMetricGroup<C>>
Special abstract
MetricGroup representing everything belonging to
a specific job. |
class |
OperatorIOMetricGroup
Metric group that contains shareable pre-defined IO-related metrics.
|
class |
OperatorMetricGroup
Special
MetricGroup representing an Operator. |
class |
ProcessMetricGroup
AbstractImitatingJobManagerMetricGroup implementation for process related metrics. |
class |
ProxyMetricGroup<P extends MetricGroup>
Metric group which forwards all registration calls to its parent metric group.
|
class |
ResourceManagerMetricGroup
Metric group which is used by the
ResourceManager to register metrics. |
class |
TaskIOMetricGroup
Metric group that contains shareable pre-defined IO-related metrics.
|
class |
TaskManagerJobMetricGroup
Special
MetricGroup representing everything belonging to
a specific job, running on the TaskManager. |
class |
TaskManagerMetricGroup
Special
MetricGroup representing a TaskManager. |
class |
TaskMetricGroup
Special
MetricGroup representing a Flink runtime Task. |
static class |
UnregisteredMetricGroups.UnregisteredJobManagerJobMetricGroup
A safe drop-in replacement for
JobManagerJobMetricGroup s. |
static class |
UnregisteredMetricGroups.UnregisteredJobManagerMetricGroup
A safe drop-in replacement for
JobManagerMetricGroup s. |
static class |
UnregisteredMetricGroups.UnregisteredOperatorMetricGroup
A safe drop-in replacement for
OperatorMetricGroup s. |
static class |
UnregisteredMetricGroups.UnregisteredProcessMetricGroup
A safe drop-in replacement for
ProcessMetricGroups . |
static class |
UnregisteredMetricGroups.UnregisteredResourceManagerMetricGroup
A safe drop-in replacement for
ResourceManagerMetricGroups . |
static class |
UnregisteredMetricGroups.UnregisteredTaskManagerJobMetricGroup
A safe drop-in replacement for
TaskManagerJobMetricGroup s. |
static class |
UnregisteredMetricGroups.UnregisteredTaskManagerMetricGroup
A safe drop-in replacement for
TaskManagerMetricGroup s. |
static class |
UnregisteredMetricGroups.UnregisteredTaskMetricGroup
A safe drop-in replacement for
TaskMetricGroup s. |
Modifier and Type | Field and Description |
---|---|
protected P |
ProxyMetricGroup.parentMetricGroup |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
ProxyMetricGroup.addGroup(int name) |
MetricGroup |
AbstractMetricGroup.addGroup(int name) |
MetricGroup |
ProxyMetricGroup.addGroup(String name) |
MetricGroup |
AbstractMetricGroup.addGroup(String name) |
MetricGroup |
ProxyMetricGroup.addGroup(String key,
String value) |
MetricGroup |
AbstractMetricGroup.addGroup(String key,
String value) |
MetricGroup |
GenericKeyMetricGroup.addGroup(String key,
String value) |
Modifier and Type | Method and Description |
---|---|
static Tuple2<TaskManagerMetricGroup,MetricGroup> |
MetricUtils.instantiateTaskManagerMetricGroup(MetricRegistry metricRegistry,
String hostName,
ResourceID resourceID,
Optional<Time> systemResourceProbeInterval) |
Modifier and Type | Method and Description |
---|---|
static void |
MetricUtils.instantiateStatusMetrics(MetricGroup metricGroup) |
static void |
SystemResourcesMetricsInitializer.instantiateSystemMetrics(MetricGroup metricGroup,
Time probeInterval) |
Modifier and Type | Method and Description |
---|---|
DistributedRuntimeUDFContext |
BatchTask.createRuntimeContext(MetricGroup metrics) |
Constructor and Description |
---|
DistributedRuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Future<Path>> cpTasks,
Map<String,Accumulator<?,?>> accumulators,
MetricGroup metrics) |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
ShuffleIOOwnerContext.getInputGroup() |
MetricGroup |
ShuffleIOOwnerContext.getOutputGroup() |
MetricGroup |
ShuffleIOOwnerContext.getParentGroup() |
MetricGroup |
ShuffleEnvironmentContext.getParentMetricGroup() |
Modifier and Type | Method and Description |
---|---|
ShuffleIOOwnerContext |
ShuffleEnvironment.createShuffleIOOwnerContext(String ownerName,
ExecutionAttemptID executionAttemptID,
MetricGroup parentGroup)
Create a context of the shuffle input/output owner used to create partitions or gates belonging to the owner.
|
Constructor and Description |
---|
ShuffleEnvironmentContext(Configuration configuration,
ResourceID taskExecutorResourceId,
MemorySize networkMemorySize,
boolean localCommunicationOnly,
InetAddress hostAddress,
TaskEventPublisher eventPublisher,
MetricGroup parentMetricGroup,
Executor ioExecutor) |
ShuffleIOOwnerContext(String ownerName,
ExecutionAttemptID executionAttemptID,
MetricGroup parentGroup,
MetricGroup outputGroup,
MetricGroup inputGroup) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
StateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry)
Creates a new
AbstractKeyedStateBackend that is responsible for holding keyed state
and checkpointing it. |
abstract <K> AbstractKeyedStateBackend<K> |
AbstractStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
FsStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Modifier and Type | Method and Description |
---|---|
<K> AbstractKeyedStateBackend<K> |
MemoryStateBackend.createKeyedStateBackend(Environment env,
JobID jobID,
String operatorIdentifier,
TypeSerializer<K> keySerializer,
int numberOfKeyGroups,
KeyGroupRange keyGroupRange,
TaskKvStateRegistry kvStateRegistry,
TtlTimeProvider ttlTimeProvider,
MetricGroup metricGroup,
Collection<KeyedStateHandle> stateHandles,
CloseableRegistry cancelStreamRegistry) |
Modifier and Type | Method and Description |
---|---|
static TaskManagerServices |
TaskManagerServices.fromConfiguration(TaskManagerServicesConfiguration taskManagerServicesConfiguration,
MetricGroup taskManagerMetricGroup,
ExecutorService ioExecutor)
Creates and returns the task manager services.
|
Modifier and Type | Method and Description |
---|---|
MetricGroup |
SavepointRuntimeContext.getMetricGroup() |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
StreamOperator.getMetricGroup() |
MetricGroup |
AbstractStreamOperator.getMetricGroup() |
Modifier and Type | Method and Description |
---|---|
protected <K> AbstractKeyedStateBackend<K> |
StreamTaskStateInitializerImpl.keyedStatedBackend(TypeSerializer<K> keySerializer,
String operatorIdentifierText,
PrioritizedOperatorSubtaskState prioritizedOperatorSubtaskStates,
CloseableRegistry backendCloseableRegistry,
MetricGroup metricGroup) |
StreamOperatorStateContext |
StreamTaskStateInitializerImpl.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup) |
StreamOperatorStateContext |
StreamTaskStateInitializer.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup)
Returns the
StreamOperatorStateContext for an AbstractStreamOperator that runs in the stream
task that owns this manager. |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
Evictor.EvictorContext.getMetricGroup()
Returns the metric group for this
Evictor . |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
Trigger.TriggerContext.getMetricGroup()
Returns the metric group for this
Trigger . |
Modifier and Type | Method and Description |
---|---|
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer08.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer010.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer09.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected abstract AbstractFetcher<T,?> |
FlinkKafkaConsumerBase.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> subscribedPartitionsToStartOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup kafkaMetricGroup,
boolean useMetrics)
Creates the fetcher that connect to the Kafka brokers, pulls data, deserialized the
data, and emits it into the data streams.
|
Constructor and Description |
---|
Kafka010Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics,
FlinkConnectorRateLimiter rateLimiter) |
Kafka09Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics,
FlinkConnectorRateLimiter rateLimiter) |
KafkaConsumerThread(org.slf4j.Logger log,
Handover handover,
Properties kafkaProperties,
ClosableBlockingQueue<KafkaTopicPartitionState<org.apache.kafka.common.TopicPartition>> unassignedPartitionsQueue,
KafkaConsumerCallBridge09 consumerCallBridge,
String threadName,
long pollTimeout,
boolean useMetrics,
MetricGroup consumerMetricGroup,
MetricGroup subtaskMetricGroup,
FlinkConnectorRateLimiter rateLimiter) |
KafkaFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Constructor and Description |
---|
AbstractFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> seedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Kafka08Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> seedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long autoCommitInterval,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
WindowOperator.Context.getMetricGroup() |
Constructor and Description |
---|
LatencyStats(MetricGroup metricGroup,
int historySize,
int subtaskIndex,
OperatorID operatorID,
LatencyStats.Granularity granularity) |
Modifier and Type | Method and Description |
---|---|
MetricGroup |
FunctionContext.getMetricGroup()
Returns the metric group for this parallel subtask.
|
Modifier and Type | Method and Description |
---|---|
MetricGroup |
Trigger.TriggerContext.getMetricGroup()
Returns the metric group for this
Trigger . |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.