Modifier and Type | Method and Description |
---|---|
SplitEnumerator<SplitT,EnumChkT> |
Source.createEnumerator(SplitEnumeratorContext<SplitT> enumContext)
Creates a new SplitEnumerator for this source, starting a new input.
|
SplitEnumerator<SplitT,EnumChkT> |
Source.restoreEnumerator(SplitEnumeratorContext<SplitT> enumContext,
EnumChkT checkpoint)
Restores an enumerator from a checkpoint.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<NumberSequenceSource.NumberSequenceSplit,Collection<NumberSequenceSource.NumberSequenceSplit>> |
NumberSequenceSource.createEnumerator(SplitEnumeratorContext<NumberSequenceSource.NumberSequenceSplit> enumContext) |
SplitEnumerator<NumberSequenceSource.NumberSequenceSplit,Collection<NumberSequenceSource.NumberSequenceSplit>> |
NumberSequenceSource.restoreEnumerator(SplitEnumeratorContext<NumberSequenceSource.NumberSequenceSplit> enumContext,
Collection<NumberSequenceSource.NumberSequenceSplit> checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
IteratorSourceEnumerator<SplitT extends IteratorSourceSplit<?,?>>
A
SplitEnumerator for iterator sources. |
Modifier and Type | Class and Description |
---|---|
static class |
HybridSource.HybridSourceBuilder<T,EnumT extends SplitEnumerator>
Builder for HybridSource.
|
static interface |
HybridSource.SourceFactory<T,SourceT extends Source<T,?,?>,FromEnumT extends SplitEnumerator>
Factory for underlying sources of
HybridSource . |
Modifier and Type | Class and Description |
---|---|
class |
HybridSourceSplitEnumerator
Wraps the actual split enumerators and facilitates source switching.
|
Modifier and Type | Method and Description |
---|---|
<ToEnumT extends SplitEnumerator,NextSourceT extends Source<T,?,?>> |
HybridSource.HybridSourceBuilder.addSource(HybridSource.SourceFactory<T,NextSourceT,? super EnumT> sourceFactory,
Boundedness boundedness)
Add source with deferred instantiation based on previous enumerator.
|
<ToEnumT extends SplitEnumerator,NextSourceT extends Source<T,?,?>> |
HybridSource.HybridSourceBuilder.addSource(NextSourceT source)
Add pre-configured source (without switch time modification).
|
static <T,EnumT extends SplitEnumerator> |
HybridSource.builder(Source<T,?,?> firstSource)
Builder for
HybridSource . |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState> |
HybridSource.createEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext) |
SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState> |
HybridSource.restoreEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext,
HybridSourceEnumeratorState checkpoint) |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>> |
AbstractFileSource.createEnumerator(SplitEnumeratorContext<SplitT> enumContext) |
SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>> |
AbstractFileSource.restoreEnumerator(SplitEnumeratorContext<SplitT> enumContext,
PendingSplitsCheckpoint<SplitT> checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileSplitEnumerator
A continuously monitoring enumerator.
|
class |
DynamicFileSplitEnumerator<SplitT extends FileSourceSplit>
A SplitEnumerator implementation that supports dynamic filtering.
|
class |
StaticFileSplitEnumerator
A SplitEnumerator implementation for bounded / batch
FileSource input. |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.createEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext) |
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.restoreEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext,
KafkaSourceEnumState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceEnumerator
The enumerator class for Kafka source.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSourceEnumerator
The enumerator class for the pulsar source.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<FromElementsSplit,NoOpEnumState> |
FromElementsSource.createEnumerator(SplitEnumeratorContext<FromElementsSplit> enumContext) |
SplitEnumerator<FromElementsSplit,NoOpEnumState> |
FromElementsSource.restoreEnumerator(SplitEnumeratorContext<FromElementsSplit> enumContext,
NoOpEnumState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
NoOpEnumerator
Mock enumerator.
|
Modifier and Type | Class and Description |
---|---|
class |
ContinuousHiveSplitEnumerator<T extends Comparable<T>>
A continuously monitoring
SplitEnumerator for hive source. |
class |
DynamicHiveSplitEnumerator
DynamicFileSplitEnumerator for hive source. |
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<HiveSourceSplit,PendingSplitsCheckpoint<HiveSourceSplit>> |
HiveSource.createEnumerator(SplitEnumeratorContext<HiveSourceSplit> enumContext) |
SplitEnumerator<HiveSourceSplit,PendingSplitsCheckpoint<HiveSourceSplit>> |
HiveSource.restoreEnumerator(SplitEnumeratorContext<HiveSourceSplit> enumContext,
PendingSplitsCheckpoint<HiveSourceSplit> checkpoint) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.