Modifier and Type | Interface and Description |
---|---|
interface |
ExternallyInducedSourceReader<T,SplitT extends SourceSplit>
Sources that implement this interface do not trigger checkpoints when receiving a trigger message
from the checkpoint coordinator, but when their input data/events indicate that a checkpoint
should be triggered.
|
interface |
Source<T,SplitT extends SourceSplit,EnumChkT>
The interface for Source.
|
interface |
SourceReader<T,SplitT extends SourceSplit>
The interface for a source reader which is responsible for reading the records from the source
splits assigned by
SplitEnumerator . |
interface |
SplitEnumerator<SplitT extends SourceSplit,CheckpointT>
A interface of a split enumerator responsible for the followings: 1.
|
interface |
SplitEnumeratorContext<SplitT extends SourceSplit>
A context class for the
SplitEnumerator . |
class |
SplitsAssignment<SplitT extends SourceSplit>
A class containing the splits assignment to the source readers.
|
Modifier and Type | Class and Description |
---|---|
static class |
NumberSequenceSource.NumberSequenceSplit
A split of the source, representing a number sub-sequence.
|
Modifier and Type | Interface and Description |
---|---|
interface |
IteratorSourceSplit<E,IterT extends Iterator<E>>
A
SourceSplit that represents a sequence of elements captured in an iterator. |
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadMultiplexSourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
A base for
SourceReader s that read splits with one thread using one SplitReader . |
class |
SourceReaderBase<E,T,SplitT extends SourceSplit,SplitStateT>
An abstract implementation of
SourceReader which provides some sychronization between the
mail box main thread and the SourceReader internal threads. |
Modifier and Type | Method and Description |
---|---|
void |
RecordsBySplits.Builder.add(SourceSplit split,
E record)
Add the record from the given source split.
|
void |
RecordsBySplits.Builder.addAll(SourceSplit split,
Collection<E> records)
Add multiple records from the given source split.
|
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadFetcherManager<E,SplitT extends SourceSplit>
A Fetcher Manager with a single fetching thread (I/O thread) that handles all splits
concurrently.
|
class |
SplitFetcher<E,SplitT extends SourceSplit>
The internal fetcher runnable responsible for polling message from the external system.
|
class |
SplitFetcherManager<E,SplitT extends SourceSplit>
A class responsible for starting the
SplitFetcher and manage the life cycles of them. |
Modifier and Type | Interface and Description |
---|---|
interface |
SplitReader<E,SplitT extends SourceSplit>
An interface used to read from splits.
|
Modifier and Type | Method and Description |
---|---|
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.deserializeSplitAssignments(byte[] serialized,
SimpleVersionedSerializer<SplitT> splitSerializer,
java.util.function.Function<Integer,C> collectionSupplier)
Deserialize the given bytes returned by
SerdeUtils.serializeSplitAssignments(Map,
SimpleVersionedSerializer) . |
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.serializeSplitAssignments(Map<Integer,C> splitAssignments,
SimpleVersionedSerializer<SplitT> splitSerializer)
Serialize a mapping from subtask ids to lists of assigned splits.
|
Modifier and Type | Class and Description |
---|---|
class |
SourceCoordinator<SplitT extends SourceSplit,EnumChkT>
The default implementation of the
OperatorCoordinator for the Source . |
class |
SourceCoordinatorContext<SplitT extends SourceSplit>
A context class for the
OperatorCoordinator . |
class |
SourceCoordinatorProvider<SplitT extends SourceSplit>
The provider of
SourceCoordinator . |
class |
SplitAssignmentTracker<SplitT extends SourceSplit>
A class that is responsible for tracking the past split assignments made by
SplitEnumerator . |
Modifier and Type | Class and Description |
---|---|
class |
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.