Modifier and Type | Class and Description |
---|---|
class |
RecordsBySplits<E>
An implementation of RecordsWithSplitIds to host all the records by splits.
|
Constructor and Description |
---|
SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier)
Creates a new SplitFetcherManager with a single I/O threads.
|
SplitFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderFactory)
Create a split fetcher manager.
|
Modifier and Type | Method and Description |
---|---|
RecordsWithSplitIds<E> |
SplitReader.fetch()
Fetch elements into the blocking queue for the given splits.
|
Modifier and Type | Class and Description |
---|---|
class |
FileRecords<T>
A collection of records for one file split.
|
Modifier and Type | Method and Description |
---|---|
RecordsWithSplitIds<Tuple3<T,Long,Long>> |
KafkaPartitionSplitReader.fetch() |
Constructor and Description |
---|
KafkaSourceReader(FutureCompletingBlockingQueue<RecordsWithSplitIds<Tuple3<T,Long,Long>>> elementsQueue,
java.util.function.Supplier<KafkaPartitionSplitReader<T>> splitReaderSupplier,
RecordEmitter<Tuple3<T,Long,Long>,T,KafkaPartitionSplitState> recordEmitter,
Configuration config,
SourceReaderContext context) |
Constructor and Description |
---|
KafkaSourceFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<Tuple3<T,Long,Long>>> elementsQueue,
java.util.function.Supplier<SplitReader<Tuple3<T,Long,Long>,KafkaPartitionSplit>> splitReaderSupplier)
Creates a new SplitFetcherManager with a single I/O threads.
|
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.