Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
StreamingFileSinkProgram.KeyBucketAssigner.getSerializer() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<EnumChkT> |
Source.getEnumeratorCheckpointSerializer()
Creates the serializer for the
SplitEnumerator checkpoint. |
SimpleVersionedSerializer<SplitT> |
Source.getSplitSerializer()
Creates a serializer for the source splits.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<Collection<NumberSequenceSource.NumberSequenceSplit>> |
NumberSequenceSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<NumberSequenceSource.NumberSequenceSplit> |
NumberSequenceSource.getSplitSerializer() |
Modifier and Type | Method and Description |
---|---|
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.deserializeSplitAssignments(byte[] serialized,
SimpleVersionedSerializer<SplitT> splitSerializer,
java.util.function.Function<Integer,C> collectionSupplier)
Deserialize the given bytes returned by
SerdeUtils.serializeSplitAssignments(Map,
SimpleVersionedSerializer) . |
static <SplitT extends SourceSplit,C extends Collection<SplitT>> |
SerdeUtils.serializeSplitAssignments(Map<Integer,C> splitAssignments,
SimpleVersionedSerializer<SplitT> splitSerializer)
Serialize a mapping from subtask ids to lists of assigned splits.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
RecoverableWriter.getCommitRecoverableSerializer()
The serializer for the CommitRecoverable types created in this writer.
|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
RecoverableWriter.getResumeRecoverableSerializer()
The serializer for the ResumeRecoverable types created in this writer.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
LocalRecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
LocalRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
static <T> T |
SimpleVersionedSerialization.readVersionAndDeSerialize(SimpleVersionedSerializer<T> serializer,
byte[] bytes)
Deserializes the version and datum from a byte array.
|
static <T> T |
SimpleVersionedSerialization.readVersionAndDeSerialize(SimpleVersionedSerializer<T> serializer,
DataInputView in)
Deserializes the version and datum from a stream.
|
static <T> byte[] |
SimpleVersionedSerialization.writeVersionAndSerialize(SimpleVersionedSerializer<T> serializer,
T datum)
Serializes the version and datum into a byte array.
|
static <T> void |
SimpleVersionedSerialization.writeVersionAndSerialize(SimpleVersionedSerializer<T> serializer,
T datum,
DataOutputView out)
Serializes the version and datum into a stream.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
S3RecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
S3RecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<T> |
MasterTriggerRestoreHook.createCheckpointDataSerializer()
Creates a the serializer to (de)serializes the data stored by this hook.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.CommitRecoverable> |
HadoopRecoverableWriter.getCommitRecoverableSerializer() |
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
HadoopRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
void |
SplitAssignmentTracker.restoreState(SimpleVersionedSerializer<SplitT> splitSerializer,
DataInputStream in)
Restore the state of the SplitAssignmentTracker.
|
void |
SplitAssignmentTracker.snapshotState(long checkpointId,
SimpleVersionedSerializer<SplitT> splitSerializer,
DataOutputStream out)
Take a snapshot of the uncheckpointed split assignments.
|
Constructor and Description |
---|
SourceCoordinatorContext(ExecutorService coordinatorExecutor,
SourceCoordinatorProvider.CoordinatorExecutorThreadFactory coordinatorThreadFactory,
int numWorkerThreads,
OperatorCoordinator.Context operatorCoordinatorContext,
SimpleVersionedSerializer<SplitT> splitSerializer) |
Modifier and Type | Method and Description |
---|---|
List<SplitT> |
AddSplitEvent.splits(SimpleVersionedSerializer<SplitT> splitSerializer) |
Constructor and Description |
---|
AddSplitEvent(List<SplitT> splits,
SimpleVersionedSerializer<SplitT> splitSerializer) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
StreamSQLTestProgram.KeyBucketAssigner.getSerializer() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<BucketID> |
BucketAssigner.getSerializer() |
Constructor and Description |
---|
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
Modifier and Type | Class and Description |
---|---|
class |
SimpleVersionedStringSerializer
A
SimpleVersionedSerializer implementation for Strings. |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
DateTimeBucketAssigner.getSerializer() |
SimpleVersionedSerializer<String> |
BasePathBucketAssigner.getSerializer() |
Constructor and Description |
---|
SourceOperator(FunctionWithException<SourceReaderContext,SourceReader<OUT,SplitT>,Exception> readerFactory,
OperatorEventGateway operatorEventGateway,
SimpleVersionedSerializer<SplitT> splitSerializer,
WatermarkStrategy<OUT> watermarkStrategy,
ProcessingTimeService timeService,
Configuration configuration,
String localHostname) |
Constructor and Description |
---|
SimpleVersionedListState(ListState<byte[]> rawState,
SimpleVersionedSerializer<T> serializer)
Creates a new SimpleVersionedListState that reads and writes bytes from the given raw
ListState with the given serializer.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<String> |
FileSystemTableSink.TableBucketAssigner.getSerializer() |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.