Interface | Description |
---|---|
BucketAssigner<IN,BucketID> |
A BucketAssigner is used with a file sink to determine the bucket each incoming element should be
put into.
|
BucketAssigner.Context |
Context that the
BucketAssigner can use for getting additional data about an input
record. |
BucketFactory<IN,BucketID> |
A factory able to create
buckets for the StreamingFileSink . |
BucketLifeCycleListener<IN,BucketID> |
Listener about the status of
Bucket . |
BucketWriter<IN,BucketID> |
An interface for factories that create the different
writers . |
BucketWriter.PendingFile |
This represents the file that can not write any data to.
|
FileLifeCycleListener<BucketID> |
Listener about the status of file.
|
InProgressFileWriter<IN,BucketID> |
The
Bucket uses the InProgressFileWriter to write element to a part file. |
InProgressFileWriter.InProgressFileRecoverable |
A handle can be used to recover in-progress file..
|
InProgressFileWriter.PendingFileRecoverable |
The handle can be used to recover pending file.
|
PartFileInfo<BucketID> |
An interface exposing the information concerning the current (open) part file that is necessary
to the
RollingPolicy in order to determine if it should roll the part file or not. |
RollingPolicy<IN,BucketID> |
The policy based on which a
Bucket in the Filesystem Sink rolls its currently
open part file and opens a new one. |
Class | Description |
---|---|
AbstractPartFileWriter<IN,BucketID> |
An abstract writer for the currently open part file in a specific
Bucket . |
Bucket<IN,BucketID> |
A bucket is the directory organization of the output of the
StreamingFileSink . |
Buckets<IN,BucketID> |
The manager of the different active buckets in the
StreamingFileSink . |
BulkBucketWriter<IN,BucketID> |
A factory that creates
BulkPartWriters . |
DefaultBucketFactoryImpl<IN,BucketID> |
A factory returning
buckets . |
HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>> |
Buckets builder to create buckets that use
HadoopPathBasedPartFileWriter . |
OutputFileConfig |
Part file name configuration.
|
OutputFileConfig.OutputFileConfigBuilder |
A builder to create the part file configuration.
|
OutputStreamBasedPartFileWriter<IN,BucketID> |
The base class for all the part file writer that use
RecoverableFsDataOutputStream . |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable |
The
InProgressFileRecoverable implementation for OutputStreamBasedBucketWriter . |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer |
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable . |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable |
The
PendingFileRecoverable implementation for OutputStreamBasedBucketWriter . |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer |
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable . |
RowWiseBucketWriter<IN,BucketID> |
A factory that creates
RowWisePartWriters . |
SerializableConfiguration |
Wrapper of hadoop Configuration to make it serializable.
|
StreamingFileSink<IN> |
Sink that emits its input elements to
FileSystem files within buckets. |
StreamingFileSink.BucketsBuilder<IN,BucketID,T extends StreamingFileSink.BucketsBuilder<IN,BucketID,T>> |
The base abstract class for the
StreamingFileSink.RowFormatBuilder and StreamingFileSink.BulkFormatBuilder . |
StreamingFileSink.BulkFormatBuilder<IN,BucketID,T extends StreamingFileSink.BulkFormatBuilder<IN,BucketID,T>> |
A builder for configuring the sink for bulk-encoding formats, e.g.
|
StreamingFileSink.DefaultBulkFormatBuilder<IN> |
Builder for the vanilla
StreamingFileSink using a bulk format. |
StreamingFileSink.DefaultRowFormatBuilder<IN> |
Builder for the vanilla
StreamingFileSink using a row format. |
StreamingFileSink.RowFormatBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>> |
A builder for configuring the sink for row-wise encoding formats.
|
StreamingFileSinkHelper<IN> |
Helper for
StreamingFileSink . |
WriterProperties |
This class describes the property of the
BucketWriter . |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.