CommT- The type of information needed to commit data staged by the sink
GlobalCommT- The type of the aggregated committable
@Experimental public interface GlobalCommitter<CommT,GlobalCommT> extends AutoCloseable
GlobalCommitteris responsible for creating and committing an aggregated committable, which we call global committable (see
GlobalCommitter runs with parallelism equal to 1.
|Modifier and Type||Method and Description|
Compute an aggregated committable from a list of committables.
Commit the given list of
Signals that there is no committable any more.
Find out which global committables need to be retried when recovering from the failure.
List<GlobalCommT> filterRecoveredCommittables(List<GlobalCommT> globalCommittables) throws IOException
globalCommittables- A list of
GlobalCommTfor which we want to verify which ones were successfully committed and which ones did not.
GlobalCommTthat should be committed again.
IOException- if fail to filter the recovered committables.
GlobalCommT combine(List<CommT> committables) throws IOException
committables- A list of
CommTto be combined into a
IOException- if fail to combine the given committables.
List<GlobalCommT> commit(List<GlobalCommT> globalCommittables) throws IOException
globalCommittables- a list of
GlobalCommTneeded to re-commit, which is needed in case we implement a "commit-with-retry" pattern.
IOException- if the commit operation fail and do not want to retry any more.
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.