Modifier and Type | Method and Description |
---|---|
static ShuffleDescriptor |
TaskDeploymentDescriptorFactory.getConsumedPartitionShuffleDescriptor(IntermediateResultPartition consumedPartition,
TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionDeploymentConstraint) |
ShuffleDescriptor |
ResultPartitionDeploymentDescriptor.getShuffleDescriptor() |
ShuffleDescriptor[] |
InputGateDeploymentDescriptor.getShuffleDescriptors() |
Constructor and Description |
---|
InputGateDeploymentDescriptor(IntermediateDataSetID consumedResultId,
ResultPartitionType consumedPartitionType,
int consumedSubpartitionIndex,
ShuffleDescriptor[] inputChannels) |
ResultPartitionDeploymentDescriptor(PartitionDescriptor partitionDescriptor,
ShuffleDescriptor shuffleDescriptor,
int maxParallelism) |
Modifier and Type | Method and Description |
---|---|
ShuffleDescriptor |
PartitionInfo.getShuffleDescriptor() |
Modifier and Type | Method and Description |
---|---|
List<ShuffleDescriptor> |
DefaultExecutionGraph.getClusterPartitionShuffleDescriptors(IntermediateDataSetID intermediateDataSetID) |
List<ShuffleDescriptor> |
InternalExecutionGraphAccessor.getClusterPartitionShuffleDescriptors(IntermediateDataSetID intermediateResultPartition)
Get the shuffle descriptors of the cluster partitions ordered by partition number.
|
ShuffleMaster<? extends ShuffleDescriptor> |
InternalExecutionGraphAccessor.getShuffleMaster() |
Constructor and Description |
---|
PartitionInfo(IntermediateDataSetID intermediateResultPartitionID,
ShuffleDescriptor shuffleDescriptor) |
Modifier and Type | Method and Description |
---|---|
ShuffleDescriptor |
TaskExecutorPartitionInfo.getShuffleDescriptor() |
Modifier and Type | Method and Description |
---|---|
List<ShuffleDescriptor> |
JobMasterPartitionTracker.getClusterPartitionShuffleDescriptors(IntermediateDataSetID intermediateDataSetID)
Get the shuffle descriptors of the cluster partitions ordered by partition number.
|
List<ShuffleDescriptor> |
ResourceManagerPartitionTrackerImpl.getClusterPartitionShuffleDescriptors(IntermediateDataSetID dataSetID) |
List<ShuffleDescriptor> |
ResourceManagerPartitionTracker.getClusterPartitionShuffleDescriptors(IntermediateDataSetID dataSetID)
Returns all the shuffle descriptors of cluster partitions for the intermediate dataset.
|
List<ShuffleDescriptor> |
JobMasterPartitionTrackerImpl.getClusterPartitionShuffleDescriptors(IntermediateDataSetID intermediateDataSetID) |
CompletableFuture<List<ShuffleDescriptor>> |
ClusterPartitionManager.getClusterPartitionsShuffleDescriptors(IntermediateDataSetID intermediateDataSetID)
Get the shuffle descriptors of the cluster partitions ordered by partition number.
|
Map<ResultPartitionID,ShuffleDescriptor> |
DataSetMetaInfo.getShuffleDescriptors() |
Modifier and Type | Method and Description |
---|---|
DataSetMetaInfo |
DataSetMetaInfo.addShuffleDescriptors(Map<ResultPartitionID,ShuffleDescriptor> shuffleDescriptors) |
Constructor and Description |
---|
TaskExecutorPartitionInfo(ShuffleDescriptor shuffleDescriptor,
IntermediateDataSetID intermediateDataSetId,
int numberOfPartitions) |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<List<ShuffleDescriptor>> |
ResourceManager.getClusterPartitionsShuffleDescriptors(IntermediateDataSetID intermediateDataSetID) |
Modifier and Type | Interface and Description |
---|---|
interface |
ShuffleMaster<T extends ShuffleDescriptor>
Intermediate result partition registry to use in
JobMaster . |
interface |
ShuffleServiceFactory<SD extends ShuffleDescriptor,P extends ResultPartitionWriter,G extends IndexedInputGate>
Interface for shuffle service factory implementations.
|
Modifier and Type | Class and Description |
---|---|
class |
NettyShuffleDescriptor
Default implementation of
ShuffleDescriptor for NettyShuffleMaster . |
class |
UnknownShuffleDescriptor
Unknown
ShuffleDescriptor for which the producer has not been deployed yet. |
Modifier and Type | Method and Description |
---|---|
static <T,SD extends ShuffleDescriptor> |
ShuffleUtils.applyWithShuffleTypeCheck(Class<SD> shuffleDescriptorClass,
ShuffleDescriptor shuffleDescriptor,
java.util.function.Function<UnknownShuffleDescriptor,T> functionOfUnknownDescriptor,
java.util.function.Function<SD,T> functionOfKnownDescriptor)
Apply different functions to known and unknown
ShuffleDescriptor s. |
Modifier and Type | Method and Description |
---|---|
static <T,SD extends ShuffleDescriptor> |
ShuffleUtils.applyWithShuffleTypeCheck(Class<SD> shuffleDescriptorClass,
ShuffleDescriptor shuffleDescriptor,
java.util.function.Function<UnknownShuffleDescriptor,T> functionOfUnknownDescriptor,
java.util.function.Function<SD,T> functionOfKnownDescriptor)
Apply different functions to known and unknown
ShuffleDescriptor s. |
void |
NettyShuffleMaster.releasePartitionExternally(ShuffleDescriptor shuffleDescriptor) |
void |
ShuffleMaster.releasePartitionExternally(ShuffleDescriptor shuffleDescriptor)
Release any external resources occupied by the given partition.
|
Modifier and Type | Method and Description |
---|---|
Map<ResultPartitionID,ShuffleDescriptor> |
ClusterPartitionReport.ClusterPartitionReportEntry.getShuffleDescriptors() |
Constructor and Description |
---|
ClusterPartitionReportEntry(IntermediateDataSetID dataSetId,
int numTotalPartitions,
Map<ResultPartitionID,ShuffleDescriptor> shuffleDescriptors) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.