Modifier and Type | Field and Description |
---|---|
static ResourceProfile |
ResourceProfile.ANY
A ResourceProfile that indicates infinite resource that matches any resource requirement, for
testability purpose only.
|
static ResourceProfile |
ResourceProfile.UNKNOWN
A ResourceProfile that indicates an unknown resource requirement.
|
static ResourceProfile |
ResourceProfile.ZERO
A ResourceProfile describing zero resources.
|
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
ResourceProfile.Builder.build() |
static ResourceProfile |
ResourceProfile.fromResources(double cpuCores,
int taskHeapMemoryMB) |
static ResourceProfile |
ResourceProfile.fromResourceSpec(ResourceSpec resourceSpec,
MemorySize networkMemory) |
ResourceProfile |
ResourceBudgetManager.getAvailableBudget() |
ResourceProfile |
SlotProfile.getPhysicalSlotResourceProfile()
Returns the desired resource profile for the physical slot to host this task slot.
|
ResourceProfile |
SlotProfile.getTaskResourceProfile()
Returns the desired resource profile for the task slot.
|
ResourceProfile |
ResourceBudgetManager.getTotalBudget() |
ResourceProfile |
ResourceProfile.merge(ResourceProfile other)
Calculates the sum of two resource profiles.
|
ResourceProfile |
ResourceProfile.multiply(int multiplier) |
ResourceProfile |
ResourceProfile.subtract(ResourceProfile other)
Subtracts another piece of resource profile from this one.
|
Modifier and Type | Method and Description |
---|---|
boolean |
ResourceProfile.isMatching(ResourceProfile required)
Check whether required resource profile can be matched.
|
ResourceProfile |
ResourceProfile.merge(ResourceProfile other)
Calculates the sum of two resource profiles.
|
static SlotProfile |
SlotProfile.noLocality(ResourceProfile resourceProfile)
Returns a slot profile for the given resource profile, without any locality requirements.
|
static SlotProfile |
SlotProfile.preferredLocality(ResourceProfile resourceProfile,
Collection<TaskManagerLocation> preferredLocations)
Returns a slot profile for the given resource profile and the preferred locations.
|
static SlotProfile |
SlotProfile.priorAllocation(ResourceProfile taskResourceProfile,
ResourceProfile physicalSlotResourceProfile,
Collection<TaskManagerLocation> preferredLocations,
Collection<AllocationID> priorAllocations,
Set<AllocationID> previousExecutionGraphAllocations)
Returns a slot profile for the given resource profile, prior allocations and all prior
allocation ids from the whole execution graph.
|
boolean |
ResourceBudgetManager.release(ResourceProfile reservation) |
boolean |
ResourceBudgetManager.reserve(ResourceProfile reservation) |
ResourceProfile |
ResourceProfile.subtract(ResourceProfile other)
Subtracts another piece of resource profile from this one.
|
Constructor and Description |
---|
ResourceBudgetManager(ResourceProfile totalBudget) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
ExecutionJobVertex.getResourceProfile() |
ResourceProfile |
AccessExecutionJobVertex.getResourceProfile()
Returns the resource profile for this job vertex.
|
ResourceProfile |
ExecutionVertex.getResourceProfile() |
ResourceProfile |
ArchivedExecutionJobVertex.getResourceProfile() |
Constructor and Description |
---|
ArchivedExecutionJobVertex(ArchivedExecutionVertex[] taskVertices,
JobVertexID id,
String name,
int parallelism,
int maxParallelism,
ResourceProfile resourceProfile,
StringifiedAccumulatorResult[] archivedUserAccumulators) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
SlotInfo.getResourceProfile()
Returns the resource profile of the slot.
|
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
SlotSelectionStrategy.SlotInfoAndResources.getRemainingResources() |
abstract ResourceProfile |
SlotSharingManager.TaskSlot.getReservedResources()
Gets the total reserved resources of the slot and its descendants.
|
ResourceProfile |
SlotSharingManager.MultiTaskSlot.getReservedResources() |
ResourceProfile |
SlotSharingManager.SingleTaskSlot.getReservedResources() |
ResourceProfile |
SlotInfoWithUtilization.getResourceProfile() |
ResourceProfile |
SlotPoolImpl.PendingRequest.getResourceProfile() |
Modifier and Type | Method and Description |
---|---|
Collection<ResourceProfile> |
PhysicalSlotRequestBulk.getPendingRequests()
Returns
ResourceProfile s of pending physical slot requests. |
Constructor and Description |
---|
SlotInfoAndResources(SlotInfo slotInfo,
ResourceProfile remainingResources,
double taskExecutorUtilization) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
TaskExecutorRegistration.getDefaultSlotResourceProfile() |
ResourceProfile |
ResourceOverview.getFreeResource() |
ResourceProfile |
SlotRequest.getResourceProfile()
Get the resource profile of the desired slot
|
ResourceProfile |
ResourceOverview.getTotalResource() |
ResourceProfile |
TaskExecutorRegistration.getTotalResourceProfile() |
Modifier and Type | Method and Description |
---|---|
void |
ResourceManagerServices.allocateResource(ResourceProfile resourceProfile)
Allocates a resource according to the resource profile.
|
Constructor and Description |
---|
ResourceOverview(int numberTaskManagers,
int numberRegisteredSlots,
int numberFreeSlots,
ResourceProfile totalResource,
ResourceProfile freeResource) |
SlotRequest(JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress) |
TaskExecutorRegistration(String taskExecutorAddress,
ResourceID resourceId,
int dataPort,
int jmxPort,
HardwareDescription hardwareDescription,
TaskExecutorMemoryConfiguration memoryConfiguration,
ResourceProfile defaultSlotResourceProfile,
ResourceProfile totalResourceProfile) |
Constructor and Description |
---|
UnfulfillableSlotRequestException(AllocationID allocationId,
ResourceProfile resourceProfile) |
Modifier and Type | Method and Description |
---|---|
void |
DefaultSlotTracker.addSlot(SlotID slotId,
ResourceProfile resourceProfile,
TaskExecutorConnection taskManagerConnection,
JobID assignedJob) |
<T extends TaskManagerSlotInformation> |
LeastUtilizationSlotMatchingStrategy.findMatchingSlot(ResourceProfile requestedProfile,
Collection<T> freeSlots,
java.util.function.Function<InstanceID,Integer> numberRegisteredSlotsLookup) |
<T extends TaskManagerSlotInformation> |
AnyMatchingSlotMatchingStrategy.findMatchingSlot(ResourceProfile requestedProfile,
Collection<T> freeSlots,
java.util.function.Function<InstanceID,Integer> numberRegisteredSlotsLookup) |
<T extends TaskManagerSlotInformation> |
SlotMatchingStrategy.findMatchingSlot(ResourceProfile requestedProfile,
Collection<T> freeSlots,
java.util.function.Function<InstanceID,Integer> numberRegisteredSlotsLookup)
Finds a matching slot for the requested
ResourceProfile given the collection of free
slots and the total number of slots per TaskExecutor. |
default boolean |
TaskManagerSlotInformation.isMatchingRequirement(ResourceProfile required)
Returns true if the required
ResourceProfile can be fulfilled by this slot. |
void |
ResourceTracker.notifyAcquiredResource(JobID jobId,
ResourceProfile resourceProfile)
Notifies the tracker about the acquisition of a resource with the given resource profile, for
the given job.
|
void |
DefaultResourceTracker.notifyAcquiredResource(JobID jobId,
ResourceProfile resourceProfile) |
void |
ResourceTracker.notifyLostResource(JobID jobId,
ResourceProfile resourceProfile)
Notifies the tracker about the loss of a resource with the given resource profile, for the
given job.
|
void |
DefaultResourceTracker.notifyLostResource(JobID jobId,
ResourceProfile resourceProfile) |
Constructor and Description |
---|
PendingTaskManagerSlot(ResourceProfile resourceProfile) |
TaskManagerSlot(SlotID slotId,
ResourceProfile resourceProfile,
TaskExecutorConnection taskManagerConnection) |
Modifier and Type | Method and Description |
---|---|
static ResourceProfileInfo |
ResourceProfileInfo.fromResrouceProfile(ResourceProfile resourceProfile) |
Constructor and Description |
---|
TaskManagerInfo(ResourceID resourceId,
String address,
int dataPort,
int jmxPort,
long lastHeartbeat,
int numberSlots,
int numberAvailableSlots,
ResourceProfile totalResource,
ResourceProfile freeResource,
HardwareDescription hardwareDescription,
TaskExecutorMemoryConfiguration memoryConfiguration) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
ExecutionVertexSchedulingRequirements.getPhysicalSlotResourceProfile() |
static ResourceProfile |
ExecutionVertexSchedulingRequirementsMapper.getPhysicalSlotResourceProfile(ExecutionVertex executionVertex)
Get resource profile of the physical slot to allocate a logical slot in for the given vertex.
|
ResourceProfile |
ExecutionVertexSchedulingRequirements.getTaskResourceProfile() |
Modifier and Type | Method and Description |
---|---|
ExecutionVertexSchedulingRequirements.Builder |
ExecutionVertexSchedulingRequirements.Builder.withPhysicalSlotResourceProfile(ResourceProfile physicalSlotResourceProfile) |
ExecutionVertexSchedulingRequirements.Builder |
ExecutionVertexSchedulingRequirements.Builder.withTaskResourceProfile(ResourceProfile taskResourceProfile) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
ResourceRequirement.getResourceProfile() |
Modifier and Type | Method and Description |
---|---|
Set<ResourceProfile> |
ResourceCounter.getResourceProfiles() |
Map<ResourceProfile,Integer> |
ResourceCounter.getResourceProfilesWithCount() |
Modifier and Type | Method and Description |
---|---|
static ResourceRequirement |
ResourceRequirement.create(ResourceProfile resourceProfile,
int numberOfRequiredSlots) |
void |
ResourceCounter.decrementCount(ResourceProfile profile,
int decrement) |
int |
ResourceCounter.getResourceCount(ResourceProfile profile) |
void |
ResourceCounter.incrementCount(ResourceProfile profile,
int increment) |
Constructor and Description |
---|
ResourceCounter(Map<ResourceProfile,Integer> resources) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
TaskManagerConfiguration.getDefaultSlotResourceProfile() |
ResourceProfile |
SlotStatus.getResourceProfile()
Get the resource profile of this slot.
|
ResourceProfile |
TaskManagerConfiguration.getTotalResourceProfile() |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Acknowledge> |
TaskExecutor.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout) |
CompletableFuture<Acknowledge> |
TaskExecutorGatewayDecoratorBase.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout) |
CompletableFuture<Acknowledge> |
TaskExecutorGateway.requestSlot(SlotID slotId,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
String targetAddress,
ResourceManagerId resourceManagerId,
Time timeout)
Requests a slot from the TaskManager.
|
Constructor and Description |
---|
SlotStatus(SlotID slotID,
ResourceProfile resourceProfile) |
SlotStatus(SlotID slotID,
ResourceProfile resourceProfile,
JobID jobID,
AllocationID allocationID) |
TaskManagerConfiguration(int numberSlots,
ResourceProfile defaultSlotResourceProfile,
ResourceProfile totalResourceProfile,
String[] tmpDirectories,
Time timeout,
Time maxRegistrationDuration,
Configuration configuration,
boolean exitJvmOnOutOfMemory,
String taskManagerLogPath,
String taskManagerStdoutPath,
String taskManagerLogDir,
String taskManagerExternalAddress,
RetryingRegistrationConfiguration retryingRegistrationConfiguration) |
Modifier and Type | Method and Description |
---|---|
ResourceProfile |
TaskSlot.getResourceProfile() |
ResourceProfile |
SlotOffer.getResourceProfile() |
Modifier and Type | Method and Description |
---|---|
boolean |
TaskSlotTableImpl.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout) |
boolean |
TaskSlotTable.allocateSlot(int index,
JobID jobId,
AllocationID allocationId,
ResourceProfile resourceProfile,
Time slotTimeout)
Allocate the slot with the given index for the given job and allocation id.
|
Constructor and Description |
---|
SlotOffer(AllocationID allocationID,
int index,
ResourceProfile resourceProfile) |
TaskSlot(int index,
ResourceProfile resourceProfile,
int memoryPageSize,
JobID jobId,
AllocationID allocationId,
Executor asyncExecutor) |
TaskSlotTableImpl(int numberSlots,
ResourceProfile totalAvailableResourceProfile,
ResourceProfile defaultSlotResourceProfile,
int memoryPageSize,
TimerService<AllocationID> timerService,
Executor memoryVerificationExecutor) |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.