Pushing a large application sometimes results in "Insufficient Resources" even though the "availabable memory" metric shows cellls which should be able to easily accommodate the application. #955
Description
Current behavior
On occasion, when we push a large (6GB) application, we might receive an "Insufficient Resources" error, even though there are cells with plenty of memory to accommodate the application (a couple of cells had as much as 22GB free) according to the AvailableResources metric presented in cfdot celll-states. Here are some relevant notes about our environment:
- We use 128GB cells.
- Unlike our other CF deployments, this one sees heavy "task" usage by one of our clients.
- We are currently running v40.17.0 of cf-deployment
- There was a hint in the Cloud Foundry slack thread at https://cloudfoundry.slack.com/archives/C02HNDJB31R/p1723134840298499 that tasks might not be captured in the AvailableResources statistic.
- Adding a handful of cells allowed us to push applications normally.
Desired behavior
AvailableResources should accurately tell us if a large application can be pushed. Alternatively, if there is another metric we should be using to measure available resources, we'd like to know about it.
Affected Version
v40.17.0 of cf-deployment using diego v 2.100.0