Skip to content

Commit d9b4357

Browse files
committed
sched/fair: Block delayed tasks on throttled hierarchy during dequeue
JIRA: https://issues.redhat.com/browse/RHEL-69492 Upstream Status: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git (v6.12.54) CONFLICTS: minor context conflict in the first chunk of the patch. commit e67e3e7 Author: K Prateek Nayak <kprateek.nayak@amd.com> Date: Wed Oct 15 06:03:59 2025 +0000 sched/fair: Block delayed tasks on throttled hierarchy during dequeue Dequeuing a fair task on a throttled hierarchy returns early on encountering a throttled cfs_rq since the throttle path has already dequeued the hierarchy above and has adjusted the h_nr_* accounting till the root cfs_rq. dequeue_entities() crucially misses calling __block_task() for delayed tasks being dequeued on the throttled hierarchies, but this was mostly harmless until commit b7ca574 ("sched/core: Tweak wait_task_inactive() to force dequeue sched_delayed tasks") since all existing cases would re-enqueue the task if task_on_rq_queued() returned true and the task would eventually be blocked at pick after the hierarchy was unthrottled. wait_task_inactive() is special as it expects the delayed task on throttled hierarchy to reach the blocked state on dequeue but since __block_task() is never called, task_on_rq_queued() continues to return true. Furthermore, since the task is now off the hierarchy, the pick never reaches it to fully block the task even after unthrottle leading to wait_task_inactive() looping endlessly. Remedy this by calling __block_task() if a delayed task is being dequeued on a throttled hierarchy. This fix is only required for stabled kernels implementing delay dequeue (>= v6.12) before v6.18 since upstream commit e1fad12 ("sched/fair: Switch to task based throttle model") indirectly fixes this by removing the early return conditions in dequeue_entities() as part of the per-task throttle feature. Cc: stable@vger.kernel.org Reported-by: Matt Fleming <matt@readmodwrite.com> Closes: https://lore.kernel.org/all/20250925133310.1843863-1-matt@readmodwrite.com/ Fixes: b7ca574 ("sched/core: Tweak wait_task_inactive() to force dequeue sched_delayed tasks") Tested-by: Matt Fleming <mfleming@cloudflare.com> Signed-off-by: K Prateek Nayak <kprateek.nayak@amd.com> Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org> Signed-off-by: Luis Claudio R. Goncalves <lgoncalv@redhat.com>
1 parent b8bd692 commit d9b4357

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed

kernel/sched/fair.c

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7064,6 +7064,7 @@ static int dequeue_entities(struct rq *rq, struct sched_entity *se, int flags)
70647064
int h_nr_runnable = 0;
70657065
struct cfs_rq *cfs_rq;
70667066
u64 slice = 0;
7067+
int ret = 0;
70677068

70687069
if (entity_is_task(se)) {
70697070
p = task_of(se);
@@ -7093,7 +7094,7 @@ static int dequeue_entities(struct rq *rq, struct sched_entity *se, int flags)
70937094

70947095
/* end evaluation on encountering a throttled cfs_rq */
70957096
if (cfs_rq_throttled(cfs_rq))
7096-
return 0;
7097+
goto out;
70977098

70987099
/* Don't dequeue parent if it has other entities besides us */
70997100
if (cfs_rq->load.weight) {
@@ -7132,7 +7133,7 @@ static int dequeue_entities(struct rq *rq, struct sched_entity *se, int flags)
71327133

71337134
/* end evaluation on encountering a throttled cfs_rq */
71347135
if (cfs_rq_throttled(cfs_rq))
7135-
return 0;
7136+
goto out;
71367137
}
71377138

71387139
sub_nr_running(rq, h_nr_queued);
@@ -7141,6 +7142,8 @@ static int dequeue_entities(struct rq *rq, struct sched_entity *se, int flags)
71417142
if (unlikely(!was_sched_idle && sched_idle_rq(rq)))
71427143
rq->next_balance = jiffies;
71437144

7145+
ret = 1;
7146+
out:
71447147
if (p && task_delayed) {
71457148
SCHED_WARN_ON(!task_sleep);
71467149
SCHED_WARN_ON(p->on_rq != 1);
@@ -7156,7 +7159,7 @@ static int dequeue_entities(struct rq *rq, struct sched_entity *se, int flags)
71567159
__block_task(rq, p);
71577160
}
71587161

7159-
return 1;
7162+
return ret;
71607163
}
71617164

71627165
/*

0 commit comments

Comments
 (0)