Jiri Slaby c5b460
From: Zqiang <qiang1.zhang@intel.com>
Jiri Slaby c5b460
Date: Sat, 24 Dec 2022 13:25:53 +0800
Jiri Slaby c5b460
Subject: [PATCH] rcu: Protect rcu_print_task_exp_stall() ->exp_tasks access
Jiri Slaby c5b460
References: bsc#1012628
Jiri Slaby c5b460
Patch-mainline: 6.3.4
Jiri Slaby c5b460
Git-commit: 3c1566bca3f8349f12b75d0a2d5e4a20ad6262ec
Jiri Slaby c5b460
Jiri Slaby c5b460
[ Upstream commit 3c1566bca3f8349f12b75d0a2d5e4a20ad6262ec ]
Jiri Slaby c5b460
Jiri Slaby c5b460
For kernels built with CONFIG_PREEMPT_RCU=y, the following scenario can
Jiri Slaby c5b460
result in a NULL-pointer dereference:
Jiri Slaby c5b460
Jiri Slaby c5b460
           CPU1                                           CPU2
Jiri Slaby c5b460
rcu_preempt_deferred_qs_irqrestore                rcu_print_task_exp_stall
Jiri Slaby c5b460
  if (special.b.blocked)                            READ_ONCE(rnp->exp_tasks) != NULL
Jiri Slaby c5b460
    raw_spin_lock_rcu_node
Jiri Slaby c5b460
    np = rcu_next_node_entry(t, rnp)
Jiri Slaby c5b460
    if (&t->rcu_node_entry == rnp->exp_tasks)
Jiri Slaby c5b460
      WRITE_ONCE(rnp->exp_tasks, np)
Jiri Slaby c5b460
      ....
Jiri Slaby c5b460
      raw_spin_unlock_irqrestore_rcu_node
Jiri Slaby c5b460
                                                    raw_spin_lock_irqsave_rcu_node
Jiri Slaby c5b460
                                                    t = list_entry(rnp->exp_tasks->prev,
Jiri Slaby c5b460
                                                        struct task_struct, rcu_node_entry)
Jiri Slaby c5b460
                                                    (if rnp->exp_tasks is NULL, this
Jiri Slaby c5b460
                                                       will dereference a NULL pointer)
Jiri Slaby c5b460
Jiri Slaby c5b460
The problem is that CPU2 accesses the rcu_node structure's->exp_tasks
Jiri Slaby c5b460
field without holding the rcu_node structure's ->lock and CPU2 did
Jiri Slaby c5b460
not observe CPU1's change to rcu_node structure's ->exp_tasks in time.
Jiri Slaby c5b460
Therefore, if CPU1 sets rcu_node structure's->exp_tasks pointer to NULL,
Jiri Slaby c5b460
then CPU2 might dereference that NULL pointer.
Jiri Slaby c5b460
Jiri Slaby c5b460
This commit therefore holds the rcu_node structure's ->lock while
Jiri Slaby c5b460
accessing that structure's->exp_tasks field.
Jiri Slaby c5b460
Jiri Slaby c5b460
[ paulmck: Apply Frederic Weisbecker feedback. ]
Jiri Slaby c5b460
Jiri Slaby c5b460
Acked-by: Joel Fernandes (Google) <joel@joelfernandes.org>
Jiri Slaby c5b460
Signed-off-by: Zqiang <qiang1.zhang@intel.com>
Jiri Slaby c5b460
Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
Jiri Slaby c5b460
Signed-off-by: Joel Fernandes (Google) <joel@joelfernandes.org>
Jiri Slaby c5b460
Signed-off-by: Sasha Levin <sashal@kernel.org>
Jiri Slaby c5b460
Signed-off-by: Jiri Slaby <jslaby@suse.cz>
Jiri Slaby c5b460
---
Jiri Slaby c5b460
 kernel/rcu/tree_exp.h | 6 ++++--
Jiri Slaby c5b460
 1 file changed, 4 insertions(+), 2 deletions(-)
Jiri Slaby c5b460
Jiri Slaby c5b460
diff --git a/kernel/rcu/tree_exp.h b/kernel/rcu/tree_exp.h
Jiri Slaby c5b460
index 249c2967..54e8fb25 100644
Jiri Slaby c5b460
--- a/kernel/rcu/tree_exp.h
Jiri Slaby c5b460
+++ b/kernel/rcu/tree_exp.h
Jiri Slaby c5b460
@@ -802,9 +802,11 @@ static int rcu_print_task_exp_stall(struct rcu_node *rnp)
Jiri Slaby c5b460
 	int ndetected = 0;
Jiri Slaby c5b460
 	struct task_struct *t;
Jiri Slaby c5b460
 
Jiri Slaby c5b460
-	if (!READ_ONCE(rnp->exp_tasks))
Jiri Slaby c5b460
-		return 0;
Jiri Slaby c5b460
 	raw_spin_lock_irqsave_rcu_node(rnp, flags);
Jiri Slaby c5b460
+	if (!rnp->exp_tasks) {
Jiri Slaby c5b460
+		raw_spin_unlock_irqrestore_rcu_node(rnp, flags);
Jiri Slaby c5b460
+		return 0;
Jiri Slaby c5b460
+	}
Jiri Slaby c5b460
 	t = list_entry(rnp->exp_tasks->prev,
Jiri Slaby c5b460
 		       struct task_struct, rcu_node_entry);
Jiri Slaby c5b460
 	list_for_each_entry_continue(t, &rnp->blkd_tasks, rcu_node_entry) {
Jiri Slaby c5b460
-- 
Jiri Slaby c5b460
2.35.3
Jiri Slaby c5b460