]> git.karo-electronics.de Git - karo-tx-linux.git/commit
rcu: Allow RCU grace-period cleanup to be preempted
authorPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Thu, 21 Jun 2012 15:19:05 +0000 (08:19 -0700)
committerPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Thu, 20 Sep 2012 21:55:38 +0000 (14:55 -0700)
commitb6071f7f478d84b3d7acc3e144a5b9da54ce7065
treebeb89ddc30496ef80ba533c86bd4d6ea0e8b1917
parenta48621e98a0f83475a29724914d8b2d3c8cf4d73
rcu: Allow RCU grace-period cleanup to be preempted

RCU grace-period cleanup is currently carried out with interrupts
disabled, which can result in excessive latency spikes on large systems
(many hundreds or thousands of CPUs).  This patch therefore makes the
RCU grace-period cleanup be preemptible, including voluntary preemption
points, which should eliminate those latency spikes.  Similar spikes from
forcing of quiescent states will be dealt with similarly by later patches.

Updated to replace uses of spin_lock_irqsave() with spin_lock_irq(), as
suggested by Peter Zijlstra.

Reported-by: Mike Galbraith <mgalbraith@suse.de>
Reported-by: Dimitri Sivanich <sivanich@sgi.com>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Reviewed-by: Josh Triplett <josh@joshtriplett.org>
kernel/rcutree.c