]> git.karo-electronics.de Git - karo-tx-linux.git/commit
rcu: Segregate rcu_state fields to improve cache locality
authorDimitri Sivanich <sivanich@sgi.com>
Fri, 29 Jun 2012 21:17:29 +0000 (14:17 -0700)
committerPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Thu, 20 Sep 2012 21:55:41 +0000 (14:55 -0700)
commit9a6fdead509e0f57304d701cede803534aee91b6
treedd00a61db20b3020295c42a78575c6c2a2e4b7f6
parente5c074322a3d372c6c1b9b1dbffaaf2f8a2f49cc
rcu: Segregate rcu_state fields to improve cache locality

The fields in the rcu_state structure that are protected by the
root rcu_node structure's ->lock can share a cache line with the
fields protected by ->onofflock.  This can result in excessive
memory contention on large systems, so this commit applies
____cacheline_internodealigned_in_smp to the ->onofflock field in
order to segregate them.

Signed-off-by: Dimitri Sivanich <sivanich@sgi.com>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Tested-by: Dimitri Sivanich <sivanich@sgi.com>
Reviewed-by: Josh Triplett <josh@joshtriplett.org>
kernel/rcutree.h