rcu: Add exp_funnel_lock() fastpath
authorPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Wed, 16 Mar 2016 20:22:53 +0000 (13:22 -0700)
committerPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Thu, 31 Mar 2016 20:34:09 +0000 (13:34 -0700)
commit356051e1de3cf65575da4ee92d1f5cee86677ee2
tree498fde3d22598558fc41ce20ebfb183d014b9c4f
parentf6a12f34a448cc8a624070fd365c29c890138a48
rcu: Add exp_funnel_lock() fastpath

This commit speeds up the low-contention case, especially for systems
with large rcu_node trees, by attempting to directly acquire the
->exp_mutex.  This fastpath checks the leaves and root first in
order to avoid excessive memory contention on the mutex itself.

Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
kernel/rcu/tree.c