sched/core: Optimize __schedule()
authorPeter Zijlstra <peterz@infradead.org>
Tue, 13 Sep 2016 16:37:29 +0000 (18:37 +0200)
committerIngo Molnar <mingo@kernel.org>
Thu, 22 Sep 2016 12:53:45 +0000 (14:53 +0200)
commit9af6528ee9b682df7f29dbee86fbba0b67eab944
tree4c4d95d0ab025f7d7120694718670efce57488b2
parentbf89a304722f6904009499a31dc68ab9a5c9742e
sched/core: Optimize __schedule()

Oleg noted that by making do_exit() use __schedule() for the TASK_DEAD
context switch, we can avoid the TASK_DEAD special case currently in
__schedule() because that avoids the extra preempt_disable() from
schedule().

In order to facilitate this, create a do_task_dead() helper which we
place in the scheduler code, such that it can access __schedule().

Also add some __noreturn annotations to the functions, there's no
coming back from do_exit().

Suggested-by: Oleg Nesterov <oleg@redhat.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Cc: Cheng Chao <cs.os.kernel@gmail.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Cc: akpm@linux-foundation.org
Cc: chris@chris-wilson.co.uk
Cc: tj@kernel.org
Link: http://lkml.kernel.org/r/20160913163729.GB5012@twins.programming.kicks-ass.net
Signed-off-by: Ingo Molnar <mingo@kernel.org>
include/linux/kernel.h
include/linux/sched.h
kernel/exit.c
kernel/sched/core.c