Re: Delete scheduler SD_WAKE_AFFINE and SD_WAKE_BALANCE flags
From: Nick Piggin
Date: Thu Jul 28 2005 - 18:39:22 EST
Chen, Kenneth W wrote:
What sort of workload needs SD_WAKE_AFFINE and SD_WAKE_BALANCE?
SD_WAKE_AFFINE are not useful in conjunction with interrupt binding.
In fact, it creates more harm than usefulness, causing detrimental
process migration and destroy process cache affinity etc. Also
SD_WAKE_BALANCE is giving us performance grief with our industry
standard OLTP workload.
The periodic load balancer basically makes completely undirected,
random choices when picking which tasks to move where.
Wake balancing provides an opportunity to provide some input bias
into the load balancer.
For example, if you started 100 pairs of tasks which communicate
through a pipe. On a 2 CPU system without wake balancing, probably
half of the pairs will be on different CPUs. With wake balancing,
it should be much better.
I've also been told that it impoves IO efficiency significantly -
obviously that depends on the system and workload.
To demonstrate the problem, we turned off these two flags in the cpu
sd domain and measured a stunning 2.15% performance gain! And deleting
all the code in the try_to_wake_up() pertain to load balancing gives us
another 0.2% gain.
The wake up patch should be made simple, just put the waking task on
the previously ran cpu runqueue. Simple and elegant.
I'm proposing we either delete these two flags or make them run time
There have been lots of changes since 2.6.12. Including less aggressive
I hear you might be having problems with recent 2.6.13 kernels? If so,
it would be really good to have a look that before 2.6.13 goes out the
I appreciate all the effort you're putting into this!
SUSE Labs, Novell Inc.
Send instant messages to your online friends http://au.messenger.yahoo.com
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/