Re: [patch 0/7] cpuset writeback throttling

From: Christoph Lameter
Date: Tue Nov 04 2008 - 17:19:47 EST


On Tue, 4 Nov 2008, Andrew Morton wrote:

What are the alternatives here? What do we need to do to make
throttling a per-memcg thing?

Add statistics to the memcg lru and then you need some kind of sets of memcgs that are represented by bitmaps or so attached to an inode.

The patchset is badly misnamed, btw. It doesn't throttle writeback -
in fact several people are working on IO bandwidth controllers and
calling this thing "writeback throttling" risks confusion.

It is limiting dirty pages and throttling the dirty rate of applications in a NUMA system (same procedure as we do in non NUMA). The excessive dirtying without this patchset can cause OOMs to occur on NUMA systems.

What we're in fact throttling is rate-of-memory-dirtying. The last
thing we want to throttle is writeback - we want it to go as fast as
possible!

We want to limit the amount of dirty pages such that I/O is progressing with optimal speeds for an application that significantly dirties memory. Other processes need to be still able to do their work without being swapped out because of excessive memory use for dirty pages by the first process.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/