Re: [Slightly off topic] A question about R/B trees.
From: Maxim Levitsky
Date: Fri Oct 17 2008 - 18:48:01 EST
Chris Snook wrote:
Maxim Levitsky wrote:
I am working on my small project, and I need a fast container to hold
a large sparse array.
Balanced trees seem to fit perfectly.
Balanced trees take O(log n) to perform a great many operations, and
traversing a binary tree is a particularly bad case for branch
prediction. Hash tables will perform much better, unless you get them
horribly wrong.
Let me explain.
I am writing a userspace packet writing application.
One of things I need is to have a cache of the disk.
I need an 'array' that will hold cache of written blocks in ascending order,
I need to be able to insert a block anywhere in the array, and be able to read it
from lowest block to highest.
Hash tables can't be read this way, right?
I could use a linked list, but insertion will be slower.
I decided to implement a red/black tree, and took a look at kernel rb
tree for reference,
and I noticed that tree item has no parent pointer, while it seems
that it should have it.
I know now that it has parent pointer, but it is mixed with current
and parent node colour.
Thus it is assumed that last two bits of this pointer are zero.
Not quite. Read this:
http://lwn.net/Articles/184495/
What do you mean?
I have read this article, I haven't yet spotted anything suspicious about parent pointer there yet.
I can see anywhere that this restriction is applied.
I see that structure is "aligned" but that I think only ensures that
compiler places it
aligned in static data, does the alignment ensures that it will always
place it on aligned address in a structure?
But then, the whole container structure can be misaligned, can't it?
GCC will only misalign the contents of a struct if you explicitly tell
it to pack the struct. That's one of those things you only do if you're
100% certain it's the right thing, and you're prepared to accept the
consequences if you screw it up.
Why gcc?
Say you allocate a piece of memory using kmalloc, and write there, a structure that contains a r/b tree item.
I agree that gcc will ensure that offset from start of that structure to first byte of the tree item will be aligned.
But what if malloc returned a misaligned pointer?
This will ensure that virtual address of the tree item won't be aligned.
(I know it doesn't, but this isn't a assumption about gcc anymore)
Besides a comment there states that alignment is only for CRIS
I'm not sure this check is still necessary, but CRIS is a rather niche
architecture. On most architectures, word-aligning structures boosts
performance at negligible memory cost, so compilers do it automatically.
How about a check for misalignment?
The kernel is written in a dialect of C that makes several assumptions
about the compiler, among them that the compiler won't screw this up
unless you tell it to. Any compiler that has alignment problems with
the rbtree code is going to have similar problems in lots of other
places too. We don't support those compilers.
Best regards,
Maxim Levitsky
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/