Re: Linux NFS vs NetApp

From: Jakob Oestergaard
Date: Tue Jan 11 2005 - 05:04:13 EST


On Tue, Jan 11, 2005 at 04:19:57AM -0500, Valdis.Kletnieks@xxxxxx wrote:
> On Mon, 10 Jan 2005 23:42:30 PST, Joel Jaeggli said:
>
> > In actually using sfs97r1 published benchmarks to compare to hardware I
> > was benchmarking (from emc, netapp and several roll-your own linux boxes)
> > I found the published benchmark information alsmost entirely useless given
> > that vendors tend to provide wildly silly hardware configurations. In the
> > case of the openpower 720 (to use that for an example) the benchmarked
> > machine has 70 15k rpm disks spread across 12 fibre channel controllers,
> > 64GB of ram, 12GB of nvram and 7 network interfaces...
>
> If you threw that much hardware at a Linux system,

... theory ... or have you actually tried?

> and then tuned it so that it
> didn't really care about userspace performance (oh.. say.. by giving the knfsd
> thread a RT priority ;), and tuned things like the filesystem, the slab
> allocator and the networking stack to NFS requirements, it probably would be
> screaming fast too.. ;)

You'd need to run a 2.4 kernel.

Current problems with 2.6:
1 ext3 causes kjournald oops on load
2 xfs has bad NFS/SMP/dcache interactions (you end up with undeletable
directories)
3 knfsd will give you stale handles (can be worked around by stat'ing
all your directories constantly on the server side)

The SGI XFS kernel from CVS actually almost solved (2) above, but not
entirely - I was going to report on that again to LKML. The other
problems are still, as far as I know, unsolved.

Not trying to flame anyone here, just trying to be realistic ;)

--

/ jakob

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/