[ANNOUNCE] Filesystem test tools open-sourced by SGI

From: Greg Banks
Date: Thu Apr 02 2009 - 10:29:43 EST


G'day,

SGI is releasing to the Open Source community a number of internal
SGI testing and debugging tools for NFS. Some of these tools are
also applicable to filesystems in general.

These tools are being released under the GNU General Public License
(GPL) version 2, in the hope that the Linux filesystem development
community may find them useful. They are provided as-is, without any
support. Please do not contact SGI for support on any of these tools.

Some of these tools are unfinished. Others rely on build
infrastructure in internal SGI trees which cannot be released.
The tools are provided as tarball snapshots of internal SGI source
control trees; for a number of technical reasons it is not possible
to provide access to those trees or to create external repositories.

The tools are available for download now at

http://oss.sgi.com/projects/nfs/testtools/

A brief description of each tool follows.

Checkstream
-----------

Simple data corruption testing utilities based on the concept of
generating a stream of small self-contained records which can be
decoded in a way which makes certain common data corruption modes
automatically diagnosable. Has been useful for automated testing of
NFS, XFS, and CXFS in SGI.

Weber
-----

Test load generator for NFS. Uses multiple threads, multiple sockets
and multiple IP addresses to simulate loads from many machines,
thus enabling testing of NFS server setups with larger client counts
than can be tested with physical infrastructure (or Virtual Machine
clients). Has been useful in automated NFS testing and as a pinpoint
NFS load generator tool for performance development.

NFS PMDA
--------

PCP Data Agent for extended NFS server statistics. Exports to PCP
the new statistics (measuring per-client and per-server performance)
which are provided by SGI's EnhancedNFS kernel patches.

Samba PMDA
----------

PCP Data Agent for extended Samba server statistics. Exports to
PCP the additional statistics (measuring per-client and per-server
performance) which are provided by SGI's patches to Samba.

Ddnfs
-----

Filesystem load generation program designed to simulate the IO
load placed on an XFS filesystem by the NFS server in response
to certain NFS loads. Intended for use in XFS automated testing,
to test performance and correctness of certain XFS functionality
not otherwise exercised by the existing XFS test suite, but never
integrated into XFSQA.

Pmapload
--------

Test suite for the portmap and rpcbind programs (which are
NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). Developed by SGI to
test changes imported into those programs from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.

RPC Exerciser
-------------

Test suite for the userspace RPC infrastructure libraries, (which
are NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). Developed by SGI to
test changes imported into those libraries from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.

Testfs
------

Linux kernel module which provides an in-memory filesystem which
forgets all data written to it. Also can be configured to simulate
timing behaviour on reads and writes. This is useful for NFS
performance testing without a fast disk subsystem.

StReplay
--------

Program which reads the system call trace of another program (obtained
using the widely available strace utility) and replays the IO pattern.
This was intended to be used for automated NFS and XFS testing and
for NFS and XFS problem diagnosis, but was never completed as the
author transferred to another team. Could be the basis for a very
useful filesystem test tool.


--
Greg Banks, P.Engineer, SGI Australian Software Group.
the brightly coloured sporks of revolution.
I don't speak for SGI.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/