ISS performance improvements quantified, bench results

David S. Miller (davem@jenolan.rutgers.edu)
Sat, 8 Mar 1997 23:58:11 -0500


In both sets of runs the client was identically configured, in fact it
was just left up running in between reboots of the server to switch
kernels.

The client is an SparcStation 10 w/100Mhz HyperSparc processor and a
100baseT interface, 178MB of ram, running Linux-2.0 ISS test4. The
server is a similarly configured SparcStation 10, with 142Mhz
HyperSparc processor, same 100baseT interface and also 178MB of ram.
The 100baseT was point to point, no switches were involved. The
Apache server version 1.2b7 was used. The benchmark was WebStone 2.0,
available from SGI's website but a pain in the ass to actually run (I
suggest everyone avoids this piece of garbage if you can, it takes a
rocket scientist to compile the thing and get it to run, it doesn't
support multiple clients on different architectures at once etc.).

Two runs were done with a stock 2.0.29 kernel, two others were done
with the ISS test4 patches installed. The first run in each set was
done with the simplest filelist, which is composed of one single 1024
byte html page that gets requested over and over again by the
benchmark. The second run was done using the filelist.standard
provided with the benchmark, this set of pages has a range of various
sized pages from 1k to around 5mb, they are requested randomly. The
latter is supposed to represent more of a "typical" web server
workload. Each run was done for a duration of 5 minutes with 10
concurrent web clients processes.

Anyways here goes, first stock Linux-2.0.29 without the ISS patches:

Simple fileset, one 1024k file

WEBSTONE 2.0 results:
Total number of clients: 10
Test time: 5 minutes
Server connection rate: 90.24 connections/sec
Server error rate: 0.0000 err/sec
Server thruput: 1.07 Mbit/sec
Little's Load Factor: 9.99
Average response time: 0.1107 sec
Error Level: 0.0000 %
Average client thruput: 110 Kbit/sec
Sum of client response times: 2996.150305 sec
Total number of pages read: 27073

Standard fileset, numerous files of various sizes

WEBSTONE 2.0 results:
Total number of clients: 10
Test time: 5 minutes
Server connection rate: 75.32 connections/sec
Server error rate: 0.0000 err/sec
Server thruput: 9.45 Mbit/sec
Little's Load Factor: 6.79
Average response time: 0.0902 sec
Error Level: 0.0000 %
Average client thruput: 1425 Kbit/sec
Sum of client response times: 2037.317882 sec
Total number of pages read: 22596

Now, 2.0.29 with the ISS patches installed:

Simple fileset, one 1024k file

WEBSTONE 2.0 results:
Total number of clients: 10
Test time: 5 minutes
Server connection rate: 150.43 connections/sec
Server error rate: 0.0000 err/sec
Server thruput: 1.79 Mbit/sec
Little's Load Factor: 9.96
Average response time: 0.0662 sec
Error Level: 0.0000 %
Average client thruput: 184 Kbit/sec
Sum of client response times: 2988.783102 sec
Total number of pages read: 45129

Standard fileset, numerous files of various sizes

WEBSTONE 2.0 results:
Total number of clients: 10
Test time: 5 minutes
Server connection rate: 102.68 connections/sec
Server error rate: 0.0000 err/sec
Server thruput: 13.88 Mbit/sec
Little's Load Factor: 6.21
Average response time: 0.0605 sec
Error Level: 0.0000 %
Average client thruput: 2286 Kbit/sec
Sum of client response times: 1864.277697 sec
Total number of pages read: 30803

Not to bad for 3 days of hacking and 3 days of debugging ;-) and on
top of it I killed a ton of bugs, I'm slightly pleased with the
results...

---------------------------------------------////
Yow! 11.26 MB/s remote host TCP bandwidth & ////
199 usec remote TCP latency over 100Mb/s ////
ethernet. Beat that! ////
-----------------------------------------////__________ o
David S. Miller, davem@caip.rutgers.edu /_____________/ / // /_/ ><