linux test project results on 2.4.11-pre2 and 2.4.10-ac4

From: rwhron@earthlink.net
Date: Wed Oct 03 2001 - 01:27:15 EST


Linux Test Project suite on 2.4.11-pre2 and 2.4.10-ac4.

vmstat output at the bottom shows free memory and
swap after the runs complete.

Kernel versions: 2.4.10-ac4 and 2.4.11-pre2
.config files: identical
Filesystem: ext2
Distro: Linux From Scratch 3.0
glibc: 2.2.4
LTP version: 20010925

Hardware:
Toshiba Tecra 8000
192 megs RAM
128 megs swap
400 mhz Pentium II

Test process:
boot kernel
login 3 console ttys
run "vmstat 8 >logfile" and tail it
run "for" loop to repeat LTP 3 times and log results
tail -f LTP results files

There were 11697 - 11705 individual tests that PASS

LTP isn't a benchmark, but I grabbed some growfile i/o results anyway.

Linux molehill 2.4.10-ac4 501161 iterations on 20 files in 400 seconds
Linux molehill 2.4.10-ac4 506526 iterations on 20 files in 400 seconds
Linux molehill 2.4.10-ac4 507885 iterations on 20 files in 400 seconds

Linux molehill 2.4.11-pre2 499002 iterations on 30 files in 520 seconds
Linux molehill 2.4.11-pre2 482127 iterations on 20 files in 400 seconds
Linux molehill 2.4.11-pre2 488833 iterations on 20 files in 400 seconds

Some of the growfile commands errored out each time. growfile aborts
when it detect an error. Above the first run on 2.4.11-pre2
completed one growfile command the others didn't.

growfile commands that didn't complete:

growfiles -b -e 1 -u -r 1-49600 -I r -u -i 0 -L 120 Lgfile1
output:
growfiles: 3822 growfiles.c/2085: 14470 tlibio.c/912 writev(3, iov, 1) nbyte:38796 returned=34449
growfiles: 3822 growfiles.c/1622: 14470 Hit max errors value of 1

growfiles -b -e 1 -i 0 -L 120 -u -g 5000 -T 100 -t 499990 -l -C 10 -c 1000 -S 10 -f Lgf03_
output:
growfiles: 3837 growfiles.c/2085: 7970 tlibio.c/706 write(3, buf, 5000) returned=888
growfiles: 3837 growfiles.c/1622: 7970 Hit max errors value of 1

Unique test failures

2nd 2.4.11-pre2 run
nanosleep01 1 FAIL : Child execution not suspended for 2 seconds
nanosleep01 1 FAIL : Failures reported above

3rd 2.4.11-pre2 run
recvfrom01 5 FAIL : invalid recv buffer ; returned -1 (expected 0), errno 14 (expected 88)

These are the test cases that failed on all runs:

execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 1 FAIL : Execve fail, execve06, errno = 2
execve06 0 INFO : Test FAILED
personality01 2 FAIL : returned persona was not expected
personality01 3 FAIL : returned persona was not expected
personality01 4 FAIL : returned persona was not expected
personality01 5 FAIL : returned persona was not expected
personality01 6 FAIL : returned persona was not expected
personality01 7 FAIL : returned persona was not expected
personality01 8 FAIL : returned persona was not expected
personality01 9 FAIL : returned persona was not expected
personality01 10 FAIL : returned persona was not expected
personality01 11 FAIL : returned persona was not expected
personality01 12 FAIL : returned persona was not expected
personality01 13 FAIL : returned persona was not expected
personality02 1 FAIL : call failed - errno = 0 - Success
pread02 2 FAIL : pread() returned 0, expected -1, errno:22
recv01 3 FAIL : invalid recv buffer ; returned 0 (expected -1), errno 88 (expected 14)
setpgid03 2 FAIL : setpgid FAILED, expect EACCES got 1
shmdt02 1 FAIL : call succeeded unexpectedly
vhangup02 1 FAIL : vhangup() failed, errno:1
waitpid05 6 FAIL : signal error: core dump bit not set for exception number 3
waitpid05 9 FAIL : signal error: core dump bit not set for exception number 4
waitpid05 12 FAIL : signal error: core dump bit not set for exception number 5
waitpid05 15 FAIL : signal error: core dump bit not set for exception number 6
waitpid05 18 FAIL : signal error: core dump bit not set for exception number 8
waitpid05 23 FAIL : signal error: core dump bit not set for exception number 11

/var/log/messages suggests I'm missing something for a few tests:
modprobe: Can't locate module personality-221 (12 like this)
modprobe: Can't locate module net-pf-0

vmstat steady state after the three runs:

2.4.11-pre2
   procs memory swap io system cpu
 r b w swpd free buff cache si so bi bo in cs us sy id
 0 0 0 5304 168132 516 14576 0 0 0 0 100 7 0 0 100

2.4.10-ac4
   procs memory swap io system cpu
 r b w swpd free buff cache si so bi bo in cs us sy id
 0 0 0 71800 109928 396 7492 0 0 0 0 100 11 0 0 100

That is a snippet from the logfile, not the result of just "vmstat"

Here are some earlier results that were not necessarily using the same
.config file, nor as carefully controlled. I.E. I may (or may not) have
been using the machine during the tests. These were all with ext3.

Linux molehill 2.4.9-ac17 398456 iterations on 30 files in 520 seconds
Linux molehill 2.4.9-ac17 477585 iterations on 41 files in 760 seconds
Linux molehill 2.4.9-ac17 466445 iterations on 41 files in 760 seconds
Linux molehill 2.4.10-ac1 500033 iterations on 41 files in 760 seconds
Linux molehill 2.4.10-ac1 478288 iterations on 41 files in 760 seconds
Linux molehill 2.4.10-ac1 451056 iterations on 30 files in 520 seconds
Linux molehill 2.4.10-ac1 470089 iterations on 30 files in 520 seconds
Linux molehill 2.4.10-ac3 357026 iterations on 20 files in 400 seconds
Linux molehill 2.4.10-ac3 438938 iterations on 20 files in 400 seconds
Linux molehill 2.4.10-ac3 440438 iterations on 20 files in 400 seconds

I'll do a summary from another machine without duplicating to much.

-- 
Randy Hron
Linux News at http://lwn.net/

- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Sun Oct 07 2001 - 21:00:25 EST