Sudden sequence of kernel crashes & OOPSes

Harvey J. Stein (abel@netvision.net.il)
Wed, 2 Apr 1997 17:02:21 +0300


Hi -

We're running 2.0.29, and just experienced a string of crashes. Last
night I was in X, the screen suddenly went blank, and the machine went
into the boot sequence (bios notice, etc). It then seemed to have
hung during the fsck of the hard disk - I left it for awhile, I didn't
hear the hard disk, didn't see the disk light flash, and finally power
cycled it. Then it booted, checked the disk and gave me a login
prompt.

The next day, it gave me a kernel oops when I logged in. Neither last
night's crash nor the kernel oops from this morning were recorded in
the log files. However, I copied this morning's oops down by hand.

When it rebooted it checked the disk and came up. Logging in didn't
cause a oops this time. We rebooted into single user mode, did umount
/ to remount the root partition read-only, did afew forced checks of
the file system to make sure (the first one with a badblocks check),
and finally power cycled the machine to reboot it normally.

After this, I entered X & started reading email in emacs. It seems
that an oops occured again & killed emacs. This happened afew times.
I tried rebooting with kernel 2.0.27 and got 2 oopses during boot -
one when doing depmods & one when loading modules. Finally, I
rebooted again (with kernel 2.0.29) and it seems to be (more or less) stable.

BTW, some of the oopses were associated with many kernel messages like:

Apr 2 11:55:37 blinky kernel: MASQ: failed TCP/UDP checksum from
207.123.21.50!

By the way, we connect to the internet via ppp. The machine crashing uses IP
Masquerading to give access to the rest of the net. The above ip
address is not from our local net, and is not from our IP provider.

host has this to say about the above address:

hjstein@blinky:~$ host 207.123.21.50
Host not found.

But pings to the address succeed:

hjstein@blinky:~$ ping 207.123.21.50
PING 207.123.21.50 (207.123.21.50): 56 data bytes
64 bytes from 207.123.21.50: icmp_seq=0 ttl=41 time=521.1 ms

Traceroute has this to say:

hjstein@blinky:~$ /usr/sbin/traceroute 207.123.21.50
traceroute to 207.123.21.50 (207.123.21.50), 30 hops max, 40 byte packets
1 ts023.pop3b.netvision.net.il (199.203.201.164) 162.172 ms 148.244 ms 149.577 ms
2 sbwest-7000-201.pop3b.netvision.net.il (199.203.201.1) 196.616 ms 153.657 ms 169.782 ms
3 tlv7200-7000.NetVision.net.il (199.203.4.229) 149.785 ms 155.739 ms 759.614 ms
4 nyc-G1-ipl.NetVision.net.il (194.90.0.57) 409.746 ms 452.316 ms 869.806 ms
5 gsl-penn-3-Serial8/4.gsl.net (204.59.192.13) 499.741 ms 317.533 ms 299.736 ms
6 gsl-sl-penn-fddi.gsl.net (204.59.136.198) 419.677 ms 532.647 ms 389.784 ms
7 bb4-pen-P0/0/0-155M.sprintlink.net (144.232.0.78) 529.725 ms 397.465 ms 469.826 ms
8 bb1-pen-P4/0/0-155M.sprintlink.net (144.232.0.82) 389.648 ms 539.048 ms 449.777 ms
9 bb1-fw-H1/0-T3.sprintlink.net (144.228.10.97) 649.773 ms 676.279 ms 459.734 ms
10 gw11-fw-F0/0.sprintlink.net (144.228.30.15) 409.761 ms 500.212 ms 559.767 ms
11 sl-smartt-1-s-T3.sprintlink.net (144.228.135.6) 559.805 ms 394.829 ms 419.756 ms
12 * * *

and * * * afterwards until traceroute exits at hop 30.

Finally, I'd just like to mention that I've been seeing lots of
"Couldn't get a free page....." messages in the kernel logs. Usually
about 1-2/day, sometimes as many as 6 or 8. Also, the machine (32mb
ram, p120) seems to go into heavy swapping when running emacs (takes
4-8mb) & netscape, if I really surf hard (i.e. - pop up maybe 10-30
netscape windows by following links into a new browser window, & get
netscape to take up about 17mb or so). The strange things I notice
when doing this are:

1. netscape will freeze up for a long time until it processes a new
request - say 30-60 seconds.
2. massive disk action.
3. Disk buffer cache as indicated by free seems quite large -
something like 8mb.
4. Very little is swapped - can be as little as 4mb.
5. Although emacs is open, I'm not actively editing.
6. Other windows are quite responsive.

So, it seems to me like netscape itself is getting pages swapped back
and forth, and other things are *not* getting moved out of ram & into
swap to accommodate it. I'm especially surprised to see such a large
disk cache in use, and so little swap space used - surely emacs + the X
server could lay in swap more to accommodate netscape, and surely some
of those disk cache pages could be dropped.

I don't know if this is related or not, so I thought I'd mention
it just to be on the safe side.

Before giving the oops msgs, here's the config info:
redhat 3.0.3 + errata fixes
libc.so.5.2.18
gcc version 2.7.2
using kerneld + modules:
ppp 5 0 (autoclean)
slhc 2 [ppp] 0 (autoclean)
ip_masq_irc 1 0
ip_masq_ftp 1 0

Using ipfwadm 2.2 (redhat ipfwadm-2.2-1.i386.rpm), ethernet ne2000,
32mb ram, Linux blinky 2.0.29 #1 Tue Feb 11 13:43:15 IST 1997 i586,
Diamond stealth S3 968 pci video card.

pci bus info:
hjstein@blinky:/proc$ cat pci
PCI devices found:
Bus 0, device 11, function 0:
VGA compatible controller: S3 Inc. Vision 968 (rev 0).
Medium devsel. IRQ 11.
Non-prefetchable 32 bit memory at 0xf2000000.
Bus 0, device 7, function 1:
IDE interface: Intel 82371SB Natoma/Triton II PIIX3 (rev 0).
Medium devsel. Fast back-to-back capable. Master Capable. Latency=32.
I/O at 0xe800.
Bus 0, device 7, function 0:
ISA bridge: Intel 82371SB Natoma/Triton II PIIX3 (rev 1).
Medium devsel. Fast back-to-back capable. Master Capable. No bursts.
Bus 0, device 0, function 0:
Host bridge: Intel 82437VX Triton II (rev 2).
Medium devsel. Master Capable. Latency=32.

disk info:
Apr 1 20:19:40 blinky kernel: hda: IBM-DJAA-31700, 1628MB w/96kB Cache, LBA, CHS=3308/16/63
Apr 1 20:19:40 blinky kernel: hdd: TOSHIBA CD-ROM XM-5302TA, ATAPI CDROM drive

Here's the oops I copied from the screen and typed in by hand (so it's
probably buggy):

bounds: 0000
CPU : 0
EIP : 0010:[<003f7078>]
EFLAGS: 00010296
eax: 003f6f7f ebx: 0023e6bc ecx: 01dab000 edx: 00181af
esi: 00005000 edi: 00b6b6c9 ebp: 001cada0 esp: 01dafbe4
ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Process netstat (pid: 2469, process nr: 39, stackpage=01daf000)
Stack: 0011b500 00b6b6c8 0023e6bc 00240f90 00b6b6c8 00b6b6c8 00000000 0011bda7
00b6b6c8 00005000 00000000 00000001 01e5c014 08005000 01f15a18 00004000
00b6b6c8 00001e5c 001c8d96 0011947f 01f15a18 08005000 00000001 0011937c
Call Trace: [<0011b500>] [<0011bda7>] [<0011947f>] [<0011937c>] [<0010976d>] [<001104c8>] [<001103ac>]
[<0010a76d>] [<0012e013>] [<0012f111>] [<001734e8>] [<00174286>] [<00130014>] [<001297c3>] [<00129a19>]
[<00129a3e>] [<00109d92>] [<0010a5e2>]
Code: 62 61 63 6b 0a 74 75 72 6e 62 6f 75 74 0a 74 75 72 6e 62 75

Attempt to access beyond end of device
03:ff: rw=0, want=8208, limit=0

kernel panic: ext2-fs panic (device 03:02) ext2_write_inode.
unable to read inode block - inode=2084, block=8207

Here's the ksymoops output from the above:

Using `/System.map' to map addresses to symbols.

Trace: 11b500 <try_to_read_ahead+f0/100>
Trace: 11bda7 <filemap_nopage+233/298>
Trace: 11947f <do_no_page+103/328>
Trace: 11947f <do_no_page+103/328>
Trace: 10976d <hard_reset_now+a9/110>
Trace: 1104c8 <do_page_fault+11c/2cc>
Trace: 1104c8 <do_page_fault+11c/2cc>
Trace: 10a76d <error_code+3d/50>
Trace: 12e013 <padzero+2f/3c>
Trace: 12f111 <load_elf_binary+a91/b2c>
Trace: 1734e8 <write_intr>
Trace: 174286 <ide_intr+3e/64>
Trace: 130014 <elf_core_dump+a2c/a48>
Trace: 1297c3 <search_binary_handler+3f/150>
Trace: 129a19 <do_execve+145/1b8>
Trace: 129a3e <do_execve+16a/1b8>
Trace: 109d92 <sys_execve+32/50>
Trace: 10a5e2 <system_call+52/80>

Code: boundl 0x63(%ecx),%esp
Code: imull $0x74,(%edx),%ecx
Code: jne 0000007a <_EIP+7a>
Code: outsb %ds:(%esi),(%dx)
Code: boundl 0x75(%edi),%ebp
Code: je 00000018 <_EIP+18>
Code: je 00000085 <_EIP+85>
Code: jb 00000080 <_EIP+80>
Code: boundl 0x0(%ebp),%esi
Code: nop
Code: nop

Here what showed up in the kernel logs before the 1st oops this
morning (the one that occurred when I first logged in):

Apr 2 10:32:17 blinky kernel: Aiee: scheduling in interrupt 0011b589
Apr 2 10:32:17 blinky last message repeated 2 times
Apr 2 10:32:17 blinky kernel: Aiee: scheduling in interrupt 00122ec5
Apr 2 10:32:17 blinky kernel: Aiee: scheduling in interrupt 00122ec5
Apr 2 10:32:17 blinky kernel: Aiee: scheduling in interrupt 0011b589
Apr 2 10:32:17 blinky kernel: bounds: 0000
Apr 2 10:54:48 blinky kernel: klogd 1.3-0, log source = /proc/kmsg started.
Apr 2 10:54:48 blinky kernel: Cannot find map file.
Apr 2 10:54:48 blinky kernel: Wrong blocksize on device 03:02
Apr 2 10:54:48 blinky kernel: VFS: Wrong blocksize on device 03:02
Apr 2 10:56:59 blinky kernel: klogd 1.3-0, log source = /proc/kmsg started.
Apr 2 10:57:00 blinky kernel: Cannot find map file.

Here're excerpts from the kernel logs from all the recorded oopses
that occurred this morning, along with the ksymoops output for each
(bracketed by lines of equal signs):

********************** REBOOTED *******************************************

Apr 2 11:41:03 blinky kernel: Unable to handle kernel paging request at virtual address c8002000
Apr 2 11:41:03 blinky kernel: current->tss.cr3 = 00101000, \r3 = 00101000
Apr 2 11:41:03 blinky kernel: *pde = 00000000
Apr 2 11:41:03 blinky kernel: Oops: 0000
Apr 2 11:41:03 blinky kernel: CPU: 0
Apr 2 11:41:03 blinky kernel: EIP: 0010:[<00110a2c>]
Apr 2 11:41:03 blinky kernel: EFLAGS: 00010202
Apr 2 11:41:03 blinky kernel: eax: 00000000 ebx: 08002000 ecx: 001a8ac4 edx: 00355b98
Apr 2 11:41:03 blinky kernel: esi: 00355b98 edi: 001a8ac0 ebp: 007e7f74 esp: 007e7f68
Apr 2 11:41:03 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 11:41:03 blinky kernel: Process killall (pid: 494, process nr: 49, stackpage=007e7000)
Apr 2 11:41:03 blinky kernel: Stack: 01daec98 00355b98 004f0258 00000000 00122286 001a8ac4 004f0298 0011a663
Apr 2 11:41:03 blinky kernel: 01daec98 00355b98 ffffffff fffffffc 00115893 00355b98 0047d018 ffffffff
Apr 2 11:41:03 blinky kernel: fffffffc 00000000 001159e2 00000100 0010a5e2 00000001 00000001 000000e0
Apr 2 11:41:03 blinky kernel: Call Trace: [<00122286>] [<0011a663>] [<00115893>] [<001159e2>] [<0010a5e2>]
Apr 2 11:41:03 blinky kernel: Code: 8b 13 8b 5b 04 85 d2 74 6d 8b 02 83 f8 02 74 07 8b 02 83 f8

=========================================================================
=>>EIP: 110a2c <wake_up+2c/e4>
Trace: 122286 <iput+8e/17c>
Trace: 11a663 <exit_mmap+8b/a4>
Trace: 115893 <do_exit+ab/1ec>
Trace: 1159e2 <sys_exit+e/10>
Trace: 10a5e2 <system_call+52/80>

Code: 110a2c <wake_up+2c/e4> movl (%ebx),%edx
Code: 110a2e <wake_up+2e/e4> movl 0x4(%ebx),%ebx
Code: 110a31 <wake_up+31/e4> testl %edx,%edx
Code: 110a33 <wake_up+33/e4> je 110aa2 <wake_up+a2/e4>
Code: 110a35 <wake_up+35/e4> movl (%edx),%eax
Code: 110a37 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110a3a <wake_up+3a/e4> je 110a43 <wake_up+43/e4>
Code: 110a3c <wake_up+3c/e4> movl (%edx),%eax
Code: 110a3e <wake_up+3e/e4> cmpl $0x0,%eax
Code: 110a41 <wake_up+41/e4> nop
Code: 110a42 <wake_up+42/e4> nop
========================================================================
Apr 2 11:47:04 blinky kernel: general protection: 0000
Apr 2 11:47:04 blinky kernel: CPU: 0
Apr 2 11:47:04 blinky kernel: EIP: 0010:[<00110a35>]
Apr 2 11:47:04 blinky kernel: EFLAGS: 00010206
Apr 2 11:47:04 blinky kernel: eax: 00000000 ebx: 36f004ae ecx: 001a8ac4 edx: 7c7231af
Apr 2 11:47:04 blinky kernel: esi: 01dae3e0 edi: 001a8ac0 ebp: 014a1f74 esp: 014a1f68
Apr 2 11:47:04 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 11:47:04 blinky kernel: Process emacs (pid: 283, process nr: 39, stackpage=014a1000)
Apr 2 11:47:04 blinky kernel: Stack: 01dae3e0 01dae3e0 01dae3e0 bffff088 00122286 001a8ac4 00d7bbc0 0012122e
Apr 2 11:47:04 blinky kernel: 01dae3e0 00000000 00d7bbc0 00121280 00d7bbc0 01dae3e0 fffffff7 00000003
Apr 2 11:47:04 blinky kernel: bffff100 001212d4 00d7bbc0 014d7018 0010a5e2 00000003 bffff0dc 00000023
Apr 2 11:47:04 blinky kernel: Call Trace: [<00122286>] [<0012122e>] [<00121280>] [<001212d4>] [<0010a5e2>]
Apr 2 11:47:04 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
>>EIP: 110a35 <wake_up+35/e4>
Trace: 122286 <iput+8e/17c>
Trace: 12122e <__fput+3a/40>
Trace: 121280 <close_fp+4c/5c>
Trace: 1212d4 <sys_close+44/50>
Trace: 10a5e2 <system_call+52/80>

Code: 110a35 <wake_up+35/e4> movl (%edx),%eax
Code: 110a37 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110a3a <wake_up+3a/e4> je 110a43 <wake_up+43/e4>
Code: 110a3c <wake_up+3c/e4> movl (%edx),%eax
Code: 110a3e <wake_up+3e/e4> cmpl $0x1,%eax
Code: 110a41 <wake_up+41/e4> jne 110aa2 <wake_up+a2/e4>
Code: 110a43 <wake_up+43/e4> pushf
Code: 110a44 <wake_up+44/e4> popl %esi
Code: 110a45 <wake_up+45/e4> cli
Code: 110a46 <wake_up+46/e4> movl $0x90900000,(%edx)
=========================================================================
Apr 2 11:48:19 blinky kernel: general protection: 0000
Apr 2 11:48:19 blinky kernel: CPU: 0
Apr 2 11:48:19 blinky kernel: EIP: 0010:[<00110a35>]
Apr 2 11:48:19 blinky kernel: EFLAGS: 00010206
Apr 2 11:48:19 blinky kernel: eax: 01da0001 ebx: c3f000ef ecx: 001a8ac4 edx: 6f000000
Apr 2 11:48:19 blinky kernel: esi: 01dae6c8 edi: 001a8ac0 ebp: 01517f74 esp: 01517f68
Apr 2 11:48:19 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 11:48:19 blinky kernel: Process emacs (pid: 530, process nr: 39, stackpage=01517000)
Apr 2 11:48:19 blinky kernel: Stack: 01dae6c8 01dae6c8 01dae6c8 bfffed90 00122286 001a8ac4 01075b00 0012122e
Apr 2 11:48:19 blinky kernel: 01dae6c8 00000000 01075b00 00121280 01075b00 01dae6c8 fffffff7 00000003
Apr 2 11:48:19 blinky kernel: bfffedc8 001212d4 01075b00 014d7018 0010a5e2 00000003 bfffedc8 00000004
Apr 2 11:48:19 blinky kernel: Call Trace: [<00122286>] [<0012122e>] [<00121280>] [<001212d4>] [<0010a5e2>]
Apr 2 11:48:19 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
>>EIP: 110a35 <wake_up+35/e4>
Trace: 122286 <iput+8e/17c>
Trace: 12122e <__fput+3a/40>
Trace: 121280 <close_fp+4c/5c>
Trace: 1212d4 <sys_close+44/50>
Trace: 10a5e2 <system_call+52/80>

Code: 110a35 <wake_up+35/e4> movl (%edx),%eax
Code: 110a37 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110a3a <wake_up+3a/e4> je 110a43 <wake_up+43/e4>
Code: 110a3c <wake_up+3c/e4> movl (%edx),%eax
Code: 110a3e <wake_up+3e/e4> cmpl $0x1,%eax
Code: 110a41 <wake_up+41/e4> jne 110aa2 <wake_up+a2/e4>
Code: 110a43 <wake_up+43/e4> pushf
Code: 110a44 <wake_up+44/e4> popl %esi
Code: 110a45 <wake_up+45/e4> cli
Code: 110a46 <wake_up+46/e4> movl $0x90900000,(%edx)
=========================================================================
Apr 2 11:55:37 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 11:56:09 blinky last message repeated 4 times
Apr 2 11:57:02 blinky last message repeated 2 times
Apr 2 11:59:34 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:00:09 blinky last message repeated 5 times
Apr 2 12:01:43 blinky last message repeated 2 times
Apr 2 12:01:59 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:03:43 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:04:03 blinky last message repeated 2 times
Apr 2 12:05:43 blinky last message repeated 2 times
Apr 2 12:05:59 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:07:43 blinky last message repeated 2 times
Apr 2 12:08:42 blinky last message repeated 5 times
Apr 2 12:09:43 blinky last message repeated 7 times
Apr 2 12:10:48 blinky last message repeated 6 times
Apr 2 12:11:43 blinky last message repeated 4 times
Apr 2 12:12:43 blinky last message repeated 6 times
Apr 2 12:13:43 blinky last message repeated 7 times
Apr 2 12:14:42 blinky last message repeated 5 times
Apr 2 12:15:45 blinky last message repeated 6 times
Apr 2 12:16:42 blinky last message repeated 3 times
Apr 2 12:17:45 blinky last message repeated 6 times
Apr 2 12:18:42 blinky last message repeated 3 times
Apr 2 12:19:45 blinky last message repeated 4 times
Apr 2 12:20:42 blinky last message repeated 3 times
Apr 2 12:21:32 blinky last message repeated 4 times
Apr 2 12:21:40 blinky kernel: general protection: 0000
Apr 2 12:21:40 blinky kernel: CPU: 0
Apr 2 12:21:40 blinky kernel: EIP: 0010:[<00110a35>]
Apr 2 12:21:40 blinky kernel: EFLAGS: 00010206
Apr 2 12:21:40 blinky kernel: eax: 01da0001 ebx: c3f000ef ecx: 001a8ac4 edx: 6f000000
Apr 2 12:21:40 blinky kernel: esi: 01daee88 edi: 001a8ac0 ebp: 01996f74 esp: 01996f68
Apr 2 12:21:40 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 12:21:40 blinky kernel: Process mgetty (pid: 205, process nr: 29, stackpage=01996000)
Apr 2 12:21:40 blinky kernel: Stack: 01daee88 01daee88 01daee88 bffff1d4 00122286 001a8ac4 00d7bc80 0012122e
Apr 2 12:21:40 blinky kernel: 01daee88 00000000 00d7bc80 00121280 00d7bc80 01daee88 fffffff7 00000000
Apr 2 12:21:40 blinky kernel: 0000000b 001212d4 00d7bc80 01997018 0010a5e2 00000000 0000000a bffff15c
Apr 2 12:21:40 blinky kernel: Call Trace: [<00122286>] [<0012122e>] [<00121280>] [<001212d4>] [<0010a5e2>]
Apr 2 12:21:40 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
>>EIP: 110a35 <wake_up+35/e4>
Trace: 122286 <iput+8e/17c>
Trace: 12122e <__fput+3a/40>
Trace: 121280 <close_fp+4c/5c>
Trace: 1212d4 <sys_close+44/50>
Trace: 10a5e2 <system_call+52/80>

Code: 110a35 <wake_up+35/e4> movl (%edx),%eax
Code: 110a37 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110a3a <wake_up+3a/e4> je 110a43 <wake_up+43/e4>
Code: 110a3c <wake_up+3c/e4> movl (%edx),%eax
Code: 110a3e <wake_up+3e/e4> cmpl $0x1,%eax
Code: 110a41 <wake_up+41/e4> jne 110aa2 <wake_up+a2/e4>
Code: 110a43 <wake_up+43/e4> pushf
Code: 110a44 <wake_up+44/e4> popl %esi
Code: 110a45 <wake_up+45/e4> cli
Code: 110a46 <wake_up+46/e4> movl $0x90900000,(%edx)
=========================================================================
Apr 2 12:21:45 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:22:42 blinky last message repeated 3 times
Apr 2 12:23:45 blinky last message repeated 4 times
Apr 2 12:24:02 blinky last message repeated 2 times
Apr 2 12:24:02 blinky kernel: wait_queue is bad (eip = 00122286)
Apr 2 12:24:02 blinky kernel: q = 001a8ac4
Apr 2 12:24:02 blinky kernel: *q = 00000000
Apr 2 12:24:09 blinky kernel: general protection: 0000
Apr 2 12:24:09 blinky kernel: CPU: 0
Apr 2 12:24:09 blinky kernel: EIP: 0010:[<00110a35>]
Apr 2 12:24:09 blinky kernel: EFLAGS: 00010206
Apr 2 12:24:09 blinky kernel: eax: 01da0001 ebx: c3f000ef ecx: 001a8ac4 edx: 6f000000
Apr 2 12:24:09 blinky kernel: esi: 01daeaa8 edi: 001a8ac0 ebp: 00a71f74 esp: 00a71f68
Apr 2 12:24:09 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 12:24:09 blinky kernel: Process emacs (pid: 535, process nr: 39, stackpage=00a71000)
Apr 2 12:24:09 blinky kernel: Stack: 01daeaa8 01daeaa8 01daeaa8 bffff0a0 00122286 001a8ac4 012b58c0 0012122e
Apr 2 12:24:09 blinky kernel: 01daeaa8 00000000 012b58c0 00121280 012b58c0 01daeaa8 fffffff7 00000003
Apr 2 12:24:09 blinky kernel: bffff118 001212d4 012b58c0 014d7018 0010a5e2 00000003 bffff0f4 00000023
Apr 2 12:24:09 blinky kernel: Call Trace: [<00122286>] [<0012122e>] [<00121280>] [<001212d4>] [<0010a5e2>]
Apr 2 12:24:09 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
=>>EIP: 110a35 <wake_up+35/e4>
Trace: 122286 <iput+8e/17c>
Trace: 12122e <__fput+3a/40>
Trace: 121280 <close_fp+4c/5c>
Trace: 1212d4 <sys_close+44/50>
Trace: 10a5e2 <system_call+52/80>

Code: 110a35 <wake_up+35/e4> movl (%edx),%eax
Code: 110a37 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110a3a <wake_up+3a/e4> je 110a43 <wake_up+43/e4>
Code: 110a3c <wake_up+3c/e4> movl (%edx),%eax
Code: 110a3e <wake_up+3e/e4> cmpl $0x1,%eax
Code: 110a41 <wake_up+41/e4> jne 110aa2 <wake_up+a2/e4>
Code: 110a43 <wake_up+43/e4> pushf
Code: 110a44 <wake_up+44/e4> popl %esi
Code: 110a45 <wake_up+45/e4> cli
Code: 110a46 <wake_up+46/e4> movl $0x90900000,(%edx)
========================================================================
Apr 2 12:24:42 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:24:50 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:26:02 blinky last message repeated 2 times
Apr 2 12:27:11 blinky last message repeated 3 times
Apr 2 12:27:45 blinky last message repeated 2 times
Apr 2 12:29:11 blinky last message repeated 3 times
Apr 2 12:29:45 blinky last message repeated 2 times
Apr 2 12:31:11 blinky last message repeated 3 times
Apr 2 12:31:45 blinky last message repeated 2 times
Apr 2 12:33:11 blinky last message repeated 3 times
Apr 2 12:33:45 blinky last message repeated 2 times
Apr 2 12:35:11 blinky kernel: MASQ: failed TCP/UDP checksum from 207.123.21.50!
Apr 2 12:35:45 blinky last message repeated 2 times

********************** REBOOTED (into 2.0.27) *******************************************

Apr 2 12:38:09 blinky kernel: klogd 1.3-0, log source = /proc/kmsg started.
Apr 2 12:38:10 blinky kernel: Cannot find map file.
Apr 2 12:38:10 blinky kernel: general protection: 0000
Apr 2 12:38:10 blinky kernel: CPU: 0
Apr 2 12:38:10 blinky kernel: EIP: 0010:[<00110331>]
Apr 2 12:38:10 blinky kernel: EFLAGS: 00010206
Apr 2 12:38:10 blinky kernel: eax: 01da0001 ebx: c3f000ef ecx: 001a829c edx: 6f000000
Apr 2 12:38:10 blinky kernel: esi: 00000004 edi: 001a8298 ebp: 01f7ef84 esp: 01f7ef78
Apr 2 12:38:10 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 12:38:10 blinky kernel: Process depmod (pid: 33, process nr: 9, stackpage=01f7e000)
Apr 2 12:38:10 blinky kernel: Stack: 01daf3e0 00000004 00000000 00000000 00121b52 001a829c 00000000 00120244
Apr 2 12:38:10 blinky kernel: 01daf3e0 01daf3e0 00000004 01f1a018 bfffc658 bfffc65c bfffc614 01daf3e0
Apr 2 12:38:10 blinky kernel: 0010a602 bfffc65c 00000004 00000020 bfffc658 bfffc65c bfffc614 ffffffda
Apr 2 12:38:10 blinky kernel: Call Trace: [<00121b52>] [<00120244>] [<0010a602>]
Apr 2 12:38:10 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
>>EIP: 110331 <wake_up+35/e4>
Trace: 121b52 <iput+8e/17c>
Trace: 120244 <sys_access+88/b0>
Trace: 10a602 <system_call+52/80>

Code: 110331 <wake_up+35/e4> movl (%edx),%eax
Code: 110333 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110336 <wake_up+3a/e4> je 11033f <wake_up+43/e4>
Code: 110338 <wake_up+3c/e4> movl (%edx),%eax
Code: 11033a <wake_up+3e/e4> cmpl $0x1,%eax
Code: 11033d <wake_up+41/e4> jne 11039e <wake_up+a2/e4>
Code: 11033f <wake_up+43/e4> pushf
Code: 110340 <wake_up+44/e4> popl %esi
Code: 110341 <wake_up+45/e4> cli
Code: 110342 <wake_up+46/e4> movl $0x90900000,(%edx)
=========================================================================
Apr 2 12:38:10 blinky kernel: general protection: 0000
Apr 2 12:38:10 blinky kernel: CPU: 0
Apr 2 12:38:10 blinky kernel: EIP: 0010:[<00110331>]
Apr 2 12:38:10 blinky kernel: EFLAGS: 00010202
Apr 2 12:38:10 blinky kernel: eax: 01da0001 ebx: 6ff000ef ecx: 001a829c edx: 6ff000e9
Apr 2 12:38:10 blinky kernel: esi: 00258a98 edi: 001a8298 ebp: 01dedf74 esp: 01dedf68
Apr 2 12:38:10 blinky kernel: ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Apr 2 12:38:10 blinky kernel: Process insmod (pid: 45, process nr: 11, stackpage=01ded000)
Apr 2 12:38:10 blinky kernel: Stack: 01dafd90 00258a98 01f8f2d8 00000000 00121b52 001a829c 01f8f318 00119f5f
Apr 2 12:38:10 blinky kernel: 01dafd90 00258a98 ffffffff fffffffc 0011518f 00258a98 01eba018 ffffffff
Apr 2 12:38:10 blinky kernel: fffffffc 00000000 001152de 00000000 0010a602 00000000 00000000 000000e0
Apr 2 12:38:10 blinky kernel: Call Trace: [<00121b52>] [<00119f5f>] [<0011518f>] [<001152de>] [<0010a602>]
Apr 2 12:38:10 blinky kernel: Code: 8b 02 83 f8 02 74 07 8b 02 83 f8 01 75 5f 9c 5e fa c7 02 00
=========================================================================
>>EIP: 110331 <wake_up+35/e4>
Trace: 121b52 <iput+8e/17c>
Trace: 119f5f <exit_mmap+8b/a4>
Trace: 11518f <do_exit+ab/1ec>
Trace: 1152de <sys_exit+e/10>
Trace: 10a602 <system_call+52/80>

Code: 110331 <wake_up+35/e4> movl (%edx),%eax
Code: 110333 <wake_up+37/e4> cmpl $0x2,%eax
Code: 110336 <wake_up+3a/e4> je 11033f <wake_up+43/e4>
Code: 110338 <wake_up+3c/e4> movl (%edx),%eax
Code: 11033a <wake_up+3e/e4> cmpl $0x1,%eax
Code: 11033d <wake_up+41/e4> jne 11039e <wake_up+a2/e4>
Code: 11033f <wake_up+43/e4> pushf
Code: 110340 <wake_up+44/e4> popl %esi
Code: 110341 <wake_up+45/e4> cli
Code: 110342 <wake_up+46/e4> movl $0x90900000,(%edx)
=========================================================================
Apr 2 12:38:10 blinky kernel: wait_queue is bad (eip = 00121b52)
Apr 2 12:38:10 blinky kernel: q = 001a829c
Apr 2 12:38:10 blinky kernel: *q = 00000000
Apr 2 12:38:10 blinky kernel: wait_queue is bad (eip = 00121b52)
Apr 2 12:38:10 blinky kernel: q = 001a829c
Apr 2 12:38:10 blinky kernel: *q = 00000000
Apr 2 12:39:35 blinky kernel: klogd 1.3-0, log source = /proc/kmsg started.
Apr 2 12:39:36 blinky kernel: Cannot find map file.

********************** REBOOTED *******************************************

Thanks,

-- 
Harvey J. Stein
Berger Financial Research
abel@netvision.net.il