got an oops that keeps popping up on a server i have to admin. i'm pretty
damn sure i've seen this particular one a couple dozen times on other
servers as well. only seems to occur on servers doing relatively large
amounts of traffic, and running a large number of processes (4-500+
processes, 40-70 gigs/day).
i tracked the exact location down to csum_partial_copy_fromuser in
include/arch/i386/lib/checksum.c. that function starts at offset
001b6df4, but that should be self-evident since it's implemented in
assembly in the first place. apparently used only in the networking
code... it's hard to reproduce controllably. however, if i just let the
server sit around serving up content, i'll get more of these. sometimes
httpd ends up dead because of this, and i have to restart it. sometimes
the entire server chokes, and it has to be rebooted but that's fairly
rare.
this is the disassembly of 001b6e38
Code: 00000000 <_EIP>:
Code: 0 <_EIP+0>: 64 8b 5e 14 movl %fs:0x14(%esi),%ebx
Code: 4 <_EIP+4>: 11 d8 adcl %ebx,%eax
Code: 6 <_EIP+6>: 89 5f 14 movl %ebx,0x14(%edi)
Code: 9 <_EIP+9>: 64 8b 5e 18 movl %fs:0x18(%esi),%ebx
Code: 13 <_EIP+13>: 11 d8 adcl %ebx,%eax
Code: 15 <_EIP+15>: 89 5f 18 movl %ebx,0x18(%edi)
Code: 18 <_EIP+18>: 64 8b 00 movl %fs:(%eax),%eax
Code: 21 <_EIP+21>: 90 nop
Code: 22 <_EIP+22>: 90 nop
Code: 23 <_EIP+23>: 90 nop
Code:
Code: 00000000 <_EIP>:
Code: 0 <_EIP+0>: 64 8b 1e movl %fs:(%esi),%ebx
Code: 3 <_EIP+3>: 11 d8 adcl %ebx,%eax
Code: 5 <_EIP+5>: 89 1f movl %ebx,(%edi)
Code: 7 <_EIP+7>: 64 8b 5e 04 movl %fs:0x4(%esi),%ebx
Code: 11 <_EIP+11>: 11 d8 adcl %ebx,%eax
Code: 13 <_EIP+13>: 89 5f 04 movl %ebx,0x4(%edi)
Code: 16 <_EIP+16>: 64 8b 5e 08 movl %fs:0x8(%esi),%ebx
this is the disassembly of 001b6e63
Code: 00000000 <_EIP>:
Code: 0 <_EIP+0>: 64 8b 5e 14 movl %fs:0x14(%esi),%ebx
Code: 4 <_EIP+4>: 11 d8 adcl %ebx,%eax
Code: 6 <_EIP+6>: 89 5f 14 movl %ebx,0x14(%edi)
Code: 9 <_EIP+9>: 64 8b 5e 18 movl %fs:0x18(%esi),%ebx
Code: 13 <_EIP+13>: 11 d8 adcl %ebx,%eax
Code: 15 <_EIP+15>: 89 5f 18 movl %ebx,0x18(%edi)
Code: 18 <_EIP+18>: 64 8b 00 movl %fs:(%eax),%eax
Code: 21 <_EIP+21>: 90 nop
Code: 22 <_EIP+22>: 90 nop
Code: 23 <_EIP+23>: 90 nop
*pde = 0d639067
*pte = 00000000
Oops: 0000
CPU: 0
EIP: 0010:[<001b6e63>]
EFLAGS: 00010206
eax: 70d687bd ebx: 29db18dc ecx: 00000017 edx: 000005b4
esi: 4016dfec edi: 0c4b1320 ebp: 051d6ed4 esp: 051d6e7c
ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Process httpd (pid: 14509, process nr: 400, stackpage=051d6000)
Stack: 0c4b1668 000005b4 4016dd2c 0014c9e6 4016dd2c 0c4b1060 000005b4 00000000
0df10c0c ffffffea 00008000 0bb29ee0 0c4b104c 00000000 00000000 0c4b1668
000005b4 000005b4 4016dd2c 000022d4 00005d2c 001e1240 00000000 0014cae5
Call Trace: [<0014c9e6>] [<0014cae5>] [<00157949>] [<0013d1ba>] [<00129ecb>] [<001109cd>] [<0011002b>]
Code: 64 8b 5e 14 11 d8 89 5f 14 64 8b 5e 18 11 d8 89 5f 18 64 8b
Unable to handle kernel paging request at virtual address 4016b000
current->tss.cr3 = 070e5000, %cr3 = 070e5000
*pde = 09f3b067
*pte = 00000000
Oops: 0000
CPU: 0
EIP: 0010:[<001b6e38>]
EFLAGS: 00010206
eax: a9230147 ebx: 39fe8021 ecx: 00000005 edx: 00000218
esi: 4016afff edi: 01f9e5bc ebp: 0711bed4 esp: 0711be7c
ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Process httpd (pid: 16063, process nr: 473, stackpage=0711b000)
Stack: 01f9e6c4 00000218 4016ae9f 0014c9e6 4016ae9f 01f9e45c 00000218 00000000
09f2b414 ffffffea 00008000 0428f3fc 01f9e448 00000000 00000000 01f9e6c4
00000218 00000218 4016ae9f 00005161 00002e9f 001e1240 00000000 0014cae5
Call Trace: [<0014c9e6>] [<0014cae5>] [<00157949>] [<0013d1ba>] [<00129ecb>] [<001109cd>]
Code: 64 8b 1e 11 d8 89 1f 64 8b 5e 04 11 d8 89 5f 04 64 8b 5e 08
Unable to handle kernel paging request at virtual address 4016e000
current->tss.cr3 = 0ab75000, %cr3 = 0ab75000
*pde = 0fea0067
*pte = 00000000
Oops: 0000
CPU: 0
EIP: 0010:[<001b6e63>]
EFLAGS: 00010217
eax: 2cdac511 ebx: 7e5ff7e3 ecx: 00000017 edx: 000005b4
esi: 4016dfe9 edi: 0b75eb18 ebp: 06e08ed4 esp: 06e08e7c
ds: 0018 es: 0018 fs: 002b gs: 002b ss: 0018
Process httpd (pid: 29779, process nr: 362, stackpage=06e08000)
Stack: 0b75ee60 000005b4 4016dd29 0014c9e6 4016dd29 0b75e858 000005b4 00000000
07008414 ffffffea 00008000 0c515bb0 0b75e844 00000000 00000000 0b75ee60
000005b4 000005b4 4016dd29 000022d7 00005d29 001e1240 00000000 0014cae5
Call Trace: [<0014c9e6>] [<0014cae5>] [<00157949>] [<0013d1ba>] [<00129ecb>] [<001109cd>]
Code: 64 8b 5e 14 11 d8 89 5f 14 64 8b 5e 18 11 d8 89 5f 18 64 8b
Warning: possible SYN flood from 195.241.182.4 on 209.249.166.201:80. Sending cookies.
--- Tani Hosokawa River Styx Internet
- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.rutgers.edu Please read the FAQ at http://www.tux.org/lkml/