PROBLEM: kernel BUG at net/core/skbuff.c:1341!

From: Niccolo Rigacci
Date: Thu Sep 27 2007 - 06:06:03 EST

1. kernel BUG at net/core/skbuff.c:1341!

2. I got a kernel panic, the hardware is a good IBM 206m server
with 2 Gb ECC memory, Memtest86+ run several times without
problem. The message on the console is quite explicit, so is this
really a kernel bug?

The box is a web server with moderate network activity. The panic
occurred at 2007-09-26 13:15:54, during standard load
(here the MRTG graphs:

3. Kernel is 2.6.21, from Debian Testing linux-image package

4. Linux version 2.6.21-2-686 (Debian 2.6.21-6)
(waldi@xxxxxxxxxx) (gcc version 4.1.3 20070629 (prerelease)
(Debian 4.1.2-13)) #1 SMP Wed Jul 11 03:53:02 UTC 2007

5. No problem for several month with kernel 2.6.17

6. Here it is the transcription of the console screen. An image
of the actual screenshot is here:

Shorewall:net2all:DROP:IN=eth1 OUT= MAC=00:0a:cd:10:bc:24:00:50:7f:1f:45:d9:08:00
SRC= DST= LEN=88 TOS=0x00 PREC=0x00 TTL=60 ID=0 DF
PROTO=UDP SPT=5004 DPT=1194 LEN=68
Shorewall:net2all:DROP:IN=eth1 OUT= MAC=00:0a:cd:10:bc:24:00:50:7f:1f:45:d9:08:00
SRC= DST= LEN=88 TOS=0x00 PREC=0x00 TTL=60 ID=0 DF
PROTO=UDP SPT=5004 DPT=1194 LEN=68
audit(1190732795.310:2): dev=eth1 prom=256 old_prom=0 auid=4294967295
audit(1190732797.310:3): dev=eth1 prom=0 old_prom=256 auid=4294967295
------------[ cut here ]------------
kernel BUG at net/core/skbuff.c:1341!
invalid opcode: 0000 [#1]
Modules linked in: usblp sha256 cbc blkcipher nfsd exportfs lockd nfs_acl sunrpc
ppdev lp parport tun sch_sfq act_police cls_u32 sch_ingress sch_htb ip6table_filter
iptable_raw xt_comment xt_policy xt_multiport ipt_ULOG ipt_TTL ipt_ttl ipt_TOS
ipt_tos ipt_SAME ipt_REJECT ipt_REDIRECT ipt_recent ipt_owner ipt_NETMAP ipt_MASQUERADE
ipt_LOG ipt_iprange ipt_ECN ipt_ecn ipt_CLUSTERIP ipt_ah ipt_addrtype
nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc
nf_nat_h323 nf_nat_ftp nf_nat_amanda ts_kmp nf_conntrack_amanda nf_conntrack_tftp
nf_conntrack_sip nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre
nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_irc nf_conntrack_h323
nf_conntrack_ftp xt_tcpmss xt_pkttype xt_physdev xt_NFQUEUE xt_NFLOG xt_MARK
xt_mark xt_mac xt_limit xt_length xt_helper xt_hashlimit ip6_tables xt_dccp
xt_conntrack xt_CONNMARK xt_connmark xt_CLASSIFY xt_tcpudp xt_state iptable_nat
nf_nat nf_conntrack_ipv4 nf_conntrack iptable_mangle nfnetlink iptable_filter
ip_tables x_tables ipv6 dm_snapshot dm_mirror twofish twofish_common dm_crypt
dm_mod tcp_diag inet_diag ipmi_si ipmi_devintf ipmi_msghandler evdev serio_raw
i2c_i801 i2c_core iTCO_wdt rtc pcspkr ext3 jbd mbcache raid1 md_mod ide_generic
sd_mod ide_cd cdrom ata_piix ata_generic libata scsi_mod piix ehci_hcd generic
uhci_hcd 8139too mii ide_core tg3 usbcore thermal processor fan
CPU: 1
EIP: 0060:[<c023df85>] Not tainted VLI
EFLAGS: 00010206 (2.6.21-2-686 #1)
EIP is at skb_copy_and_csum_bits+0x2b6/0x300
eax: 00000002 ebx: fffad000 ecx: c0004eb4 edx: cfeb1120
esi: 00000000 edi: 0000000c ebp: 000005c0 esp: c2103e30
ds: 007b es: 007b fs: 00d8 gs: 0000 ss: 0068
Process swapper (pid: 0, ti=c2102000 task=dfa07540 task.ti=c2102000)
Stack: fffad000 f78c26b7 00000509 00000000 00000000 00000000 00000020 f78c2bc0
d4447eb0 000005c0 00000002 0000059e 000005c0 00000008 00000509 00000022
00000000 f78c2622 d4447eb0 c023ecdd 000005aa 944099dd f78c2600 d4447eb0
Call Trace:
[<c023ecdd>] skb_copy_and_csum_dev+0x75/0xac
[<f8852d05>] rtl8139_start_xmit+0x5f/0x109 [8139too]
[<c024291e>] dev_hard_start_xmit+0x1be/0x21d
[<c02514b2>] __qdisc_run+oxe1/0x196
[<c0243abc>] net_tx_action+0xcf/0xf4
[<c0126102>] __do_softirq+0x66/0xcc
[<c01261ab>] do_softirq+0x43/0x51
[<c012640f>] irq_exit+0x38/0x6b
[<c0114bc2>] smp_apic_timer_interrupt+0x71/0x7d
[<c010481c>] apic_timer_interrupt+0x28/0x30
[<c0102241>] mwait_idle_with_hints+0x3b/0x3f
[<c01023b5>] cpu_idle+0xb5/0xd6
Code: c0 0f b6 c0 01 c2 29 df 89 54 24 54 74 5b 01 5c 24 1c 01 dd 01 5c 24 2c 8b
36 8b 44 24 34 89 44 24 24 e9 46 ff ff ff 85 ff 74 3e <0f> 0b eb fe 8b 54 24 54
8b 44 24 1c c7 44 24 14 00 00 00 00 c7
EIP: [<c023df85>] skb_copy_and_csum_bits+0x2b6/0x300 SS:ESP 0068:c2103e30
Kernel panic - not syncing: Fatal exception in interrupt

8. Environment: see the attached gzipped files.

Thanks, and let me know if more info or testing is needed.

Niccolo Rigacci
Firenze - Italy

Attachment: lspci_vvv.gz
Description: Binary data

Attachment: proc_cpuinfo.gz
Description: Binary data

Attachment: proc_iomem.gz
Description: Binary data

Attachment: proc_ioports.gz
Description: Binary data

Attachment: proc_modules.gz
Description: Binary data

Attachment: proc_scsi_scsi.gz
Description: Binary data

Attachment: ver_linux.gz
Description: Binary data