Re: kernel BUG at mm/khugepaged.c:533 on 4.15.3

From: Laura Abbott
Date: Tue Mar 13 2018 - 21:21:31 EST


On 02/22/2018 09:33 AM, Laura Abbott wrote:
On 02/21/2018 01:14 AM, Kirill A. Shutemov wrote:
On Mon, Feb 19, 2018 at 10:51:01AM -0800, Laura Abbott wrote:
Hi,

Fedora got a bug report of a BUG with 4.15.3:
(https://bugzilla.redhat.com/show_bug.cgi?id=1546709)

Is it new to v4.15 kernel?
I don't see any recent change that could cause it.


The original reporter only saw it on 4.15 but another reporter
saw it on 4.14.13 (I only found this out after I sent the
e-mail). So I suspect the bug may have been latent but
hard to trigger.


page:fffffac1800a0000 count:513 mapcount:1 mapping:ffff95657ef359a1 index:0x7f95d3400 compound_mapcount: 0
flags: 0xffffe00048268(uptodate|lru|active|owner_priv_1|head|swapbacked)
raw: 000ffffe00048268 ffff95657ef359a1 00000007f95d3400 0000020100000000
raw: fffffac18edea9a0 fffffac18e7085a0 00000000000db400 ffff9567a3269800
page dumped because: VM_BUG_ON_PAGE(PageCompound(page))
page->mem_cgroup:ffff9567a3269800
------------[ cut here ]------------
kernel BUG at mm/khugepaged.c:533!
invalid opcode: 0000 [#1] SMP PTI
Modules linked in: vhost_net vhost tap fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_raw iptable_security ebtable_filter ebtables ip6table_filter ip6_tables sunrpc vfat fat rmi_smbus rmi_core arc4 intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp snd_hda_codec_hdmi iwlmvm kvm_intel iTCO_wdt mac80211 snd_hda_codec_realtek iTCO_vendor_support mei_wdt kvm snd_hda_codec_generic irqbypass intel_cstate snd_hda_intel intel_uncore iwlwifi uvcvideo intel_rapl_perf
snd_hda_codec videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_core snd_hda_core cfg80211 videodev snd_hwdep snd_seq snd_seq_device snd_pcm media mei_me snd_timer thinkpad_acpi wmi_bmof rtsx_pci_ms joydev tpm_tis memstick i2c_i801 mei tpm_tis_core snd soundcore intel_pch_thermal tpm shpchp rfkill dm_crypt hid_logitech_hidpp hid_logitech_dj mmc_block nouveau i915 rtsx_pci_sdmmc mmc_core mxm_wmi ttm e1000e i2c_algo_bit drm_kms_helper crct10dif_pclmul crc32_pclmul crc32c_intel ptp drm ghash_clmulni_intel serio_raw rtsx_pci pps_core wmi video
CPU: 2 PID: 66 Comm: khugepaged Not tainted 4.15.3-300.fc27.x86_64 #1
Hardware name: LENOVO 20FXS0BB14/20FXS0BB14, BIOS R07ET63W (2.03 ) 03/15/2016
RIP: 0010:khugepaged+0x1af6/0x2130
RSP: 0018:ffffacacc1b4bdc0 EFLAGS: 00010282
RAX: 0000000000000021 RBX: fffffac1800a0000 RCX: 0000000000000006
RDX: 0000000000000000 RSI: 0000000000000086 RDI: ffff9567c14968f0
RBP: fffffac18e3a5b40 R08: 00000000000004a8 R09: 0000000000000004
R10: ffffacacc1b4bd70 R11: ffffffffb995b1ed R12: 00007f95f7e00000
R13: ffff95661113eaf0 R14: ffff9567a9ea0000 R15: 8000000002800825
FS:Â 0000000000000000(0000) GS:ffff9567c1480000(0000) knlGS:0000000000000000
CS:Â 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000481046 CR3: 00000002ee20a005 CR4: 00000000003626e0
Call Trace:
? finish_wait+0x80/0x80
? collapse_shmem+0xdd0/0xdd0
kthread+0x113/0x130
? kthread_create_worker_on_cpu+0x70/0x70
ret_from_fork+0x35/0x40
Code: ff e9 e7 fd ff ff bb 07 00 00 00 49 89 c7 e9 20 fb ff ff 48 83 ea 01 e9 66 fc ff ff 48 c7 c6 d8 3f 0a b9 48 89 df e8 0a 82 fa ff <0f> 0b 31 c9 4c 89 fa 48 89 de 4c 89 f7 e8 58 f1 fd ff e9 2e fa
RIP: khugepaged+0x1af6/0x2130 RSP: ffffacacc1b4bdc0
---[ end trace a734c2f4d682e3bd ]---

Reporter said it happened several times. Config is attached.
Any ideas?

Looks like somebody managed to insert THP into the range in split it back
between khugepaged_scan_pmd() and __collapse_huge_page_isolate().

That's rather unlikely chain of events, but I don't see other option.

Could you check if this works:

diff --git a/mm/khugepaged.c b/mm/khugepaged.c
index b7e2268dfc9a..c15da1ea7e63 100644
--- a/mm/khugepaged.c
+++ b/mm/khugepaged.c
@@ -530,7 +530,12 @@ static int __collapse_huge_page_isolate(struct vm_area_struct *vma,
ÂÂÂÂÂÂÂÂÂÂÂÂÂ goto out;
ÂÂÂÂÂÂÂÂÂ }
-ÂÂÂÂÂÂÂ VM_BUG_ON_PAGE(PageCompound(page), page);
+ÂÂÂÂÂÂÂ /* TODO: teach khugepaged to collapse THP mapped with pte */
+ÂÂÂÂÂÂÂ if (PageCompound(page)) {
+ÂÂÂÂÂÂÂÂÂÂÂ result = SCAN_PAGE_COMPOUND;
+ÂÂÂÂÂÂÂÂÂÂÂ goto out;
+ÂÂÂÂÂÂÂ }
+
ÂÂÂÂÂÂÂÂÂ VM_BUG_ON_PAGE(!PageAnon(page), page);
ÂÂÂÂÂÂÂÂÂ /*


I asked the reporter(s) to test with this patch. I'll let you know
if I hear any results.

Thanks,
Laura

Reporter said he had been running with the patch for several
weeks and hadn't seen the issue again.

Thanks,
Laura