Re: DMA error when sg->offset value is greater than PAGE_SIZE in Intel IOMMU

From: Harsh Jain
Date: Tue Sep 26 2017 - 08:22:02 EST


Find attached new set of log. After repeated tries it panics.


On 26-09-2017 09:16, Harsh Jain wrote:
> On 26-09-2017 00:16, Casey Leedom wrote:
>> | From: Raj, Ashok <ashok.raj@xxxxxxxxx>
>> | Sent: Monday, September 25, 2017 8:54 AM
>> |
>> | Not sure how the page->offset would end up being greater than page-size?
> Refer below
>> |
>> | If you have additional traces, please send them by.
>> |
>> | Is this a new driver? wondering how we didn't run into this?
>>
>> According to Herbert Xu and one of our own engineers, it's actually legal
>> for Scatter/Gather Lists to have this. This isn't my area of expertise
>> though so I'm just passing that on.
>>
>> I've asked our team to produce a detailed trace of the exact
>> Scatter/Gather Lists they're seeing and what ends up coming out of the DMA
>> Mappings, etc. They're in India, so I expect that they'll have this for you
>> by tomorrow morning.
> Below mentioned log was already there in 1st mail. Copied here for easy reference. Let me know if you need
> additional traces.
>
> 1) IN esp_output() "__skb_to_sgvec()" convert skb frags to scatter gather list.
> At that moment sg->offset was 4094.
> 2) From esp_output control reaches to "crypto_authenc_encrypt()". Here in
> "scatterwalk_ffwd()" sg->offset become 4110.
> 3) Same sg list received by chelsio crypto driver(chcr). When chcr try to do
> DMA mapping it starts giving DMA errors.
>
> Following error observed. first two prints are added for debugging in chcr.
> Kernel version used to reproduce is 4.9.28 on x86_64 with Page size 4K.
>
> Sep 15 12:40:52 heptagon kernel: process_cipher req src ffff8803cb41f0a8
> Sep 15 12:40:52 heptagon kernel: ========= issue hit offset:4110 =======
> dma_addr f24b000e ==> DMA mapped address returned by dma_map_sg()
>
> Sep 15 12:40:52 heptagon kernel: DMAR: DRHD: handling fault status reg 2
> Sep 15 12:40:52 heptagon kernel: DMAR: [DMA Write] Request device [02:00.4]
> fault addr f24b0000 [fault reason 05] PTE Write access is not set
>
>> Casey

[root@heptagon linux_t4_build]# modprobe xts
[root@heptagon linux_t4_build]# modprobe authenc
[root@heptagon linux_t4_build]# insmod chcr/chcr.ko
[root@heptagon linux_t4_build]# ipsec restart
Stopping strongSwan IPsec failed: starter is not running
Starting strongSwan 5.5.1 IPsec [starter]...
[root@heptagon linux_t4_build]# ipsec up hep-chum
initiating IKE_SA hep-chum[1] to 1.0.0.95
generating IKE_SA_INIT request 0 [ SA KE No N(NATD_S_IP) N(NATD_D_IP) N(FRAG_SUP) N(HASH_ALG) N(REDIR_SUP) ]
sending packet: from 1.0.0.50[500] to 1.0.0.95[500] (804 bytes)
received packet: from 1.0.0.95[500] to 1.0.0.50[500] (617 bytes)
parsed IKE_SA_INIT response 0 [ SA KE No N(NATD_S_IP) N(NATD_D_IP) CERTREQ N(FRAG_SUP) N(HASH_ALG) N(MULT_AUTH) ]
received cert request for "C=CH, O=Strongswan, CN=Strongswan CA"
sending cert request for "C=CH, O=Strongswan, CN=Strongswan CA"
authentication of 'C=CH, O=Strongswan, CN=host1' (myself) with RSA_EMSA_PKCS1_SHA2_256 successful
sending end entity cert "C=CH, O=Strongswan, CN=host1"
establishing CHILD_SA hep-chum
generating IKE_AUTH request 1 [ IDi CERT N(INIT_CONTACT) CERTREQ IDr AUTH SA TSi TSr N(MOBIKE_SUP) N(ADD_4_ADDR) N(ADD_4_ADDR) N(ADD_4_ADDR) N(MULT_AUTH) N(EAP_ONLY) ]
splitting IKE message with length of 1440 bytes into 2 fragments
generating IKE_AUTH request 1 [ EF(1/2) ]
generating IKE_AUTH request 1 [ EF(2/2) ]
sending packet: from 1.0.0.50[4500] to 1.0.0.95[4500] (1236 bytes)
sending packet: from 1.0.0.50[4500] to 1.0.0.95[4500] (276 bytes)
received packet: from 1.0.0.95[4500] to 1.0.0.50[4500] (1236 bytes)
parsed IKE_AUTH response 1 [ EF(1/2) ]
received fragment #1 of 2, waiting for complete IKE message
received packet: from 1.0.0.95[4500] to 1.0.0.50[4500] (164 bytes)
parsed IKE_AUTH response 1 [ EF(2/2) ]
received fragment #2 of 2, reassembling fragmented IKE message
parsed IKE_AUTH response 1 [ IDr CERT AUTH SA TSi TSr N(AUTH_LFT) N(MOBIKE_SUP) N(ADD_4_ADDR) N(ADD_4_ADDR) ]
received end entity cert "C=CH, O=Strongswan, CN=host2"
using certificate "C=CH, O=Strongswan, CN=host2"
using trusted ca certificate "C=CH, O=Strongswan, CN=Strongswan CA"
checking certificate status of "C=CH, O=Strongswan, CN=host2"
certificate status is not available
reached self-signed root ca with a path length of 0
authentication of 'C=CH, O=Strongswan, CN=host2' with RSA_EMSA_PKCS1_SHA2_256 successful
IKE_SA hep-chum[1] established between 1.0.0.50[C=CH, O=Strongswan, CN=host1]...1.0.0.95[C=CH, O=Strongswan, CN=host2]
scheduling reauthentication in 3246s
maximum IKE_SA lifetime 3426s
CHILD_SA hep-chum{1} established with SPIs cfd0aa80_i c7c9816e_o and TS 2.0.0.0/24 === 1.0.0.0/24
connection 'hep-chum' established successfully
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]# dmesg -c
[ 1700.923113] alg: No test for authenc(hmac(sha224),cbc(aes)) (authenc-hmac-sha224-cbc-aes-chcr)
[ 1700.923213] alg: No test for authenc(hmac(sha384),cbc(aes)) (authenc-hmac-sha384-cbc-aes-chcr)
[ 1700.928695] alg: No test for authenc(digest_null,cbc(aes)) (authenc-digest_null-cbc-aes-chcr)
[ 1709.238896] alg: No test for authenc(digest_null,rfc3686(ctr(aes))) (authenc(digest_null-generic,rfc3686-ctr-aes-chcr))
[ 1709.239075] alg: No test for seqiv(authenc(digest_null,rfc3686(ctr(aes)))) (seqiv(authenc(digest_null-generic,rfc3686-ctr-aes-chcr)))
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]# dmesg
[root@heptagon linux_t4_build]# dmesg
[ 1750.062765] offset 4110 len 56 dma addr f290d00e dma len 56
[ 1750.062844] DMAR: DRHD: handling fault status reg 2
[ 1750.068196] DMAR: [DMA Write] Request device [02:00.4] fault addr f290d000 [fault reason 05] PTE Write access is not set
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]# dmesg
[ 1750.062765] offset 4110 len 56 dma addr f290d00e dma len 56
[ 1750.062844] DMAR: DRHD: handling fault status reg 2
[ 1750.068196] DMAR: [DMA Write] Request device [02:00.4] fault addr f290d000 [fault reason 05] PTE Write access is not set
[ 1766.961186] offset 4110 len 96 dma addr f297e00e dma len 96
[ 1766.961281] DMAR: DRHD: handling fault status reg 102
[ 1766.967076] DMAR: [DMA Write] Request device [02:00.4] fault addr f297e000 [fault reason 05] PTE Write access is not set
[root@heptagon linux_t4_build]# dmesg
[ 1750.062765] offset 4110 len 56 dma addr f290d00e dma len 56
[ 1750.062844] DMAR: DRHD: handling fault status reg 2
[ 1750.068196] DMAR: [DMA Write] Request device [02:00.4] fault addr f290d000 [fault reason 05] PTE Write access is not set
[ 1766.961186] offset 4110 len 96 dma addr f297e00e dma len 96
[ 1766.961281] DMAR: DRHD: handling fault status reg 102
[ 1766.967076] DMAR: [DMA Write] Request device [02:00.4] fault addr f297e000 [fault reason 05] PTE Write access is not set
[ 1782.763833] offset 4110 len 176 dma addr f28d000e dma len 176
[ 1782.763921] DMAR: DRHD: handling fault status reg 202
[ 1782.769533] DMAR: [DMA Write] Request device [02:00.4] fault addr f28d0000 [fault reason 05] PTE Write access is not set
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]#
[root@heptagon linux_t4_build]# dmesg
[ 1750.062765] offset 4110 len 56 dma addr f290d00e dma len 56
[ 1750.062844] DMAR: DRHD: handling fault status reg 2
[ 1750.068196] DMAR: [DMA Write] Request device [02:00.4] fault addr f290d000 [fault reason 05] PTE Write access is not set
[ 1766.961186] offset 4110 len 96 dma addr f297e00e dma len 96
[ 1766.961281] DMAR: DRHD: handling fault status reg 102
[ 1766.967076] DMAR: [DMA Write] Request device [02:00.4] fault addr f297e000 [fault reason 05] PTE Write access is not set
[ 1782.763833] offset 4110 len 176 dma addr f28d000e dma len 176
[ 1782.763921] DMAR: DRHD: handling fault status reg 202
[ 1782.769533] DMAR: [DMA Write] Request device [02:00.4] fault addr f28d0000 [fault reason 05] PTE Write access is not set
[ 1798.654209] DMAR: ERROR: DMA PTE for vPFN 0xf290d already set (to 40c829003 not 3d829d003)
[ 1798.663282] ------------[ cut here ]------------
[ 1798.663289] WARNING: CPU: 1 PID: 0 at drivers/iommu/intel-iommu.c:2294 __domain_mapping+0x37c/0x390
[ 1798.663290] Modules linked in: ccm ghash_generic gcm sha512_generic chcr(O) xts gf128mul drbg ansi_cprng authenc seqiv xfrm4_mode_tunnel ctr xfrm4_tunnel tunnel4 ipcomp xfrm_ipcomp esp4 ah4 af_key rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_core libcxgb cxgb4(O) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod intel_powerclamp coretemp kvm_intel kvm irqbypass iTCO_wdt pcspkr gpio_ich iTCO_vendor_support
[ 1798.663329] ppdev i2c_i801 sg i2c_smbus lpc_ich ioatdma i7core_edac parport_pc edac_core parport shpchp tpm_infineon dca acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 jbd2 mbcache sd_mod ata_generic pata_acpi crc32c_intel mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm serio_raw drm libata i2c_core e1000e ptp pps_core floppy fjes mptsas scsi_transport_sas mptscsih mptbase
[ 1798.663357] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G IO 4.9.50 #7
[ 1798.663358] Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0b 11/07/2013
[ 1798.663359] ffff88040f243600 ffffffff813573ac 0000000000000000 0000000000000000
[ 1798.663362] ffff88040f243640 ffffffff8108e631 000008f60f243620 00000003d829d003
[ 1798.663364] ffff88040b7eb868 0000000000000001 0000000000000001 00000000000f290d
[ 1798.663366] Call Trace:
[ 1798.663367] <IRQ>
[ 1798.663372] [<ffffffff813573ac>] dump_stack+0x63/0x87
[ 1798.663377] [<ffffffff8108e631>] __warn+0xd1/0xf0
[ 1798.663379] [<ffffffff8108e76d>] warn_slowpath_null+0x1d/0x20
[ 1798.663381] [<ffffffff8149e34c>] __domain_mapping+0x37c/0x390
[ 1798.663383] [<ffffffff814a02bf>] intel_map_sg+0x10f/0x220
[ 1798.663387] [<ffffffffa08920d2>] process_cipher+0x4c2/0x650 [chcr]
[ 1798.663390] [<ffffffff815d2d7d>] ? skb_release_data+0xcd/0xf0
[ 1798.663393] [<ffffffffa0892398>] chcr_aes_encrypt+0x68/0xd0 [chcr]
[ 1798.663396] [<ffffffff8130f58e>] skcipher_encrypt_ablkcipher+0x5e/0x60
[ 1798.663398] [<ffffffffa0870300>] crypto_authenc_encrypt+0x170/0x1a0 [authenc]
[ 1798.663401] [<ffffffffa069e180>] ? esp4_err+0x120/0x120 [esp4]
[ 1798.663403] [<ffffffffa086b375>] seqiv_aead_encrypt+0x185/0x230 [seqiv]
[ 1798.663405] [<ffffffffa069eb08>] esp_output+0x388/0x500 [esp4]
[ 1798.663408] [<ffffffffa00dace5>] ? ipt_do_table+0x2e5/0x3e0 [ip_tables]
[ 1798.663412] [<ffffffff81690cfc>] xfrm_output_resume+0x16c/0x3f0
[ 1798.663415] [<ffffffffa05851dc>] ? ipv4_confirm+0x7c/0xf0 [nf_conntrack_ipv4]
[ 1798.663417] [<ffffffff81690ff6>] xfrm_output+0x56/0x100
[ 1798.663420] [<ffffffff816221db>] ? nf_hook_slow+0x6b/0xc0
[ 1798.663422] [<ffffffff81683b2b>] xfrm4_output_finish+0x2b/0x30
[ 1798.663424] [<ffffffff816839e4>] __xfrm4_output+0x34/0x50
[ 1798.663425] [<ffffffff81683b77>] xfrm4_output+0x47/0xc0
[ 1798.663427] [<ffffffff816839b0>] ? xfrm4_udp_encap_rcv+0x1a0/0x1a0
[ 1798.663429] [<ffffffff8162db40>] ip_forward_finish+0x40/0x70
[ 1798.663431] [<ffffffff8162df10>] ip_forward+0x3a0/0x460
[ 1798.663432] [<ffffffff8162db00>] ? ip_frag_mem+0x40/0x40
[ 1798.663434] [<ffffffff8162bcb5>] ip_rcv_finish+0xc5/0x340
[ 1798.663435] [<ffffffff8162c5a5>] ip_rcv+0x295/0x400
[ 1798.663437] [<ffffffff8162bbf0>] ? inet_del_offload+0x40/0x40
[ 1798.663440] [<ffffffff815e7b05>] __netif_receive_skb_core+0x395/0xa10
[ 1798.663441] [<ffffffff815e7b00>] ? __netif_receive_skb_core+0x390/0xa10
[ 1798.663445] [<ffffffff81658223>] ? tcp4_gro_receive+0x133/0x1a0
[ 1798.663446] [<ffffffff815e8198>] __netif_receive_skb+0x18/0x60
[ 1798.663448] [<ffffffff815e8220>] netif_receive_skb_internal+0x40/0xb0
[ 1798.663450] [<ffffffff815e9169>] napi_gro_frags+0x189/0x210
[ 1798.663464] [<ffffffffa05eb6b8>] t4_ethrx_handler+0x458/0x640 [cxgb4]
[ 1798.663474] [<ffffffffa05e6e3d>] process_responses+0x31d/0x560 [cxgb4]
[ 1798.663477] [<ffffffff810ce3de>] ? load_balance+0x19e/0x9c0
[ 1798.663479] [<ffffffff81037d29>] ? sched_clock+0x9/0x10
[ 1798.663482] [<ffffffff811080bb>] ? ktime_get+0x3b/0xb0
[ 1798.663484] [<ffffffff8105400d>] ? lapic_next_event+0x1d/0x30
[ 1798.663494] [<ffffffffa05e70f0>] napi_rx_handler+0x70/0x170 [cxgb4]
[ 1798.663496] [<ffffffff815e891d>] net_rx_action+0x16d/0x390
[ 1798.663499] [<ffffffff81702fc9>] __do_softirq+0xc9/0x26d
[ 1798.663502] [<ffffffff81094b39>] irq_exit+0xd9/0xf0
[ 1798.663503] [<ffffffff81702d56>] do_IRQ+0x56/0xd0
[ 1798.663505] [<ffffffff81700c8c>] common_interrupt+0x8c/0x8c
[ 1798.663505] <EOI>
[ 1798.663508] [<ffffffff8159bdb1>] ? cpuidle_enter_state+0xe1/0x260
[ 1798.663510] [<ffffffff8159bf67>] cpuidle_enter+0x17/0x20
[ 1798.663513] [<ffffffff810d59c3>] call_cpuidle+0x23/0x40
[ 1798.663514] [<ffffffff810d5c39>] cpu_startup_entry+0x159/0x250
[ 1798.663516] [<ffffffff81052a44>] start_secondary+0x154/0x190
[ 1798.663518] ---[ end trace b95550498acc27a5 ]---
[ 1801.358354] DMAR: ERROR: DMA PTE for vPFN 0xf290d already set (to 40c82d003 not 3d829b003)
[ 1801.367432] ------------[ cut here ]------------
[ 1801.367438] WARNING: CPU: 1 PID: 0 at drivers/iommu/intel-iommu.c:2294 __domain_mapping+0x37c/0x390
[ 1801.367439] Modules linked in: ccm ghash_generic gcm sha512_generic chcr(O) xts gf128mul drbg ansi_cprng authenc seqiv xfrm4_mode_tunnel ctr xfrm4_tunnel tunnel4 ipcomp xfrm_ipcomp esp4 ah4 af_key rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_core libcxgb cxgb4(O) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod intel_powerclamp coretemp kvm_intel kvm irqbypass iTCO_wdt pcspkr gpio_ich iTCO_vendor_support
[ 1801.367479] ppdev i2c_i801 sg i2c_smbus lpc_ich ioatdma i7core_edac parport_pc edac_core parport shpchp tpm_infineon dca acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 jbd2 mbcache sd_mod ata_generic pata_acpi crc32c_intel mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm serio_raw drm libata i2c_core e1000e ptp pps_core floppy fjes mptsas scsi_transport_sas mptscsih mptbase
[ 1801.367507] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W IO 4.9.50 #7
[ 1801.367508] Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0b 11/07/2013
[ 1801.367509] ffff88040f2436f8 ffffffff813573ac 0000000000000000 0000000000000000
[ 1801.367511] ffff88040f243738 ffffffff8108e631 000008f60f243718 00000003d829b003
[ 1801.367513] ffff88040b7eb868 0000000000000001 0000000000000001 00000000000f290d
[ 1801.367516] Call Trace:
[ 1801.367517] <IRQ>
[ 1801.367522] [<ffffffff813573ac>] dump_stack+0x63/0x87
[ 1801.367527] [<ffffffff8108e631>] __warn+0xd1/0xf0
[ 1801.367529] [<ffffffff8108e76d>] warn_slowpath_null+0x1d/0x20
[ 1801.367530] [<ffffffff8149e34c>] __domain_mapping+0x37c/0x390
[ 1801.367532] [<ffffffff814a02bf>] intel_map_sg+0x10f/0x220
[ 1801.367537] [<ffffffffa08920d2>] process_cipher+0x4c2/0x650 [chcr]
[ 1801.367539] [<ffffffffa08922cb>] chcr_aes_decrypt+0x6b/0xd0 [chcr]
[ 1801.367543] [<ffffffff8130f5ee>] skcipher_decrypt_ablkcipher+0x5e/0x60
[ 1801.367545] [<ffffffffa087063b>] crypto_authenc_decrypt_tail.isra.3+0xfb/0x110 [authenc]
[ 1801.367547] [<ffffffffa08706d7>] crypto_authenc_decrypt+0x87/0x90 [authenc]
[ 1801.367549] [<ffffffffa086b195>] seqiv_aead_decrypt+0xa5/0xb0 [seqiv]
[ 1801.367552] [<ffffffffa069f08c>] esp_input+0x1dc/0x290 [esp4]
[ 1801.367555] [<ffffffff816909fa>] xfrm_input+0x63a/0x6d0
[ 1801.367558] [<ffffffff8168369b>] xfrm4_rcv+0x3b/0x40
[ 1801.367559] [<ffffffff81684233>] xfrm4_esp_rcv+0x33/0x60
[ 1801.367562] [<ffffffff8162bfa0>] ip_local_deliver_finish+0x70/0x1a0
[ 1801.367563] [<ffffffff8162c28f>] ip_local_deliver+0x6f/0xf0
[ 1801.367565] [<ffffffff8162bf30>] ? ip_rcv_finish+0x340/0x340
[ 1801.367567] [<ffffffff8162bcb5>] ip_rcv_finish+0xc5/0x340
[ 1801.367568] [<ffffffff8162c5a5>] ip_rcv+0x295/0x400
[ 1801.367569] [<ffffffff8162bbf0>] ? inet_del_offload+0x40/0x40
[ 1801.367572] [<ffffffff815e7b05>] __netif_receive_skb_core+0x395/0xa10
[ 1801.367575] [<ffffffffa0892525>] ? chcr_handle_resp+0xe5/0x850 [chcr]
[ 1801.367578] [<ffffffff81658223>] ? tcp4_gro_receive+0x133/0x1a0
[ 1801.367581] [<ffffffff815d82ca>] ? __build_skb+0x2a/0x180
[ 1801.367583] [<ffffffff815e8198>] __netif_receive_skb+0x18/0x60
[ 1801.367584] [<ffffffff815e8220>] netif_receive_skb_internal+0x40/0xb0
[ 1801.367586] [<ffffffff815e82ac>] netif_receive_skb+0x1c/0x70
[ 1801.367602] [<ffffffffa05eb446>] t4_ethrx_handler+0x1e6/0x640 [cxgb4]
[ 1801.367612] [<ffffffffa05e6e3d>] process_responses+0x31d/0x560 [cxgb4]
[ 1801.367614] [<ffffffff810ce3de>] ? load_balance+0x19e/0x9c0
[ 1801.367616] [<ffffffff811080bb>] ? ktime_get+0x3b/0xb0
[ 1801.367619] [<ffffffff8105400d>] ? lapic_next_event+0x1d/0x30
[ 1801.367620] [<ffffffff811080bb>] ? ktime_get+0x3b/0xb0
[ 1801.367622] [<ffffffff8105400d>] ? lapic_next_event+0x1d/0x30
[ 1801.367624] [<ffffffff8110e916>] ? clockevents_program_event+0x76/0x110
[ 1801.367634] [<ffffffffa05e70f0>] napi_rx_handler+0x70/0x170 [cxgb4]
[ 1801.367635] [<ffffffff815e891d>] net_rx_action+0x16d/0x390
[ 1801.367639] [<ffffffff81702fc9>] __do_softirq+0xc9/0x26d
[ 1801.367641] [<ffffffff81094b39>] irq_exit+0xd9/0xf0
[ 1801.367643] [<ffffffff81702d56>] do_IRQ+0x56/0xd0
[ 1801.367645] [<ffffffff81700c8c>] common_interrupt+0x8c/0x8c
[ 1801.367645] <EOI>
[ 1801.367648] [<ffffffff8159bdb1>] ? cpuidle_enter_state+0xe1/0x260
[ 1801.367650] [<ffffffff8159bf67>] cpuidle_enter+0x17/0x20
[ 1801.367652] [<ffffffff810d59c3>] call_cpuidle+0x23/0x40
[ 1801.367654] [<ffffffff810d5c39>] cpu_startup_entry+0x159/0x250
[ 1801.367656] [<ffffffff81052a44>] start_secondary+0x154/0x190
[ 1801.367658] ---[ end trace b95550498acc27a6 ]---
[ 1804.079625] offset 4110 len 92 dma addr f264900e dma len 92
[ 1804.079642] DMAR: DRHD: handling fault status reg 302
[ 1804.085195] DMAR: [DMA Write] Request device [02:00.4] fault addr f2649000 [fault reason 05] PTE Write access is not set
[root@heptagon linux_t4_build]#