Re: [LKP] [lkp] [xfs] 68a9f5e700: aim7.jobs-per-min -13.6% regression
From: Huang\, Ying
Date: Wed Aug 10 2016 - 20:11:25 EST
"Huang, Ying" <ying.huang@xxxxxxxxx> writes:
> Hi, Linus,
>
> Linus Torvalds <torvalds@xxxxxxxxxxxxxxxxxxxx> writes:
>
>> On Wed, Aug 10, 2016 at 4:08 PM, Dave Chinner <david@xxxxxxxxxxxxx> wrote:
>>>
>>> That, to me, says there's a change in lock contention behaviour in
>>> the workload (which we know aim7 is good at exposing). i.e. the
>>> iomap change shifted contention from a sleeping lock to a spinning
>>> lock, or maybe we now trigger optimistic spinning behaviour on a
>>> lock we previously didn't spin on at all.
>>
>> Hmm. Possibly. I reacted to the lower cpu load number, but yeah, I
>> could easily imagine some locking primitive difference too.
>>
>>> We really need instruction level perf profiles to understand
>>> this - I don't have a machine with this many cpu cores available
>>> locally, so I'm not sure I'm going to be able to make any progress
>>> tracking it down in the short term. Maybe the lkp team has more
>>> in-depth cpu usage profiles they can share?
>>
>> Yeah, I've occasionally wanted to see some kind of "top-25 kernel
>> functions in the profile" thing. That said, when the load isn't all
>> that familiar, the profiles usually are not all that easy to make
>> sense of either. But comparing the before and after state might give
>> us clues.
>
> I have started perf-profile data collection, will send out the
> comparison result soon.
Here is the comparison result with perf-profile data.
=========================================================================================
compiler/cpufreq_governor/debug-setup/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase:
gcc-6/performance/profile/1BRD_48G/xfs/x86_64-rhel/3000/debian-x86_64-2015-02-07.cgz/ivb44/disk_wrt/aim7
commit:
f0c6bcba74ac51cb77aadb33ad35cb2dc1ad1506
68a9f5e7007c1afa2cf6830b690a90d0187c0684
f0c6bcba74ac51cb 68a9f5e7007c1afa2cf6830b69
---------------- --------------------------
%stddev %change %stddev
\ | \
484435 Â 0% -13.3% 420004 Â 0% aim7.jobs-per-min
37.37 Â 0% +15.3% 43.09 Â 0% aim7.time.elapsed_time
37.37 Â 0% +15.3% 43.09 Â 0% aim7.time.elapsed_time.max
6491 Â 3% +30.8% 8491 Â 0% aim7.time.involuntary_context_switches
376.89 Â 0% +28.4% 484.11 Â 0% aim7.time.system_time
430512 Â 0% -20.1% 343838 Â 0% aim7.time.voluntary_context_switches
26816 Â 8% +10.2% 29542 Â 1% interrupts.CAL:Function_call_interrupts
125122 Â 10% -10.7% 111758 Â 12% softirqs.SCHED
24772 Â 0% -28.6% 17675 Â 0% vmstat.system.cs
53477 Â 2% +5.6% 56453 Â 0% vmstat.system.in
15627 Â 0% +27.7% 19956 Â 1% meminfo.Active(file)
16103 Â 3% +14.3% 18405 Â 8% meminfo.AnonHugePages
132898 Â 9% +15.4% 153380 Â 1% meminfo.DirectMap4k
13777 Â 5% +43.1% 19709 Â 0% meminfo.Shmem
3906 Â 0% +28.8% 5032 Â 2% proc-vmstat.nr_active_file
919.33 Â 5% +14.8% 1055 Â 8% proc-vmstat.nr_dirty
3444 Â 5% +41.8% 4884 Â 0% proc-vmstat.nr_shmem
4092 Â 14% +61.2% 6595 Â 1% proc-vmstat.pgactivate
1975 Â 15% +63.2% 3224 Â 17% slabinfo.scsi_data_buffer.active_objs
1975 Â 15% +63.2% 3224 Â 17% slabinfo.scsi_data_buffer.num_objs
464.33 Â 15% +63.3% 758.33 Â 17% slabinfo.xfs_efd_item.active_objs
464.33 Â 15% +63.3% 758.33 Â 17% slabinfo.xfs_efd_item.num_objs
1724300 Â 27% -40.5% 1025538 Â 1% sched_debug.cfs_rq:/.load.max
96.36 Â 3% +18.6% 114.32 Â 15% sched_debug.cfs_rq:/.util_avg.stddev
1724300 Â 27% -40.5% 1025538 Â 1% sched_debug.cpu.load.max
2887 Â 30% -28.2% 2073 Â 48% sched_debug.cpu.nr_load_updates.min
7.66 Â 20% -24.9% 5.75 Â 15% sched_debug.cpu.nr_uninterruptible.stddev
37.37 Â 0% +15.3% 43.09 Â 0% time.elapsed_time
37.37 Â 0% +15.3% 43.09 Â 0% time.elapsed_time.max
6491 Â 3% +30.8% 8491 Â 0% time.involuntary_context_switches
1037 Â 0% +10.8% 1148 Â 0% time.percent_of_cpu_this_job_got
376.89 Â 0% +28.4% 484.11 Â 0% time.system_time
430512 Â 0% -20.1% 343838 Â 0% time.voluntary_context_switches
24.18 Â 0% +9.0% 26.35 Â 0% turbostat.%Busy
686.00 Â 0% +9.5% 751.00 Â 0% turbostat.Avg_MHz
0.28 Â 0% -25.0% 0.21 Â 0% turbostat.CPU%c3
93.33 Â 1% +3.0% 96.15 Â 0% turbostat.CorWatt
124.61 Â 0% +2.1% 127.17 Â 0% turbostat.PkgWatt
4.74 Â 0% -2.7% 4.61 Â 1% turbostat.RAMWatt
7723 Â 0% +32.6% 10238 Â 5% numa-meminfo.node0.Active(file)
1589 Â 17% +45.5% 2313 Â 24% numa-meminfo.node0.Dirty
56052 Â 3% +58.2% 88666 Â 17% numa-meminfo.node1.Active
48142 Â 4% +64.0% 78943 Â 19% numa-meminfo.node1.Active(anon)
7908 Â 1% +22.9% 9722 Â 3% numa-meminfo.node1.Active(file)
46721 Â 3% +55.9% 72837 Â 24% numa-meminfo.node1.AnonPages
4789 Â 69% +102.3% 9687 Â 9% numa-meminfo.node1.Shmem
52991525 Â 1% -19.4% 42687208 Â 0% cpuidle.C1-IVT.time
319584 Â 1% -26.5% 234868 Â 1% cpuidle.C1-IVT.usage
3468808 Â 2% -19.8% 2783341 Â 3% cpuidle.C1E-IVT.time
46760 Â 0% -22.4% 36298 Â 0% cpuidle.C1E-IVT.usage
12590471 Â 0% -22.3% 9788585 Â 1% cpuidle.C3-IVT.time
79965 Â 0% -19.0% 64749 Â 0% cpuidle.C3-IVT.usage
1.3e+09 Â 0% +13.3% 1.473e+09 Â 0% cpuidle.C6-IVT.time
352.33 Â 8% -24.7% 265.33 Â 1% cpuidle.POLL.usage
1930 Â 0% +33.9% 2585 Â 3% numa-vmstat.node0.nr_active_file
4468 Â 7% -8.5% 4089 Â 5% numa-vmstat.node0.nr_alloc_batch
466.67 Â 4% +29.3% 603.33 Â 14% numa-vmstat.node0.nr_dirty
12026 Â 4% +64.1% 19734 Â 20% numa-vmstat.node1.nr_active_anon
1977 Â 1% +23.6% 2444 Â 1% numa-vmstat.node1.nr_active_file
3809 Â 6% +16.1% 4422 Â 4% numa-vmstat.node1.nr_alloc_batch
11671 Â 3% +55.9% 18197 Â 24% numa-vmstat.node1.nr_anon_pages
1197 Â 69% +102.3% 2422 Â 9% numa-vmstat.node1.nr_shmem
456.33 Â 57% -75.6% 111.33 Â 86% numa-vmstat.node1.nr_written
2.658e+11 Â 4% +24.7% 3.316e+11 Â 2% perf-stat.branch-instructions
0.41 Â 1% -9.1% 0.37 Â 1% perf-stat.branch-miss-rate
1.09e+09 Â 3% +13.4% 1.237e+09 Â 1% perf-stat.branch-misses
981138 Â 0% -18.1% 803696 Â 0% perf-stat.context-switches
1.511e+12 Â 5% +23.4% 1.864e+12 Â 3% perf-stat.cpu-cycles
102600 Â 1% -7.3% 95075 Â 1% perf-stat.cpu-migrations
0.26 Â 12% -30.8% 0.18 Â 10% perf-stat.dTLB-load-miss-rate
3.164e+11 Â 1% +39.9% 4.426e+11 Â 4% perf-stat.dTLB-loads
0.03 Â 26% -41.3% 0.02 Â 13% perf-stat.dTLB-store-miss-rate
2.247e+11 Â 6% +26.4% 2.839e+11 Â 2% perf-stat.dTLB-stores
1.49e+12 Â 4% +30.1% 1.939e+12 Â 2% perf-stat.instructions
43348 Â 2% +34.2% 58161 Â 12% perf-stat.instructions-per-iTLB-miss
0.99 Â 0% +5.5% 1.04 Â 0% perf-stat.ipc
262799 Â 0% +4.4% 274251 Â 1% perf-stat.minor-faults
34.12 Â 1% +2.1% 34.83 Â 0% perf-stat.node-load-miss-rate
46476754 Â 2% +4.6% 48601269 Â 1% perf-stat.node-load-misses
9.96 Â 0% +13.4% 11.30 Â 0% perf-stat.node-store-miss-rate
24460859 Â 1% +14.4% 27971097 Â 1% perf-stat.node-store-misses
262780 Â 0% +4.4% 274227 Â 1% perf-stat.page-faults
11.31 Â 1% -18.1% 9.27 Â 0% perf-profile.cycles-pp.____fput.task_work_run.exit_to_usermode_loop.syscall_return_slowpath.entry_SYSCALL_64_fastpath
0.00 Â -1% +Inf% 1.68 Â 1% perf-profile.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin
1.80 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin
2.55 Â 3% -14.2% 2.19 Â 2% perf-profile.cycles-pp.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.pagecache_get_page.grab_cache_page_write_begin
0.00 Â -1% +Inf% 4.45 Â 1% perf-profile.cycles-pp.__block_commit_write.isra.24.block_write_end.generic_write_end.iomap_write_actor.iomap_apply
5.93 Â 0% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__block_commit_write.isra.24.block_write_end.generic_write_end.xfs_vm_write_end.generic_perform_write
13.71 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__block_write_begin.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter
10.36 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__block_write_begin_int.__block_write_begin.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write
0.00 Â -1% +Inf% 3.64 Â 0% perf-profile.cycles-pp.__block_write_begin_int.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.04 Â 2% -18.9% 0.84 Â 1% perf-profile.cycles-pp.__delete_from_page_cache.delete_from_page_cache.truncate_inode_page.truncate_inode_pages_range.truncate_inode_pages_final
11.24 Â 2% -18.1% 9.21 Â 0% perf-profile.cycles-pp.__dentry_kill.dput.__fput.____fput.task_work_run
11.31 Â 2% -18.1% 9.26 Â 0% perf-profile.cycles-pp.__fput.____fput.task_work_run.exit_to_usermode_loop.syscall_return_slowpath
0.00 Â -1% +Inf% 1.09 Â 2% perf-profile.cycles-pp.__mark_inode_dirty.generic_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.32 Â 4% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__mark_inode_dirty.generic_write_end.xfs_vm_write_end.generic_perform_write.xfs_file_buffered_aio_write
0.00 Â -1% +Inf% 2.68 Â 2% perf-profile.cycles-pp.__page_cache_alloc.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor
3.04 Â 3% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__page_cache_alloc.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin.generic_perform_write
1.00 Â 1% -18.0% 0.82 Â 1% perf-profile.cycles-pp.__radix_tree_lookup.radix_tree_lookup_slot.find_get_entry.pagecache_get_page.grab_cache_page_write_begin
1.12 Â 2% -17.6% 0.92 Â 4% perf-profile.cycles-pp.__sb_start_write.vfs_write.sys_write.entry_SYSCALL_64_fastpath
1.38 Â 2% -13.3% 1.19 Â 1% perf-profile.cycles-pp.__set_page_dirty.mark_buffer_dirty.__block_commit_write.isra.24.block_write_end.generic_write_end
54.10 Â 1% +13.1% 61.20 Â 0% perf-profile.cycles-pp.__vfs_write.vfs_write.sys_write.entry_SYSCALL_64_fastpath
6.34 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.__xfs_get_blocks.xfs_get_blocks.__block_write_begin_int.__block_write_begin.xfs_vm_write_begin
0.00 Â -1% +Inf% 3.69 Â 1% perf-profile.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor
4.02 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin.generic_perform_write
0.98 Â 5% -100.0% 0.00 Â -1% perf-profile.cycles-pp.alloc_page_buffers.create_empty_buffers.create_page_buffers.__block_write_begin_int.__block_write_begin
0.00 Â -1% +Inf% 2.56 Â 2% perf-profile.cycles-pp.alloc_pages_current.__page_cache_alloc.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin
2.91 Â 3% -100.0% 0.00 Â -1% perf-profile.cycles-pp.alloc_pages_current.__page_cache_alloc.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin
3.42 Â 0% -20.9% 2.71 Â 2% perf-profile.cycles-pp.block_invalidatepage.xfs_vm_invalidatepage.truncate_inode_page.truncate_inode_pages_range.truncate_inode_pages_final
0.00 Â -1% +Inf% 4.69 Â 0% perf-profile.cycles-pp.block_write_end.generic_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write
6.24 Â 0% -100.0% 0.00 Â -1% perf-profile.cycles-pp.block_write_end.generic_write_end.xfs_vm_write_end.generic_perform_write.xfs_file_buffered_aio_write
19.18 Â 5% -9.3% 17.40 Â 0% perf-profile.cycles-pp.call_cpuidle.cpu_startup_entry.start_secondary
0.94 Â 4% -19.8% 0.76 Â 0% perf-profile.cycles-pp.cancel_dirty_page.try_to_free_buffers.xfs_vm_releasepage.try_to_release_page.block_invalidatepage
3.95 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.copy_user_enhanced_fast_string.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write
0.00 Â -1% +Inf% 3.22 Â 0% perf-profile.cycles-pp.copy_user_enhanced_fast_string.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
19.75 Â 5% -9.8% 17.81 Â 0% perf-profile.cycles-pp.cpu_startup_entry.start_secondary
19.18 Â 5% -9.3% 17.40 Â 0% perf-profile.cycles-pp.cpuidle_enter.call_cpuidle.cpu_startup_entry.start_secondary
18.45 Â 5% -9.2% 16.75 Â 0% perf-profile.cycles-pp.cpuidle_enter_state.cpuidle_enter.call_cpuidle.cpu_startup_entry.start_secondary
1.44 Â 3% -100.0% 0.00 Â -1% perf-profile.cycles-pp.create_empty_buffers.create_page_buffers.__block_write_begin_int.__block_write_begin.xfs_vm_write_begin
0.00 Â -1% +Inf% 1.18 Â 1% perf-profile.cycles-pp.create_empty_buffers.create_page_buffers.__block_write_begin_int.iomap_write_begin.iomap_write_actor
1.86 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.create_page_buffers.__block_write_begin_int.__block_write_begin.xfs_vm_write_begin.generic_perform_write
0.00 Â -1% +Inf% 1.53 Â 1% perf-profile.cycles-pp.create_page_buffers.__block_write_begin_int.iomap_write_begin.iomap_write_actor.iomap_apply
1.74 Â 2% -19.9% 1.40 Â 3% perf-profile.cycles-pp.delete_from_page_cache.truncate_inode_page.truncate_inode_pages_range.truncate_inode_pages_final.evict
1.27 Â 0% -22.5% 0.99 Â 4% perf-profile.cycles-pp.destroy_inode.evict.iput.__dentry_kill.dput
2.61 Â 1% -24.3% 1.98 Â 1% perf-profile.cycles-pp.do_filp_open.do_sys_open.sys_creat.entry_SYSCALL_64_fastpath
2.66 Â 1% -24.3% 2.01 Â 1% perf-profile.cycles-pp.do_sys_open.sys_creat.entry_SYSCALL_64_fastpath
1.79 Â 2% -28.2% 1.28 Â 3% perf-profile.cycles-pp.do_unlinkat.sys_unlink.entry_SYSCALL_64_fastpath
1.07 Â 3% -23.3% 0.82 Â 3% perf-profile.cycles-pp.down_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write.vfs_write
1.01 Â 3% -17.9% 0.83 Â 2% perf-profile.cycles-pp.down_write.xfs_ilock.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write
11.26 Â 2% -18.1% 9.23 Â 0% perf-profile.cycles-pp.dput.__fput.____fput.task_work_run.exit_to_usermode_loop
11.21 Â 2% -18.1% 9.18 Â 0% perf-profile.cycles-pp.evict.iput.__dentry_kill.dput.__fput
11.34 Â 2% -18.1% 9.29 Â 0% perf-profile.cycles-pp.exit_to_usermode_loop.syscall_return_slowpath.entry_SYSCALL_64_fastpath
0.00 Â -1% +Inf% 1.55 Â 3% perf-profile.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor
1.83 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin.generic_perform_write
43.95 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write.vfs_write
0.00 Â -1% +Inf% 7.91 Â 1% perf-profile.cycles-pp.generic_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
10.68 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.generic_write_end.xfs_vm_write_end.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter
1.91 Â 3% -16.4% 1.59 Â 1% perf-profile.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.pagecache_get_page
0.00 Â -1% +Inf% 9.85 Â 0% perf-profile.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
10.96 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.grab_cache_page_write_begin.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter
0.00 Â -1% +Inf% 52.29 Â 0% perf-profile.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write
0.00 Â -1% +Inf% 52.94 Â 0% perf-profile.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write.vfs_write
0.00 Â -1% +Inf% 34.35 Â 0% perf-profile.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_write_iter
0.00 Â -1% +Inf% 16.48 Â 0% perf-profile.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
11.22 Â 2% -18.1% 9.19 Â 0% perf-profile.cycles-pp.iput.__dentry_kill.dput.__fput.____fput
0.00 Â -1% +Inf% 1.55 Â 1% perf-profile.cycles-pp.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin
1.72 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin
0.00 Â -1% +Inf% 2.78 Â 0% perf-profile.cycles-pp.mark_buffer_dirty.__block_commit_write.isra.24.block_write_end.generic_write_end.iomap_write_actor
3.39 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.mark_buffer_dirty.__block_commit_write.isra.24.block_write_end.generic_write_end.xfs_vm_write_end
0.00 Â -1% +Inf% 3.44 Â 1% perf-profile.cycles-pp.mark_page_accessed.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
3.03 Â 0% -100.0% 0.00 Â -1% perf-profile.cycles-pp.memset_erms.__block_write_begin.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write
0.00 Â -1% +Inf% 2.43 Â 0% perf-profile.cycles-pp.memset_erms.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
0.00 Â -1% +Inf% 9.25 Â 0% perf-profile.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
10.37 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write
2.58 Â 1% -24.1% 1.96 Â 0% perf-profile.cycles-pp.path_openat.do_filp_open.do_sys_open.sys_creat.entry_SYSCALL_64_fastpath
1.17 Â 3% -100.0% 0.00 Â -1% perf-profile.cycles-pp.radix_tree_lookup_slot.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.xfs_vm_write_begin
2.06 Â 3% -22.5% 1.60 Â 2% perf-profile.cycles-pp.rw_verify_area.vfs_write.sys_write.entry_SYSCALL_64_fastpath
1.79 Â 3% -22.2% 1.39 Â 0% perf-profile.cycles-pp.security_file_permission.rw_verify_area.vfs_write.sys_write.entry_SYSCALL_64_fastpath
1.32 Â 4% -21.4% 1.04 Â 0% perf-profile.cycles-pp.selinux_file_permission.security_file_permission.rw_verify_area.vfs_write.sys_write
19.79 Â 5% -9.9% 17.84 Â 0% perf-profile.cycles-pp.start_secondary
2.67 Â 1% -24.2% 2.02 Â 1% perf-profile.cycles-pp.sys_creat.entry_SYSCALL_64_fastpath
1.79 Â 3% -27.9% 1.29 Â 3% perf-profile.cycles-pp.sys_unlink.entry_SYSCALL_64_fastpath
60.98 Â 1% +9.5% 66.76 Â 0% perf-profile.cycles-pp.sys_write.entry_SYSCALL_64_fastpath
11.34 Â 1% -18.1% 9.29 Â 0% perf-profile.cycles-pp.syscall_return_slowpath.entry_SYSCALL_64_fastpath
11.32 Â 1% -18.0% 9.28 Â 0% perf-profile.cycles-pp.task_work_run.exit_to_usermode_loop.syscall_return_slowpath.entry_SYSCALL_64_fastpath
5.96 Â 1% -20.0% 4.77 Â 0% perf-profile.cycles-pp.truncate_inode_page.truncate_inode_pages_range.truncate_inode_pages_final.evict.iput
9.89 Â 2% -17.4% 8.17 Â 0% perf-profile.cycles-pp.truncate_inode_pages_final.evict.iput.__dentry_kill.dput
9.87 Â 2% -17.5% 8.15 Â 0% perf-profile.cycles-pp.truncate_inode_pages_range.truncate_inode_pages_final.evict.iput.__dentry_kill
2.07 Â 1% -20.4% 1.65 Â 2% perf-profile.cycles-pp.try_to_free_buffers.xfs_vm_releasepage.try_to_release_page.block_invalidatepage.xfs_vm_invalidatepage
2.40 Â 1% -21.0% 1.89 Â 2% perf-profile.cycles-pp.try_to_release_page.block_invalidatepage.xfs_vm_invalidatepage.truncate_inode_page.truncate_inode_pages_range
0.00 Â -1% +Inf% 1.36 Â 1% perf-profile.cycles-pp.unlock_page.generic_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.72 Â 4% -100.0% 0.00 Â -1% perf-profile.cycles-pp.unlock_page.generic_write_end.xfs_vm_write_end.generic_perform_write.xfs_file_buffered_aio_write
59.63 Â 1% +10.2% 65.72 Â 0% perf-profile.cycles-pp.vfs_write.sys_write.entry_SYSCALL_64_fastpath
0.00 Â -1% +Inf% 1.52 Â 2% perf-profile.cycles-pp.workingset_activation.mark_page_accessed.iomap_write_actor.iomap_apply.iomap_file_buffered_write
0.00 Â -1% +Inf% 1.73 Â 1% perf-profile.cycles-pp.xfs_bmap_search_extents.xfs_bmapi_delay.xfs_iomap_write_delay.xfs_file_iomap_begin.iomap_apply
0.00 Â -1% +Inf% 1.97 Â 2% perf-profile.cycles-pp.xfs_bmap_search_extents.xfs_bmapi_read.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write
0.00 Â -1% +Inf% 1.61 Â 2% perf-profile.cycles-pp.xfs_bmap_search_extents.xfs_bmapi_read.xfs_iomap_eof_want_preallocate.constprop.8.xfs_iomap_write_delay.xfs_file_iomap_begin
0.00 Â -1% +Inf% 1.24 Â 2% perf-profile.cycles-pp.xfs_bmap_search_multi_extents.xfs_bmap_search_extents.xfs_bmapi_delay.xfs_iomap_write_delay.xfs_file_iomap_begin
0.00 Â -1% +Inf% 1.46 Â 1% perf-profile.cycles-pp.xfs_bmap_search_multi_extents.xfs_bmap_search_extents.xfs_bmapi_read.xfs_file_iomap_begin.iomap_apply
0.00 Â -1% +Inf% 1.21 Â 2% perf-profile.cycles-pp.xfs_bmap_search_multi_extents.xfs_bmap_search_extents.xfs_bmapi_read.xfs_iomap_eof_want_preallocate.constprop.8.xfs_iomap_write_delay
1.25 Â 0% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_bmapi_delay.xfs_iomap_write_delay.__xfs_get_blocks.xfs_get_blocks.__block_write_begin_int
0.00 Â -1% +Inf% 3.06 Â 1% perf-profile.cycles-pp.xfs_bmapi_delay.xfs_iomap_write_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write
1.04 Â 0% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_bmapi_read.__xfs_get_blocks.xfs_get_blocks.__block_write_begin_int.__block_write_begin
0.00 Â -1% +Inf% 3.04 Â 1% perf-profile.cycles-pp.xfs_bmapi_read.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
0.00 Â -1% +Inf% 3.05 Â 1% perf-profile.cycles-pp.xfs_bmapi_read.xfs_iomap_eof_want_preallocate.constprop.8.xfs_iomap_write_delay.xfs_file_iomap_begin.iomap_apply
1.32 Â 2% -21.5% 1.04 Â 1% perf-profile.cycles-pp.xfs_create.xfs_generic_create.xfs_vn_mknod.xfs_vn_create.path_openat
51.83 Â 1% +14.3% 59.25 Â 0% perf-profile.cycles-pp.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write.vfs_write.sys_write
0.00 Â -1% +Inf% 16.05 Â 0% perf-profile.cycles-pp.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_write_iter
53.16 Â 1% +13.6% 60.40 Â 0% perf-profile.cycles-pp.xfs_file_write_iter.__vfs_write.vfs_write.sys_write.entry_SYSCALL_64_fastpath
1.24 Â 1% -23.1% 0.95 Â 4% perf-profile.cycles-pp.xfs_fs_destroy_inode.destroy_inode.evict.iput.__dentry_kill
1.42 Â 2% -21.2% 1.12 Â 1% perf-profile.cycles-pp.xfs_generic_create.xfs_vn_mknod.xfs_vn_create.path_openat.do_filp_open
6.46 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_get_blocks.__block_write_begin_int.__block_write_begin.xfs_vm_write_begin.generic_perform_write
1.29 Â 3% -18.9% 1.04 Â 1% perf-profile.cycles-pp.xfs_ilock.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write.vfs_write
0.00 Â -1% +Inf% 1.14 Â 3% perf-profile.cycles-pp.xfs_ilock.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
1.21 Â 1% -23.4% 0.93 Â 4% perf-profile.cycles-pp.xfs_inactive.xfs_fs_destroy_inode.destroy_inode.evict.iput
1.23 Â 4% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_iomap_eof_want_preallocate.constprop.6.xfs_iomap_write_delay.__xfs_get_blocks.xfs_get_blocks.__block_write_begin_int
0.00 Â -1% +Inf% 4.14 Â 0% perf-profile.cycles-pp.xfs_iomap_eof_want_preallocate.constprop.8.xfs_iomap_write_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write
3.28 Â 2% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_iomap_write_delay.__xfs_get_blocks.xfs_get_blocks.__block_write_begin_int.__block_write_begin
0.00 Â -1% +Inf% 9.08 Â 0% perf-profile.cycles-pp.xfs_iomap_write_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
3.54 Â 0% -20.8% 2.81 Â 1% perf-profile.cycles-pp.xfs_vm_invalidatepage.truncate_inode_page.truncate_inode_pages_range.truncate_inode_pages_final.evict
2.35 Â 1% -21.0% 1.86 Â 1% perf-profile.cycles-pp.xfs_vm_releasepage.try_to_release_page.block_invalidatepage.xfs_vm_invalidatepage.truncate_inode_page
25.10 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_vm_write_begin.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write
11.03 Â 1% -100.0% 0.00 Â -1% perf-profile.cycles-pp.xfs_vm_write_end.generic_perform_write.xfs_file_buffered_aio_write.xfs_file_write_iter.__vfs_write
1.42 Â 2% -20.7% 1.13 Â 1% perf-profile.cycles-pp.xfs_vn_create.path_openat.do_filp_open.do_sys_open.sys_creat
1.42 Â 2% -20.5% 1.13 Â 1% perf-profile.cycles-pp.xfs_vn_mknod.xfs_vn_create.path_openat.do_filp_open.do_sys_open
2.27 Â 1% -10.6% 2.03 Â 0% perf-profile.func.cycles-pp.___might_sleep
2.49 Â 0% -34.5% 1.63 Â 1% perf-profile.func.cycles-pp.__block_commit_write.isra.24
1.51 Â 2% +15.4% 1.75 Â 1% perf-profile.func.cycles-pp.__block_write_begin_int
1.79 Â 4% -16.8% 1.49 Â 1% perf-profile.func.cycles-pp.__mark_inode_dirty
1.32 Â 0% -16.4% 1.10 Â 1% perf-profile.func.cycles-pp.__radix_tree_lookup
1.08 Â 2% -100.0% 0.00 Â -1% perf-profile.func.cycles-pp.__xfs_get_blocks
1.16 Â 0% -18.1% 0.95 Â 1% perf-profile.func.cycles-pp._raw_spin_lock
3.96 Â 2% -18.4% 3.23 Â 0% perf-profile.func.cycles-pp.copy_user_enhanced_fast_string
1.41 Â 3% -20.6% 1.12 Â 3% perf-profile.func.cycles-pp.entry_SYSCALL_64_fastpath
1.30 Â 2% -100.0% 0.00 Â -1% perf-profile.func.cycles-pp.generic_perform_write
1.31 Â 2% -46.7% 0.70 Â 0% perf-profile.func.cycles-pp.generic_write_end
18.43 Â 5% -9.1% 16.76 Â 0% perf-profile.func.cycles-pp.intel_idle
0.00 Â -1% +Inf% 1.12 Â 1% perf-profile.func.cycles-pp.iomap_write_actor
1.50 Â 1% -20.9% 1.19 Â 1% perf-profile.func.cycles-pp.mark_buffer_dirty
0.00 Â -1% +Inf% 1.91 Â 1% perf-profile.func.cycles-pp.mark_page_accessed
3.24 Â 0% -19.8% 2.60 Â 0% perf-profile.func.cycles-pp.memset_erms
1.75 Â 2% -18.9% 1.42 Â 1% perf-profile.func.cycles-pp.unlock_page
1.16 Â 1% -21.6% 0.91 Â 1% perf-profile.func.cycles-pp.vfs_write
0.37 Â 2% +243.6% 1.26 Â 2% perf-profile.func.cycles-pp.xfs_bmap_search_extents
0.41 Â 1% +198.4% 1.22 Â 2% perf-profile.func.cycles-pp.xfs_bmap_search_multi_extents
0.70 Â 5% +219.5% 2.24 Â 0% perf-profile.func.cycles-pp.xfs_bmapi_read
1.05 Â 2% -15.6% 0.88 Â 3% perf-profile.func.cycles-pp.xfs_file_write_iter
0.64 Â 1% +182.8% 1.81 Â 4% perf-profile.func.cycles-pp.xfs_iext_bno_to_ext
0.00 Â -1% +Inf% 1.10 Â 3% perf-profile.func.cycles-pp.xfs_iomap_eof_want_preallocate.constprop.8
0.46 Â 4% +161.6% 1.20 Â 1% perf-profile.func.cycles-pp.xfs_iomap_write_delay
Best Regards,
Huang, Ying