[GIT PULL] KVM changes for Linux 6.3 merge window
From: Paolo Bonzini
Date: Fri Feb 24 2023 - 03:11:58 EST
Linus,
The following changes since commit 9442d05bba6c12749fdc4039eddcf801398ec82b:
arm64/sme: Fix __finalise_el2 SMEver check (2023-02-06 16:34:29 +0000)
are available in the Git repository at:
https://git.kernel.org/pub/scm/virt/kvm/kvm.git tags/for-linus
for you to fetch changes up to 45dd9bc75d9adc9483f0c7d662ba6e73ed698a0b:
KVM: SVM: hyper-v: placate modpost section mismatch error (2023-02-22 13:32:07 -0500)
The common topic branches with other trees have all been merged already,
hence the slightly weird "since commit" line that git chose above.
There are small conflicts in arch/x86's cpuid lists. I include the
conflict resolution after the diffstat.
Also, the following drivers/ changes stand out in the diffstat:
- virtualization-related features for the vGIC of Apple's interrupt
controller and for the RISC-V PMU (event->attr.exclude_{hv,guest})
- a s390 virtio-ccw change that technically should have been included
in Michael Tsirkin's virtio tree, or simply through the s390 tree.
But the author (Alexander Gordeev) _is_ an s390 maintainer so please
give him a pass. :)
----------------------------------------------------------------
ARM:
- Provide a virtual cache topology to the guest to avoid
inconsistencies with migration on heterogenous systems. Non secure
software has no practical need to traverse the caches by set/way in
the first place.
- Add support for taking stage-2 access faults in parallel. This was an
accidental omission in the original parallel faults implementation,
but should provide a marginal improvement to machines w/o FEAT_HAFDBS
(such as hardware from the fruit company).
- A preamble to adding support for nested virtualization to KVM,
including vEL2 register state, rudimentary nested exception handling
and masking unsupported features for nested guests.
- Fixes to the PSCI relay that avoid an unexpected host SVE trap when
resuming a CPU when running pKVM.
- VGIC maintenance interrupt support for the AIC
- Improvements to the arch timer emulation, primarily aimed at reducing
the trap overhead of running nested.
- Add CONFIG_USERFAULTFD to the KVM selftests config fragment in the
interest of CI systems.
- Avoid VM-wide stop-the-world operations when a vCPU accesses its own
redistributor.
- Serialize when toggling CPACR_EL1.SMEN to avoid unexpected exceptions
in the host.
- Aesthetic and comment/kerneldoc fixes
- Drop the vestiges of the old Columbia mailing list and add [Oliver]
as co-maintainer
This also drags in arm64's 'for-next/sme2' branch, because both it and
the PSCI relay changes touch the EL2 initialization code.
RISC-V:
- Fix wrong usage of PGDIR_SIZE instead of PUD_SIZE
- Correctly place the guest in S-mode after redirecting a trap to the guest
- Redirect illegal instruction traps to guest
- SBI PMU support for guest
s390:
- Two patches sorting out confusion between virtual and physical
addresses, which currently are the same on s390.
- A new ioctl that performs cmpxchg on guest memory
- A few fixes
x86:
- Change tdp_mmu to a read-only parameter
- Separate TDP and shadow MMU page fault paths
- Enable Hyper-V invariant TSC control
- Fix a variety of APICv and AVIC bugs, some of them real-world,
some of them affecting architecurally legal but unlikely to
happen in practice
- Mark APIC timer as expired if its in one-shot mode and the count
underflows while the vCPU task was being migrated
- Advertise support for Intel's new fast REP string features
- Fix a double-shootdown issue in the emergency reboot code
- Ensure GIF=1 and disable SVM during an emergency reboot, i.e. give SVM
similar treatment to VMX
- Update Xen's TSC info CPUID sub-leaves as appropriate
- Add support for Hyper-V's extended hypercalls, where "support" at this
point is just forwarding the hypercalls to userspace
- Clean up the kvm->lock vs. kvm->srcu sequences when updating the PMU and
MSR filters
- One-off fixes and cleanups
- Fix and cleanup the range-based TLB flushing code, used when KVM is
running on Hyper-V
- Add support for filtering PMU events using a mask. If userspace
wants to restrict heavily what events the guest can use, it can now
do so without needing an absurd number of filter entries
- Clean up KVM's handling of "PMU MSRs to save", especially when vPMU
support is disabled
- Add PEBS support for Intel Sapphire Rapids
- Fix a mostly benign overflow bug in SEV's send|receive_update_data()
- Move several SVM-specific flags into vcpu_svm
x86 Intel:
- Handle NMI VM-Exits before leaving the noinstr region
- A few trivial cleanups in the VM-Enter flows
- Stop enabling VMFUNC for L1 purely to document that KVM doesn't support
EPTP switching (or any other VM function) for L1
- Fix a crash when using eVMCS's enlighted MSR bitmaps
Generic:
- Clean up the hardware enable and initialization flow, which was
scattered around multiple arch-specific hooks. Instead, just
let the arch code call into generic code. Both x86 and ARM should
benefit from not having to fight common KVM code's notion of how
to do initialization.
- Account allocations in generic kvm_arch_alloc_vm()
- Fix a memory leak if coalesced MMIO unregistration fails
selftests:
- On x86, cache the CPU vendor (AMD vs. Intel) and use the info to emit
the correct hypercall instruction instead of relying on KVM to patch
in VMMCALL
- Use TAP interface for kvm_binary_stats_test and tsc_msrs_test
----------------------------------------------------------------
Aaron Lewis (8):
KVM: x86/pmu: Correct the mask used in a pmu event filter lookup
KVM: x86/pmu: Remove impossible events from the pmu event filter
KVM: x86/pmu: prepare the pmu event filter for masked events
KVM: x86/pmu: Introduce masked events to the pmu event filter
KVM: selftests: Add flags when creating a pmu event filter
KVM: selftests: Add testing for KVM_SET_PMU_EVENT_FILTER
KVM: selftests: Test masked events in PMU filter
KVM: selftests: Fix a typo in the vcpu_msrs_set assert
Akihiko Odaki (6):
arm64/sysreg: Convert CCSIDR_EL1 to automatic generation
arm64/sysreg: Add CCSIDR2_EL1
arm64/cache: Move CLIDR macro definitions
KVM: arm64: Always set HCR_TID2
KVM: arm64: Mask FEAT_CCIDX
KVM: arm64: Normalize cache configuration
Alexander Gordeev (1):
s390/virtio: sort out physical vs virtual pointers usage
Alexandre Ghiti (1):
KVM: RISC-V: Fix wrong usage of PGDIR_SIZE to check page sizes
Alexandru Matei (1):
KVM: VMX: Fix crash due to uninitialized current_vmcs
Alexey Dobriyan (2):
KVM: account allocation in generic version of kvm_arch_alloc_vm()
KVM: VMX: don't use "unsigned long" in vmx_vcpu_enter_exit()
Andy Chiu (1):
RISC-V: KVM: Redirect illegal instruction traps to guest
Anish Ghulati (1):
KVM: SVM: Account scratch allocations used to decrypt SEV guest memory
Anup Patel (1):
RISC-V: KVM: Fix privilege mode setting in kvm_riscv_vcpu_trap_redirect()
Atish Patra (14):
perf: RISC-V: Define helper functions expose hpm counter width and count
perf: RISC-V: Improve privilege mode filtering for perf
RISC-V: Improve SBI PMU extension related definitions
RISC-V: KVM: Define a probe function for SBI extension data structures
RISC-V: KVM: Return correct code for hsm stop function
RISC-V: KVM: Modify SBI extension handler to return SBI error code
RISC-V: KVM: Add skeleton support for perf
RISC-V: KVM: Add SBI PMU extension support
RISC-V: KVM: Make PMU functionality depend on Sscofpmf
RISC-V: KVM: Disable all hpmcounter access for VS/VU mode
RISC-V: KVM: Implement trap & emulate for hpmcounters
RISC-V: KVM: Implement perf support without sampling
RISC-V: KVM: Support firmware events
RISC-V: KVM: Increment firmware pmu events
Chao Gao (3):
KVM: x86: Do compatibility checks when onlining CPU
KVM: Rename and move CPUHP_AP_KVM_STARTING to ONLINE section
KVM: Disable CPU hotplug during hardware enabling/disabling
Christoffer Dall (6):
KVM: arm64: nv: Introduce nested virtualization VCPU feature
KVM: arm64: nv: Reset VCPU to EL2 registers if VCPU nested virt is set
KVM: arm64: nv: Allow userspace to set PSR_MODE_EL2x
KVM: arm64: nv: Add nested virt VCPU primitives for vEL2 VCPU state
KVM: arm64: nv: Handle trapped ERET from virtual EL2
KVM: arm64: nv: Only toggle cache for virtual EL2 when SCTLR_EL2 changes
Christophe JAILLET (2):
KVM: arm64: vgic-v3: Use kstrtobool() instead of strtobool()
KVM: x86/mmu: Use kstrtobool() instead of strtobool()
David Matlack (22):
KVM: x86/mmu: Change tdp_mmu to a read-only parameter
KVM: x86/mmu: Move TDP MMU VM init/uninit behind tdp_mmu_enabled
KVM: x86/mmu: Grab mmu_invalidate_seq in kvm_faultin_pfn()
KVM: x86/mmu: Handle error PFNs in kvm_faultin_pfn()
KVM: x86/mmu: Avoid memslot lookup during KVM_PFN_ERR_HWPOISON handling
KVM: x86/mmu: Handle no-slot faults in kvm_faultin_pfn()
KVM: x86/mmu: Initialize fault.{gfn,slot} earlier for direct MMUs
KVM: x86/mmu: Split out TDP MMU page fault handling
KVM: x86/mmu: Stop needlessly making MMU pages available for TDP MMU faults
KVM: x86/mmu: Rename __direct_map() to direct_map()
KVM: x86/mmu: Change tdp_mmu to a read-only parameter
KVM: x86/mmu: Move TDP MMU VM init/uninit behind tdp_mmu_enabled
KVM: x86/mmu: Grab mmu_invalidate_seq in kvm_faultin_pfn()
KVM: x86/mmu: Handle error PFNs in kvm_faultin_pfn()
KVM: x86/mmu: Avoid memslot lookup during KVM_PFN_ERR_HWPOISON handling
KVM: x86/mmu: Handle no-slot faults in kvm_faultin_pfn()
KVM: x86/mmu: Initialize fault.{gfn,slot} earlier for direct MMUs
KVM: x86/mmu: Split out TDP MMU page fault handling
KVM: x86/mmu: Stop needlessly making MMU pages available for TDP MMU faults
KVM: x86/mmu: Rename __direct_map() to direct_map()
KVM: x86: Replace cpu_dirty_logging_count with nr_memslots_dirty_logging
KVM: x86/mmu: Make tdp_mmu_allowed static
Emanuele Giuseppe Esposito (2):
KVM: x86: Reinitialize xAPIC ID when userspace forces x2APIC => xAPIC
KVM: selftests: Verify APIC_ID is set when forcing x2APIC=>xAPIC transition
Gavin Shan (2):
KVM: selftests: Remove duplicate VM creation in memslot_perf_test
KVM: selftests: Assign guest page size in sync area early in memslot_perf_test
Greg Edwards (1):
KVM: x86: Allow APICv APIC ID inhibit to be cleared
Hou Wenlong (6):
KVM: x86/mmu: Move round_gfn_for_level() helper into mmu_internal.h
KVM: x86/mmu: Fix wrong gfn range of tlb flushing in kvm_set_pte_rmapp()
KVM: x86/mmu: Reduce gfn range of tlb flushing in tdp_mmu_map_handle_target_level()
KVM: x86/mmu: Fix wrong start gfn of tlb flushing with range
KVM: x86/mmu: Fix wrong gfn range of tlb flushing in validate_direct_spte()
KVM: x86/mmu: Cleanup range-based flushing for given page
Isaku Yamahata (3):
KVM: Drop kvm_count_lock and instead protect kvm_usage_count with kvm_lock
KVM: Remove on_each_cpu(hardware_disable_nolock) in kvm_exit()
KVM: Make hardware_enable_failed a local variable in the "enable all" path
Janis Schoetterl-Glausch (14):
KVM: s390: selftest: memop: Pass mop_desc via pointer
KVM: s390: selftest: memop: Replace macros by functions
KVM: s390: selftest: memop: Move testlist into main
KVM: s390: selftest: memop: Add bad address test
KVM: s390: selftest: memop: Fix typo
KVM: s390: selftest: memop: Fix wrong address being used in test
KVM: s390: selftest: memop: Fix integer literal
KVM: s390: Move common code of mem_op functions into function
KVM: s390: Dispatch to implementing function at top level of vm mem_op
KVM: s390: Refactor absolute vm mem_op function
KVM: s390: Refactor vcpu mem_op function
KVM: s390: Extend MEM_OP ioctl by storage key checked cmpxchg
Documentation: KVM: s390: Describe KVM_S390_MEMOP_F_CMPXCHG
KVM: s390: selftest: memop: Add cmpxchg tests
Janosch Frank (1):
Merge remote-tracking branch 'l390-korg/cmpxchg_user_key' into kvm-next
Jiapeng Chong (1):
arm64/sysreg: clean up some inconsistent indenting
Jim Mattson (2):
x86/cpufeatures: Add macros for Intel's new fast rep string features
KVM: x86: Advertise fast REP string features inherent to the CPU
Jing Zhang (1):
KVM: selftests: Stop assuming stats are contiguous in kvm_binary_stats_test
Jintack Lim (7):
arm64: Add ARM64_HAS_NESTED_VIRT cpufeature
KVM: arm64: nv: Handle HCR_EL2.NV system register traps
KVM: arm64: nv: Support virtual EL2 exceptions
KVM: arm64: nv: Inject HVC exceptions to the virtual EL2
KVM: arm64: nv: Handle SMCs taken from virtual EL2
KVM: arm64: nv: Add accessors for SPSR_EL1, ELR_EL1 and VBAR_EL1 from virtual EL2
KVM: arm64: nv: Emulate EL12 register accesses from the virtual EL2
Kees Cook (1):
KVM: x86: Replace 0-length arrays with flexible arrays
Lai Jiangshan (4):
kvm: x86/mmu: Warn on linking when sp->unsync_children
kvm: x86/mmu: Warn on linking when sp->unsync_children
kvm: x86/mmu: Rename SPTE_TDP_AD_ENABLED_MASK to SPTE_TDP_AD_ENABLED
kvm: x86/mmu: Don't clear write flooding for direct SP
Li RongQing (1):
KVM: x86: fire timer when it is migrated and expired, and in oneshot mode
Like Xu (5):
KVM: svm/avic: Drop "struct kvm_x86_ops" for avic_hardware_setup()
KVM: x86/pmu: Drop event_type and rename "struct kvm_event_hw_type_mapping"
KVM: x86/pmu: Don't tell userspace to save MSRs for non-existent fixed PMCs
KVM: x86/pmu: Add PRIR++ and PDist support for SPR and later models
perf/x86/intel: Expose EPT-friendly PEBS for SPR and future models
Marc Zyngier (18):
KVM: arm64: Simplify the CPUHP logic
arm64: Allow the definition of UNKNOWN system register fields
KVM: arm64: Kill CPACR_EL1_TTA definition
KVM: arm64: vgic: Allow registration of a non-maskable maintenance interrupt
irqchip/apple-aic: Register vgic maintenance interrupt with KVM
KVM: arm64: vgic-v3: Limit IPI-ing when accessing GICR_{C,S}ACTIVER0
KVM: arm64: Drop Columbia-hosted mailing list
KVM: arm64: Don't arm a hrtimer for an already pending timer
KVM: arm64: Reduce overhead of trapped timer sysreg accesses
KVM: arm64: timers: Don't BUG() on unhandled timer trap
irqchip/apple-aic: Correctly map the vgic maintenance interrupt
KVM: arm64: Fix non-kerneldoc comments
KVM: arm64: Use the S2 MMU context to iterate over S2 table
KVM: arm64: nv: Add EL2 system registers to vcpu context
KVM: arm64: nv: Emulate PSTATE.M for a guest hypervisor
KVM: arm64: nv: Allow a sysreg to be hidden from userspace only
KVM: arm64: nv: Filter out unsupported features from ID regs
Merge tag ' https://github.com/oupton/linux tags/kvmarm-6.3' from into kvmarm-master/next
Mark Brown (1):
KVM: selftests: Enable USERFAULTFD
Maxim Levitsky (4):
KVM: nSVM: Don't sync tlb_ctl back to vmcb12 on nested VM-Exit
KVM: x86: Move HF_GIF_MASK into "struct vcpu_svm" as "guest_gif"
KVM: x86: Move HF_NMI_MASK and HF_IRET_MASK into "struct vcpu_svm"
KVM: x86: Use emulator callbacks instead of duplicating "host flags"
Michal Luczaj (9):
KVM: x86/emulator: Fix segment load privilege level validation
KVM: x86/emulator: Fix comment in __load_segment_descriptor()
KVM: x86: Optimize kvm->lock and SRCU interaction (KVM_SET_PMU_EVENT_FILTER)
KVM: x86: Optimize kvm->lock and SRCU interaction (KVM_X86_SET_MSR_FILTER)
KVM: x86: Simplify msr_filter update
KVM: x86: Explicitly state lockdep condition of msr_filter update
KVM: x86: Remove unnecessary initialization in kvm_vm_ioctl_set_msr_filter()
KVM: x86: Simplify msr_io()
KVM: selftests: Clean up misnomers in xen_shinfo_test
Nianyao Tang (1):
KVM: arm64: Synchronize SMEN on vcpu schedule out
Nico Boehr (2):
KVM: s390: disable migration mode when dirty tracking is disabled
KVM: s390: GISA: sort out physical vs virtual pointers usage
Nina Schoetterl-Glausch (1):
KVM: selftests: Compile s390 tests with -march=z10
Oliver Upton (19):
KVM: arm64: Use KVM's pte type/helpers in handle_access_fault()
KVM: arm64: Ignore EAGAIN for walks outside of a fault
KVM: arm64: Return EAGAIN for invalid PTE in attr walker
KVM: arm64: Don't serialize if the access flag isn't set
KVM: arm64: Handle access faults behind the read lock
KVM: arm64: Condition HW AF updates on config option
MAINTAINERS: Add Oliver Upton as co-maintainer of KVM/arm64
KVM: arm64: Mark some VM-scoped allocations as __GFP_ACCOUNT
KVM: arm64: nv: Use reg_to_encoding() to get sysreg ID
Merge branch kvm/kvm-hw-enable-refactor into kvmarm/next
Merge branch arm64/for-next/sme2 into kvmarm/next
Merge branch kvm-arm64/virtual-cache-geometry into kvmarm/next
Merge branch kvm-arm64/parallel-access-faults into kvmarm/next
Merge branch kvm-arm64/MAINTAINERS into kvmarm/next
Merge branch kvm-arm64/nv-timer-improvements into kvmarm/next
Merge branch kvm-arm64/psci-relay-fixes into kvmarm/next
Merge branch kvm-arm64/apple-vgic-mi into kvmarm/next
Merge branch kvm-arm64/misc into kvmarm/next
Merge branch kvm-arm64/nv-prefix into kvmarm/next
Paolo Bonzini (15):
Merge branch 'kvm-late-6.1' into HEAD
Merge branch 'kvm-hw-enable-refactor' into HEAD
Merge branch 'kvm-v6.2-rc4-fixes' into HEAD
Merge branch 'kvm-lapic-fix-and-cleanup' into HEAD
Merge tag 'kvm-x86-generic-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-misc-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-mmu-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-pmu-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-selftests-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-svm-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-x86-vmx-6.3' of https://github.com/kvm-x86/linux into HEAD
Merge tag 'kvm-riscv-6.3-1' of https://github.com/kvm-riscv/linux into HEAD
Merge tag 'kvm-s390-next-6.3-1' of https://git.kernel.org/pub/scm/linux/kernel/git/kvms390/linux into HEAD
Merge tag 'kvmarm-6.3' of git://git.kernel.org/pub/scm/linux/kernel/git/kvmarm/kvmarm into HEAD
Merge tag 'kvm-x86-apic-6.3' of https://github.com/kvm-x86/linux into HEAD
Paul Durrant (2):
KVM: x86/cpuid: generalize kvm_update_kvm_cpuid_base() and also capture limit
KVM: x86/xen: update Xen CPUID Leaf 4 (tsc info) sub-leaves, if present
Peter Gonda (1):
KVM: SVM: Fix potential overflow in SEV's send|receive_update_data()
Quentin Perret (4):
KVM: arm64: Provide sanitized SYS_ID_AA64SMFR0_EL1 to nVHE
KVM: arm64: Introduce finalise_el2_state macro
KVM: arm64: Use sanitized values in __check_override in nVHE
KVM: arm64: Finalise EL2 state from pKVM PSCI relay
Randy Dunlap (1):
KVM: SVM: hyper-v: placate modpost section mismatch error
Reiji Watanabe (1):
KVM: selftests: kvm_vm_elf_load() and elfhdr_get() should close fd
Sean Christopherson (105):
KVM: x86/mmu: Replace open coded usage of tdp_mmu_page with is_tdp_mmu_page()
KVM: x86/mmu: Pivot on "TDP MMU enabled" to check if active MMU is TDP MMU
KVM: x86/mmu: Pivot on "TDP MMU enabled" when handling direct page faults
KVM: x86/mmu: Replace open coded usage of tdp_mmu_page with is_tdp_mmu_page()
KVM: x86/mmu: Pivot on "TDP MMU enabled" to check if active MMU is TDP MMU
KVM: x86/mmu: Pivot on "TDP MMU enabled" when handling direct page faults
KVM: Register /dev/kvm as the _very_ last thing during initialization
KVM: Initialize IRQ FD after arch hardware setup
KVM: Allocate cpus_hardware_enabled after arch hardware setup
KVM: Teardown VFIO ops earlier in kvm_exit()
KVM: s390: Unwind kvm_arch_init() piece-by-piece() if a step fails
KVM: s390: Move hardware setup/unsetup to init/exit
KVM: x86: Do timer initialization after XCR0 configuration
KVM: x86: Move hardware setup/unsetup to init/exit
KVM: Drop arch hardware (un)setup hooks
KVM: VMX: Reset eVMCS controls in VP assist page during hardware disabling
KVM: VMX: Don't bother disabling eVMCS static key on module exit
KVM: VMX: Move Hyper-V eVMCS initialization to helper
KVM: x86: Move guts of kvm_arch_init() to standalone helper
KVM: VMX: Do _all_ initialization before exposing /dev/kvm to userspace
KVM: x86: Serialize vendor module initialization (hardware setup)
KVM: arm64: Free hypervisor allocations if vector slot init fails
KVM: arm64: Unregister perf callbacks if hypervisor finalization fails
KVM: arm64: Do arm/arch initialization without bouncing through kvm_init()
KVM: arm64: Mark kvm_arm_init() and its unique descendants as __init
KVM: MIPS: Hardcode callbacks to hardware virtualization extensions
KVM: MIPS: Setup VZ emulation? directly from kvm_mips_init()
KVM: MIPS: Register die notifier prior to kvm_init()
KVM: RISC-V: Do arch init directly in riscv_kvm_init()
KVM: RISC-V: Tag init functions and data with __init, __ro_after_init
KVM: PPC: Move processor compatibility check to module init
KVM: s390: Do s390 specific init without bouncing through kvm_init()
KVM: s390: Mark __kvm_s390_init() and its descendants as __init
KVM: Drop kvm_arch_{init,exit}() hooks
KVM: VMX: Make VMCS configuration/capabilities structs read-only after init
KVM: x86: Do CPU compatibility checks in x86 code
KVM: Drop kvm_arch_check_processor_compat() hook
KVM: x86: Use KBUILD_MODNAME to specify vendor module name
KVM: x86: Unify pr_fmt to use module name for all KVM modules
KVM: VMX: Use current CPU's info to perform "disabled by BIOS?" checks
KVM: x86: Do VMX/SVM support checks directly in vendor code
KVM: VMX: Shuffle support checks and hardware enabling code around
KVM: SVM: Check for SVM support in CPU compatibility checks
KVM: x86: Move CPU compat checks hook to kvm_x86_ops (from kvm_x86_init_ops)
KVM: Ensure CPU is stable during low level hardware enable/disable
KVM: Use a per-CPU variable to track which CPUs have enabled virtualization
KVM: Register syscore (suspend/resume) ops early in kvm_init()
KVM: Opt out of generic hardware enabling on s390 and PPC
KVM: Clean up error labels in kvm_init()
KVM: x86: Blindly get current x2APIC reg value on "nodecode write" traps
KVM: x86: Purge "highest ISR" cache when updating APICv state
KVM: SVM: Flush the "current" TLB when activating AVIC
KVM: SVM: Process ICR on AVIC IPI delivery failure due to invalid target
KVM: x86: Don't inhibit APICv/AVIC on xAPIC ID "change" if APIC is disabled
KVM: x86: Don't inhibit APICv/AVIC if xAPIC ID mismatch is due to 32-bit ID
KVM: SVM: Don't put/load AVIC when setting virtual APIC mode
KVM: x86: Handle APICv updates for APIC "mode" changes via request
KVM: x86: Move APIC access page helper to common x86 code
KVM: x86: Inhibit APIC memslot if x2APIC and AVIC are enabled
KVM: SVM: Replace "avic_mode" enum with "x2avic_enabled" boolean
KVM: SVM: Compute dest based on sender's x2APIC status for AVIC kick
Revert "KVM: SVM: Use target APIC ID to complete x2AVIC IRQs when possible"
KVM: SVM: Document that vCPU ID == APIC ID in AVIC kick fastpatch
KVM: SVM: Add helper to perform final AVIC "kick" of single vCPU
KVM: x86: Explicitly skip optimized logical map setup if vCPU's LDR==0
KVM: x86: Explicitly track all possibilities for APIC map's logical modes
KVM: x86: Skip redundant x2APIC logical mode optimized cluster setup
KVM: x86: Disable APIC logical map if logical ID covers multiple MDAs
KVM: x86: Disable APIC logical map if vCPUs are aliased in logical mode
KVM: x86: Honor architectural behavior for aliased 8-bit APIC IDs
KVM: x86: Inhibit APICv/AVIC if the optimized physical map is disabled
KVM: SVM: Inhibit AVIC if vCPUs are aliased in logical mode
KVM: SVM: Always update local APIC on writes to logical dest register
KVM: SVM: Update svm->ldr_reg cache even if LDR is "bad"
KVM: SVM: Require logical ID to be power-of-2 for AVIC entry
KVM: SVM: Handle multiple logical targets in AVIC kick fastpath
KVM: SVM: Ignore writes to Remote Read Data on AVIC write traps
Revert "KVM: SVM: Do not throw warning when calling avic_vcpu_load on a running vcpu"
KVM: x86: Track required APICv inhibits with variable, not callback
KVM: x86: Add helpers to recalc physical vs. logical optimized APIC maps
KVM: PPC: Fix refactoring goof in kvmppc_e500mc_init()
KVM: x86: Inject #GP if WRMSR sets reserved bits in APIC Self-IPI
KVM: x86: Inject #GP on x2APIC WRMSR that sets reserved bits 63:32
KVM: x86: Mark x2APIC DFR reg as non-existent for x2APIC
KVM: x86: Split out logic to generate "readable" APIC regs mask to helper
KVM: VMX: Always intercept accesses to unsupported "extended" x2APIC regs
KVM: VMX: Intercept reads to invalid and write-only x2APIC registers
x86/crash: Disable virt in core NMI crash handler to avoid double shootdown
x86/virt: Force GIF=1 prior to disabling SVM (for reboot flows)
x86/reboot: Disable virtualization in an emergency if SVM is supported
x86/reboot: Disable SVM, not just VMX, when stopping CPUs
KVM: VMX: Access @flags as a 32-bit value in __vmx_vcpu_run()
KVM: x86: Make vmx_get_exit_qual() and vmx_get_intr_info() noinstr-friendly
KVM: VMX: Allow VM-Fail path of VMREAD helper to be instrumented
KVM: VMX: Always inline eVMCS read/write helpers
KVM: VMX: Always inline to_vmx() and to_kvm_vmx()
x86/entry: KVM: Use dedicated VMX NMI entry for 32-bit kernels too
KVM: VMX: Provide separate subroutines for invoking NMI vs. IRQ handlers
KVM: VMX: Handle NMI VM-Exits in noinstr region
KVM: x86/pmu: Cap kvm_pmu_cap.num_counters_gp at KVM's internal max
KVM: x86/pmu: Gate all "unimplemented MSR" prints on report_ignored_msrs
KVM: x86/pmu: Use separate array for defining "PMU MSRs to save"
KVM: x86/pmu: Don't tell userspace to save PMU MSRs if PMU is disabled
KVM: x86/pmu: Provide "error" semantics for unsupported-but-known PMU MSRs
KVM: Destroy target device if coalesced MMIO unregistration fails
Shaoqin Huang (3):
KVM: selftests: Remove redundant setbuf()
selftests: KVM: Replace optarg with arg in guest_modes_cmdline
KVM: selftests: Remove duplicate macro definition
Suravee Suthikulpanit (1):
KVM: SVM: Fix x2APIC Logical ID calculation for avic_kick_target_vcpus_fast
Thomas Huth (4):
KVM: selftests: Use TAP interface in the kvm_binary_stats_test
KVM: selftests: x86: Use TAP interface in the tsc_msrs_test
KVM: selftests: Use TAP interface in the kvm_binary_stats_test
KVM: selftests: x86: Use TAP interface in the tsc_msrs_test
Vipin Sharma (5):
KVM: x86: hyper-v: Use common code for hypercall userspace exit
KVM: x86: hyper-v: Add extended hypercall support in Hyper-v
KVM: selftests: Test Hyper-V extended hypercall enablement
KVM: selftests: Replace hardcoded Linux OS id with HYPERV_LINUX_OS_ID
KVM: selftests: Test Hyper-V extended hypercall exit to userspace
Vishal Annapurve (3):
KVM: selftests: x86: Use "this_cpu" prefix for cpu vendor queries
KVM: selftests: x86: Cache host CPU vendor (AMD vs. Intel)
KVM: selftests: x86: Use host's native hypercall instruction in kvm_hypercall()
Vitaly Kuznetsov (22):
KVM: nVMX: Sanitize primary processor-based VM-execution controls with eVMCS too
KVM: nVMX: Invert 'unsupported by eVMCSv1' check
KVM: nVMX: Prepare to sanitize tertiary execution controls with eVMCS
KVM: VMX: Resurrect vmcs_conf sanitization for KVM-on-Hyper-V
x86/hyperv: Add HV_EXPOSE_INVARIANT_TSC define
KVM: x86: Add a KVM-only leaf for CPUID_8000_0007_EDX
KVM: x86: Hyper-V invariant TSC control
KVM: selftests: Rename 'msr->available' to 'msr->fault_exepected' in hyperv_features test
KVM: selftests: Convert hyperv_features test to using KVM_X86_CPU_FEATURE()
KVM: selftests: Test that values written to Hyper-V MSRs are preserved
KVM: selftests: Test Hyper-V invariant TSC control
KVM: nVMX: Sanitize primary processor-based VM-execution controls with eVMCS too
KVM: nVMX: Invert 'unsupported by eVMCSv1' check
KVM: nVMX: Prepare to sanitize tertiary execution controls with eVMCS
KVM: VMX: Resurrect vmcs_conf sanitization for KVM-on-Hyper-V
x86/hyperv: Add HV_EXPOSE_INVARIANT_TSC define
KVM: x86: Add a KVM-only leaf for CPUID_8000_0007_EDX
KVM: x86: Hyper-V invariant TSC control
KVM: selftests: Rename 'msr->available' to 'msr->fault_exepected' in hyperv_features test
KVM: selftests: Convert hyperv_features test to using KVM_X86_CPU_FEATURE()
KVM: selftests: Test that values written to Hyper-V MSRs are preserved
KVM: selftests: Test Hyper-V invariant TSC control
Wang Liang (1):
kvm_host.h: fix spelling typo in function declaration
Wang Yong (1):
KVM: update code comment in struct kvm_vcpu
Wei Liu (1):
KVM: x86/mmu: fix an incorrect comment in kvm_mmu_new_pgd()
Yu Zhang (3):
KVM: MMU: Make the definition of 'INVALID_GPA' common
KVM: VMX: Do not trap VMFUNC instructions for L1 guests.
KVM: nVMX: Simplify the setting of SECONDARY_EXEC_ENABLE_VMFUNC for nested.
ye xingchen (1):
KVM: x86: Replace IS_ERR() with IS_ERR_VALUE()
zhang songyi (3):
KVM: x86: remove redundant ret variable
KVM: x86/xen: Remove unneeded semicolon
KVM: SVM: remove redundant ret variable
Documentation/admin-guide/kernel-parameters.txt | 7 +-
Documentation/virt/kvm/api.rst | 124 +++-
Documentation/virt/kvm/devices/vm.rst | 4 +
Documentation/virt/kvm/locking.rst | 25 +-
Documentation/virt/kvm/x86/errata.rst | 11 +
MAINTAINERS | 3 +-
arch/arm64/include/asm/cache.h | 9 +
arch/arm64/include/asm/el2_setup.h | 99 +++
arch/arm64/include/asm/esr.h | 4 +
arch/arm64/include/asm/kvm_arm.h | 23 +-
arch/arm64/include/asm/kvm_emulate.h | 70 ++-
arch/arm64/include/asm/kvm_host.h | 67 +-
arch/arm64/include/asm/kvm_hyp.h | 1 +
arch/arm64/include/asm/kvm_mmu.h | 15 +-
arch/arm64/include/asm/kvm_nested.h | 20 +
arch/arm64/include/asm/kvm_pgtable.h | 8 +
arch/arm64/include/asm/sysreg.h | 39 +-
arch/arm64/include/uapi/asm/kvm.h | 1 +
arch/arm64/kernel/cacheinfo.c | 5 -
arch/arm64/kernel/cpufeature.c | 25 +
arch/arm64/kernel/hyp-stub.S | 86 +--
arch/arm64/kvm/Kconfig | 1 +
arch/arm64/kvm/Makefile | 2 +-
arch/arm64/kvm/arch_timer.c | 106 ++--
arch/arm64/kvm/arm.c | 109 ++--
arch/arm64/kvm/emulate-nested.c | 203 +++++++
arch/arm64/kvm/fpsimd.c | 1 +
arch/arm64/kvm/guest.c | 6 +
arch/arm64/kvm/handle_exit.c | 47 +-
arch/arm64/kvm/hyp/exception.c | 48 +-
arch/arm64/kvm/hyp/include/hyp/sysreg-sr.h | 21 +-
arch/arm64/kvm/hyp/nvhe/hyp-init.S | 1 +
arch/arm64/kvm/hyp/nvhe/sys_regs.c | 1 +
arch/arm64/kvm/hyp/pgtable.c | 43 +-
arch/arm64/kvm/hyp/vhe/switch.c | 26 +-
arch/arm64/kvm/hypercalls.c | 2 +-
arch/arm64/kvm/inject_fault.c | 61 +-
arch/arm64/kvm/mmu.c | 46 +-
arch/arm64/kvm/nested.c | 161 +++++
arch/arm64/kvm/pvtime.c | 8 +-
arch/arm64/kvm/reset.c | 25 +-
arch/arm64/kvm/sys_regs.c | 459 ++++++++++----
arch/arm64/kvm/sys_regs.h | 14 +-
arch/arm64/kvm/trace_arm.h | 59 ++
arch/arm64/kvm/vgic/vgic-init.c | 21 +-
arch/arm64/kvm/vgic/vgic-mmio.c | 13 +-
arch/arm64/kvm/vgic/vgic-v3.c | 9 +-
arch/arm64/kvm/vmid.c | 6 +-
arch/arm64/tools/cpucaps | 1 +
arch/arm64/tools/gen-sysreg.awk | 20 +-
arch/arm64/tools/sysreg | 17 +
arch/mips/include/asm/kvm_host.h | 3 +-
arch/mips/kvm/Kconfig | 1 +
arch/mips/kvm/Makefile | 2 +-
arch/mips/kvm/callback.c | 14 -
arch/mips/kvm/mips.c | 34 +-
arch/mips/kvm/vz.c | 7 +-
arch/powerpc/include/asm/kvm_host.h | 3 -
arch/powerpc/include/asm/kvm_ppc.h | 1 -
arch/powerpc/kvm/book3s.c | 12 +-
arch/powerpc/kvm/booke.c | 2 +-
arch/powerpc/kvm/e500.c | 6 +-
arch/powerpc/kvm/e500mc.c | 8 +-
arch/powerpc/kvm/powerpc.c | 20 -
arch/riscv/include/asm/kvm_host.h | 11 +-
arch/riscv/include/asm/kvm_vcpu_pmu.h | 107 ++++
arch/riscv/include/asm/kvm_vcpu_sbi.h | 13 +-
arch/riscv/include/asm/sbi.h | 7 +-
arch/riscv/kvm/Kconfig | 1 +
arch/riscv/kvm/Makefile | 1 +
arch/riscv/kvm/main.c | 26 +-
arch/riscv/kvm/mmu.c | 20 +-
arch/riscv/kvm/tlb.c | 4 +
arch/riscv/kvm/vcpu.c | 7 +
arch/riscv/kvm/vcpu_exit.c | 9 +
arch/riscv/kvm/vcpu_insn.c | 4 +-
arch/riscv/kvm/vcpu_pmu.c | 633 +++++++++++++++++++
arch/riscv/kvm/vcpu_sbi.c | 72 ++-
arch/riscv/kvm/vcpu_sbi_base.c | 27 +-
arch/riscv/kvm/vcpu_sbi_hsm.c | 28 +-
arch/riscv/kvm/vcpu_sbi_pmu.c | 86 +++
arch/riscv/kvm/vcpu_sbi_replace.c | 50 +-
arch/riscv/kvm/vcpu_sbi_v01.c | 17 +-
arch/riscv/kvm/vmid.c | 4 +-
arch/s390/include/asm/kvm_host.h | 1 -
arch/s390/kvm/gaccess.c | 109 ++++
arch/s390/kvm/gaccess.h | 3 +
arch/s390/kvm/interrupt.c | 13 +-
arch/s390/kvm/kvm-s390.c | 348 ++++++-----
arch/s390/kvm/kvm-s390.h | 2 +-
arch/s390/kvm/pci.c | 2 +-
arch/s390/kvm/pci.h | 2 +-
arch/x86/events/intel/core.c | 1 +
arch/x86/events/intel/ds.c | 4 +-
arch/x86/include/asm/cpufeatures.h | 3 +
arch/x86/include/asm/hyperv-tlfs.h | 3 +
arch/x86/include/asm/idtentry.h | 16 +-
arch/x86/include/asm/kvm-x86-ops.h | 2 +-
arch/x86/include/asm/kvm_host.h | 109 ++--
arch/x86/include/asm/reboot.h | 2 +
arch/x86/include/asm/virtext.h | 16 +-
arch/x86/include/asm/xen/hypervisor.h | 4 +-
arch/x86/include/uapi/asm/kvm.h | 34 +-
arch/x86/kernel/cpu/mshyperv.c | 2 +-
arch/x86/kernel/crash.c | 17 +-
arch/x86/kernel/nmi.c | 8 +-
arch/x86/kernel/reboot.c | 88 ++-
arch/x86/kernel/smp.c | 6 +-
arch/x86/kvm/Kconfig | 1 +
arch/x86/kvm/cpuid.c | 43 +-
arch/x86/kvm/debugfs.c | 2 +
arch/x86/kvm/emulate.c | 18 +-
arch/x86/kvm/hyperv.c | 85 ++-
arch/x86/kvm/hyperv.h | 27 +
arch/x86/kvm/i8254.c | 4 +-
arch/x86/kvm/i8259.c | 4 +-
arch/x86/kvm/ioapic.c | 1 +
arch/x86/kvm/irq.c | 1 +
arch/x86/kvm/irq_comm.c | 7 +-
arch/x86/kvm/kvm_cache_regs.h | 12 +
arch/x86/kvm/kvm_emulate.h | 7 +-
arch/x86/kvm/kvm_onhyperv.c | 1 +
arch/x86/kvm/lapic.c | 404 +++++++++----
arch/x86/kvm/lapic.h | 4 +
arch/x86/kvm/mmu.h | 6 +-
arch/x86/kvm/mmu/mmu.c | 320 ++++++----
arch/x86/kvm/mmu/mmu_internal.h | 22 +-
arch/x86/kvm/mmu/page_track.c | 1 +
arch/x86/kvm/mmu/paging_tmpl.h | 25 +-
arch/x86/kvm/mmu/spte.c | 10 +-
arch/x86/kvm/mmu/spte.h | 20 +-
arch/x86/kvm/mmu/tdp_iter.c | 12 +-
arch/x86/kvm/mmu/tdp_mmu.c | 20 +-
arch/x86/kvm/mmu/tdp_mmu.h | 25 +-
arch/x86/kvm/mtrr.c | 1 +
arch/x86/kvm/pmu.c | 290 +++++++--
arch/x86/kvm/pmu.h | 13 +-
arch/x86/kvm/reverse_cpuid.h | 7 +
arch/x86/kvm/smm.c | 3 +-
arch/x86/kvm/svm/avic.c | 374 +++++-------
arch/x86/kvm/svm/nested.c | 5 +-
arch/x86/kvm/svm/pmu.c | 4 +
arch/x86/kvm/svm/sev.c | 7 +-
arch/x86/kvm/svm/svm.c | 131 ++--
arch/x86/kvm/svm/svm.h | 58 +-
arch/x86/kvm/svm/svm_onhyperv.c | 1 +
arch/x86/kvm/svm/svm_onhyperv.h | 8 +-
arch/x86/kvm/vmx/capabilities.h | 4 +-
arch/x86/kvm/vmx/hyperv.c | 87 ++-
arch/x86/kvm/vmx/hyperv.h | 128 ++--
arch/x86/kvm/vmx/nested.c | 24 +-
arch/x86/kvm/vmx/pmu_intel.c | 28 +-
arch/x86/kvm/vmx/posted_intr.c | 2 +
arch/x86/kvm/vmx/sgx.c | 5 +-
arch/x86/kvm/vmx/vmcs.h | 4 +-
arch/x86/kvm/vmx/vmcs12.c | 1 +
arch/x86/kvm/vmx/vmenter.S | 80 +--
arch/x86/kvm/vmx/vmx.c | 624 ++++++++++---------
arch/x86/kvm/vmx/vmx.h | 18 +-
arch/x86/kvm/vmx/vmx_ops.h | 6 +-
arch/x86/kvm/x86.c | 557 +++++++++--------
arch/x86/kvm/x86.h | 18 +-
arch/x86/kvm/xen.c | 27 +
arch/x86/kvm/xen.h | 7 +
drivers/irqchip/irq-apple-aic.c | 53 +-
drivers/perf/riscv_pmu_sbi.c | 64 +-
drivers/s390/virtio/virtio_ccw.c | 46 +-
include/kvm/arm_arch_timer.h | 6 +-
include/kvm/arm_vgic.h | 4 +
include/linux/cpuhotplug.h | 5 +-
include/linux/kvm_host.h | 19 +-
include/linux/kvm_types.h | 2 +-
include/linux/perf/riscv_pmu.h | 5 +
include/uapi/linux/kvm.h | 9 +
tools/testing/selftests/kvm/Makefile | 4 +
.../selftests/kvm/aarch64/page_fault_test.c | 2 -
tools/testing/selftests/kvm/config | 1 +
.../testing/selftests/kvm/include/x86_64/hyperv.h | 149 +++--
.../selftests/kvm/include/x86_64/processor.h | 31 +-
.../testing/selftests/kvm/kvm_binary_stats_test.c | 21 +-
tools/testing/selftests/kvm/lib/elf.c | 2 +
tools/testing/selftests/kvm/lib/guest_modes.c | 2 +-
tools/testing/selftests/kvm/lib/kvm_util.c | 4 +-
tools/testing/selftests/kvm/lib/x86_64/processor.c | 46 +-
tools/testing/selftests/kvm/memslot_perf_test.c | 5 +-
tools/testing/selftests/kvm/s390x/memop.c | 672 ++++++++++++++++-----
.../kvm/x86_64/exit_on_emulation_failure_test.c | 3 -
.../selftests/kvm/x86_64/fix_hypercall_test.c | 4 +-
tools/testing/selftests/kvm/x86_64/hyperv_clock.c | 2 +-
.../kvm/x86_64/hyperv_extended_hypercalls.c | 97 +++
.../testing/selftests/kvm/x86_64/hyperv_features.c | 339 +++++++----
.../selftests/kvm/x86_64/mmio_warning_test.c | 2 +-
.../selftests/kvm/x86_64/pmu_event_filter_test.c | 385 +++++++++++-
tools/testing/selftests/kvm/x86_64/tsc_msrs_test.c | 16 +-
.../vmx_exception_with_invalid_guest_state.c | 2 +-
.../selftests/kvm/x86_64/xapic_state_test.c | 55 ++
.../testing/selftests/kvm/x86_64/xen_shinfo_test.c | 15 +-
virt/kvm/Kconfig | 3 +
virt/kvm/coalesced_mmio.c | 8 +-
virt/kvm/kvm_main.c | 297 ++++-----
200 files changed, 7274 insertions(+), 2928 deletions(-)
diff --cc arch/x86/include/asm/cpufeatures.h
index 389ea336258f,cdb7e1492311..000000000000
--- a/arch/x86/include/asm/cpufeatures.h
+++ b/arch/x86/include/asm/cpufeatures.h
@@@ -314,8 -312,9 +314,11 @@@
#define X86_FEATURE_AVX_VNNI (12*32+ 4) /* AVX VNNI instructions */
#define X86_FEATURE_AVX512_BF16 (12*32+ 5) /* AVX512 BFLOAT16 instructions */
#define X86_FEATURE_CMPCCXADD (12*32+ 7) /* "" CMPccXADD instructions */
+#define X86_FEATURE_ARCH_PERFMON_EXT (12*32+ 8) /* "" Intel Architectural PerfMon Extension */
+ #define X86_FEATURE_FZRM (12*32+10) /* "" Fast zero-length REP MOVSB */
+ #define X86_FEATURE_FSRS (12*32+11) /* "" Fast short REP STOSB */
+ #define X86_FEATURE_FSRC (12*32+12) /* "" Fast short REP {CMPSB,SCASB} */
+#define X86_FEATURE_LKGS (12*32+18) /* "" Load "kernel" (userspace) GS */
#define X86_FEATURE_AMX_FP16 (12*32+21) /* "" AMX fp16 Support */
#define X86_FEATURE_AVX_IFMA (12*32+23) /* "" Support for VPMADD52[H,L]UQ */
diff --cc arch/x86/kvm/reverse_cpuid.h
index 81f4e9ce0c77,4945456fd646..000000000000
--- a/arch/x86/kvm/reverse_cpuid.h
+++ b/arch/x86/kvm/reverse_cpuid.h
@@@ -68,7 -72,7 +72,8 @@@ static const struct cpuid_reg reverse_c
[CPUID_12_EAX] = {0x00000012, 0, CPUID_EAX},
[CPUID_8000_001F_EAX] = {0x8000001f, 0, CPUID_EAX},
[CPUID_7_1_EDX] = { 7, 1, CPUID_EDX},
+ [CPUID_8000_0007_EDX] = {0x80000007, 0, CPUID_EDX},
+ [CPUID_8000_0021_EAX] = {0x80000021, 0, CPUID_EAX},
};
/*