]> git.baikalelectronics.ru Git - kernel.git/commit
x86/mm: Reinitialize TLB state on hotplug and resume
authorAndy Lutomirski <luto@kernel.org>
Thu, 7 Sep 2017 02:54:53 +0000 (19:54 -0700)
committerLinus Torvalds <torvalds@linux-foundation.org>
Thu, 7 Sep 2017 03:12:57 +0000 (20:12 -0700)
commit61b4fe59f7f4db51e5e2e8ca1ca7b11166a317b6
treec7ccad396f1c6aa6d0a647cd75a2c9b50406ba8f
parent8c03a4658df3a76adae2c026518edd7ee9a3dbfa
x86/mm: Reinitialize TLB state on hotplug and resume

When Linux brings a CPU down and back up, it switches to init_mm and then
loads swapper_pg_dir into CR3.  With PCID enabled, this has the side effect
of masking off the ASID bits in CR3.

This can result in some confusion in the TLB handling code.  If we
bring a CPU down and back up with any ASID other than 0, we end up
with the wrong ASID active on the CPU after resume.  This could
cause our internal state to become corrupt, although major
corruption is unlikely because init_mm doesn't have any user pages.
More obviously, if CONFIG_DEBUG_VM=y, we'll trip over an assertion
in the next context switch.  The result of *that* is a failure to
resume from suspend with probability 1 - 1/6^(cpus-1).

Fix it by reinitializing cpu_tlbstate on resume and CPU bringup.

Reported-by: Linus Torvalds <torvalds@linux-foundation.org>
Reported-by: Jiri Kosina <jikos@kernel.org>
Fixes: 0b6af6bfbadb ("x86/mm: Implement PCID based optimization: try to preserve old TLB entries using PCID")
Signed-off-by: Andy Lutomirski <luto@kernel.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
arch/x86/include/asm/tlbflush.h
arch/x86/kernel/cpu/common.c
arch/x86/mm/tlb.c
arch/x86/power/cpu.c