kernel-packages team mailing list archive
-
kernel-packages team
-
Mailing list archive
-
Message #175257
[Bug 1573231] Re: Kernel Panic on EC2 After Upgrading from 14.04 to 16.04 via do-release-upgrade -d
According to my bisect this commit is responsible:
commit 8ae10f463b7ae3455e9d0507176349c76580995f
Author: Vikas Shivappa <vikas.shivappa@xxxxxxxxxxxxxxx>
Date: Thu Mar 10 15:32:09 2016 -0800
perf/x86/mbm: Add Intel Memory B/W Monitoring enumeration and init
BugLink: http://bugs.launchpad.net/bugs/1397880
The MBM init patch enumerates the Intel MBM (Memory b/w monitoring)
and initializes the perf events and datastructures for monitoring the
memory b/w.
Its based on original patch series by Tony Luck and Kanaka Juvva.
Memory bandwidth monitoring (MBM) provides OS/VMM a way to monitor
bandwidth from one level of cache to another. The current patches
support L3 external bandwidth monitoring. It supports both 'local
bandwidth' and 'total bandwidth' monitoring for the socket. Local
bandwidth measures the amount of data sent through the memory controller
on the socket and total b/w measures the total system bandwidth.
Extending the cache quality of service monitoring (CQM) we add two
more events to the perf infrastructure:
intel_cqm_llc/local_bytes - bytes sent through local socket memory controller
intel_cqm_llc/total_bytes - total L3 external bytes sent
The tasks are associated with a Resouce Monitoring ID (RMID) just like
in CQM and OS uses a MSR write to indicate the RMID of the task during
scheduling.
Signed-off-by: Vikas Shivappa <vikas.shivappa@xxxxxxxxxxxxxxx>
Signed-off-by: Peter Zijlstra (Intel) <peterz@xxxxxxxxxxxxx>
Reviewed-by: Tony Luck <tony.luck@xxxxxxxxx>
Acked-by: Thomas Gleixner <tglx@xxxxxxxxxxxxx>
Cc: Alexander Shishkin <alexander.shishkin@xxxxxxxxxxxxxxx>
Cc: Andy Lutomirski <luto@xxxxxxxxxxxxxx>
Cc: Arnaldo Carvalho de Melo <acme@xxxxxxxxxx>
Cc: Borislav Petkov <bp@xxxxxxxxx>
Cc: Brian Gerst <brgerst@xxxxxxxxx>
Cc: David Ahern <dsahern@xxxxxxxxx>
Cc: Denys Vlasenko <dvlasenk@xxxxxxxxxx>
Cc: H. Peter Anvin <hpa@xxxxxxxxx>
Cc: Jiri Olsa <jolsa@xxxxxxxxxx>
Cc: Linus Torvalds <torvalds@xxxxxxxxxxxxxxxxxxxx>
Cc: Matt Fleming <matt@xxxxxxxxxxxxxxxxxxx>
Cc: Namhyung Kim <namhyung@xxxxxxxxxx>
Cc: Peter Zijlstra <peterz@xxxxxxxxxxxxx>
Cc: Stephane Eranian <eranian@xxxxxxxxxx>
Cc: Vince Weaver <vincent.weaver@xxxxxxxxx>
Cc: fenghua.yu@xxxxxxxxx
Cc: h.peter.anvin@xxxxxxxxx
Cc: ravi.v.shankar@xxxxxxxxx
Cc: vikas.shivappa@xxxxxxxxx
Link: http://lkml.kernel.org/r/1457652732-4499-4-git-send-email-vikas.shivappa@xxxxxxxxxxxxxxx
Signed-off-by: Ingo Molnar <mingo@xxxxxxxxxx>
(back ported from commit 33c3cc7acfd95968d74247f1a4e1b0727a07ed43)
Signed-off-by: Tim Gardner <tim.gardner@xxxxxxxxxxxxx>
Conflicts:
arch/x86/kernel/cpu/common.c
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1573231
Title:
Kernel Panic on EC2 After Upgrading from 14.04 to 16.04 via do-
release-upgrade -d
Status in linux package in Ubuntu:
Confirmed
Status in linux source package in Xenial:
Confirmed
Bug description:
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 4.4.0-21-generic (buildd@lgw01-21) (gcc version 5.3.1 20160413 (Ubuntu 5.3.1-14ubuntu2) ) #37-Ubuntu SMP Mon Apr 18 18:33:37 UTC 2016 (Ubuntu 4.4.0-21.37-generic 4.4.6)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-21-generic root=UUID=8ea401db-b84b-4cd6-a628-d72f30bbf1e5 ro console=tty1 console=ttyS0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x04: 'AVX registers'
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] x86/fpu: Using 'eager' FPU context switches.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000efffffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001efffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.4 present.
[ 0.000000] Hypervisor detected: Xen
[ 0.000000] Xen version 4.2.
[ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[ 0.000000] You might have to change the root device
[ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[ 0.000000] in your root= kernel command line option
[ 0.000000] e820: last_pfn = 0x1f0000 max_arch_pfn = 0x400000000
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0xf0000 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fbba0-0x000fbbaf] mapped at [ffff8800000fbba0]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] RAMDISK: [mem 0x3407e000-0x36036fff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen )
[ 0.000000] ACPI: XSDT 0x00000000FC00F5A0 000054 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: FACP 0x00000000FC00F260 0000F4 (v04 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: DSDT 0x00000000FC0035E0 00BBF6 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[ 0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[ 0.000000] ACPI: APIC 0x00000000FC00F360 0000D8 (v02 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: HPET 0x00000000FC00F4B0 000038 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: WAET 0x00000000FC00F4F0 000028 (v01 Xen HVM 00000000 HVML 00000000)
[ 0.000000] ACPI: SSDT 0x00000000FC00F520 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] ACPI: SSDT 0x00000000FC00F560 000031 (v02 Xen HVM 00000000 INTL 20090123)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x00000001efffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x1efff7000-0x1efffbfff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x00000001efffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009dfff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x00000000efffffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x00000001efffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x00000001efffffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0xb008
[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.000000] smpboot: Allowing 15 CPUs, 13 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfbffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xffffffff]
[ 0.000000] e820: [mem 0xf0000000-0xfbffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on Xen HVM
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:15 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff8801e7a00000 s98008 r8192 d28968 u262144
[ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1935240
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-21-generic root=UUID=8ea401db-b84b-4cd6-a628-d72f30bbf1e5 ro console=tty1 console=ttyS0
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Memory: 7621704K/7863924K available (8356K kernel code, 1278K rwdata, 3920K rodata, 1476K init, 1292K bss, 242220K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=15.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15
[ 0.000000] NR_IRQS:16640 nr_irqs:952 16
[ 0.000000] xen:events: Using 2-level ABI
[ 0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty1] enabled
[ 0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[ 0.000000] console [ttyS0] enabled
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[ 0.000000] tsc: Detected 2500.038 MHz processor
[ 0.012000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5000.07 BogoMIPS (lpj=10000152)
[ 0.016003] pid_max: default: 32768 minimum: 301
[ 0.020008] ACPI: Core revision 20150930
[ 0.029145] ACPI: 3 ACPI AML tables successfully acquired and loaded
[ 0.032827] Security Framework initialized
[ 0.036002] Yama: becoming mindful.
[ 0.040021] AppArmor: AppArmor initialized
[ 0.044434] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.053113] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.056758] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[ 0.064010] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[ 0.068206] Initializing cgroup subsys io
[ 0.072005] Initializing cgroup subsys memory
[ 0.076009] Initializing cgroup subsys devices
[ 0.080004] Initializing cgroup subsys freezer
[ 0.082912] Initializing cgroup subsys net_cls
[ 0.084004] Initializing cgroup subsys perf_event
[ 0.088004] Initializing cgroup subsys net_prio
[ 0.092004] Initializing cgroup subsys hugetlb
[ 0.095088] Initializing cgroup subsys pids
[ 0.096059] CPU: Physical Processor ID: 0
[ 0.100763] mce: CPU supports 2 MCE banks
[ 0.104024] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[ 0.108002] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[ 0.113286] Freeing SMP alternatives memory: 28K (ffffffff820b2000 - ffffffff820b9000)
[ 0.125920] ftrace: allocating 31878 entries in 125 pages
[ 0.160059] divide error: 0000 [#1] SMP
[ 0.163586] Modules linked in:
[ 0.164000] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.4.0-21-generic #37-Ubuntu
[ 0.164000] Hardware name: Xen HVM domU, BIOS 4.2.amazon 12/07/2015
[ 0.164000] task: ffff8801e6618000 ti: ffff8801e6620000 task.ti: ffff8801e6620000
[ 0.164000] RIP: 0010:[<ffffffff81f6f5de>] [<ffffffff81f6f5de>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.164000] RSP: 0000:ffff8801e6623ea8 EFLAGS: 00010286
[ 0.164000] RAX: 000000000000000e RBX: ffffffff81f34f60 RCX: 0000000000000000
[ 0.164000] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8801e7a0a180
[ 0.164000] RBP: ffff8801e6623ec8 R08: 0000000000000000 R09: 0000000000007fff
[ 0.164000] R10: ffffffff81a11ee0 R11: ffffffff81a11ec0 R12: 00000000ffffffff
[ 0.164000] R13: 000000000000a0a0 R14: 000000000000a192 R15: 0000000000000000
[ 0.164000] FS: 0000000000000000(0000) GS:ffff8801e7a00000(0000) knlGS:0000000000000000
[ 0.164000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 0.164000] CR2: ffff8801effff000 CR3: 0000000001e0a000 CR4: 00000000001406f0
[ 0.164000] Stack:
[ 0.164000] ffffffff81f34f60 0000000000000100 000000000000a0a0 0000000000000000
[ 0.164000] ffff8801e6623ef8 ffffffff81f6f763 ffffffff82089ef8 ffff8801e66186a8
[ 0.164000] 0000000000000001 0000000000000000 ffff8801e6623f08 ffffffff81f64e10
[ 0.164000] Call Trace:
[ 0.164000] [<ffffffff81f6f763>] native_smp_prepare_cpus+0x57/0x2eb
[ 0.164000] [<ffffffff81f64e10>] xen_hvm_smp_prepare_cpus+0x9/0x2e
[ 0.164000] [<ffffffff81f5a0e5>] kernel_init_freeable+0xb3/0x212
[ 0.164000] [<ffffffff81817f30>] ? rest_init+0x80/0x80
[ 0.164000] [<ffffffff81817f3e>] kernel_init+0xe/0xe0
[ 0.164000] [<ffffffff8182488f>] ret_from_fork+0x3f/0x70
[ 0.164000] [<ffffffff81817f30>] ? rest_init+0x80/0x80
[ 0.164000] Code: 53 41 83 cc ff 49 c7 c6 92 a1 00 00 48 89 c7 f3 a5 66 c7 80 da 00 00 00 00 00 0f b7 35 b4 36 fc ff 8b 05 16 88 27 00 8d 44 06 ff <f7> f6 31 d2 89 05 78 4a fc ff 8d 86 ff 7f 00 00 f7 f6 be c0 00
[ 0.164000] RIP [<ffffffff81f6f5de>] smp_store_boot_cpu_info+0x51/0x17f
[ 0.164000] RSP <ffff8801e6623ea8>
[ 0.336005] ---[ end trace 1a9aebc980234339 ]---
[ 0.340017] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
[ 0.340017]
System won't boot at all, so there's a limit to the additional information I can get, but if nothing can be done from the above, let me know what/how to provide additional information needed. Thanks!
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1573231/+subscriptions
