← Back to team overview

kernel-packages team mailing list archive

[Bug 1350522] Re: EC2 kernel crash due to vmalloc

 

I'm running ubuntu 14.04 on Jiffybox, a German ec2 alternative. Due to
an unrelated problem with the 3.13 kernel (see
https://www.df.eu/forum/threads/72787-CONFIG_FHANDLE-Support-im-Jiffy-
Kernel?highlight=kernel if curious), it is not possible to use the stock
kernel: it will not boot. After installing the kernel from
http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.16-utopic/ the system
successfully boots, which is a great improvement on the earlier state.
However, it is not able to insert any modules and gives the same error
messages as quoted above.

More info:

root@localhost:~# dmesg | grep "Xen version"
[    0.000000] Xen version: 3.1.2-308.8.2.el5 (preserve-AD)

sample error message from dmesg:

[    4.244198] ------------[ cut here ]------------
[    4.244213] WARNING: CPU: 0 PID: 404 at /home/apw/COD/linux/mm/vmalloc.c:128 vmap_pte_range+0x13d/0x170()
[    4.244215] Modules linked in:
[    4.244220] CPU: 0 PID: 404 Comm: systemd-udevd Tainted: G        W     3.16.0-031600-generic #201408031935
[    4.244222]  0000000000000080 ffff8800f3f8fb38 ffffffff81786525 000000000000546e
[    4.244225]  0000000000000000 ffff8800f3f8fb78 ffffffff8107207c ffffffff81005719
[    4.244228]  ffff8800057417a0 ffffffffc00f4000 ffff8800f3f8fc94 0000000000000163
[    4.244230] Call Trace:
[    4.244235]  [<ffffffff81786525>] dump_stack+0x46/0x58
[    4.244238]  [<ffffffff8107207c>] warn_slowpath_common+0x8c/0xc0
[    4.244242]  [<ffffffff81005719>] ? __raw_callee_save_xen_pmd_val+0x11/0x1e
[    4.244250]  [<ffffffff810720ca>] warn_slowpath_null+0x1a/0x20
[    4.244255]  [<ffffffff811a8dfd>] vmap_pte_range+0x13d/0x170
[    4.244259]  [<ffffffff8100a9be>] ? xen_pud_val+0xe/0x10
[    4.244262]  [<ffffffff811a8f52>] vmap_pud_range+0x122/0x1c0
[    4.244266]  [<ffffffff811a9086>] vmap_page_range_noflush+0x96/0xc0
[    4.244269]  [<ffffffff811a90e1>] map_vm_area+0x31/0x50
[    4.244272]  [<ffffffff811aa180>] __vmalloc_area_node+0x130/0x1e0
[    4.244275]  [<ffffffff811a9e06>] __vmalloc_node_range+0x86/0xd0
[    4.244278]  [<ffffffff810f41fd>] ? module_alloc_update_bounds+0x1d/0x80
[    4.244282]  [<ffffffff810f41fd>] ? module_alloc_update_bounds+0x1d/0x80
[    4.244286]  [<ffffffff81055454>] module_alloc+0x74/0xd0
[    4.244289]  [<ffffffff810f41fd>] ? module_alloc_update_bounds+0x1d/0x80
[    4.244291]  [<ffffffff810f41fd>] module_alloc_update_bounds+0x1d/0x80
[    4.244294]  [<ffffffff810f4287>] move_module+0x27/0x1c0
[    4.244297]  [<ffffffff810f44d6>] layout_and_allocate+0xa6/0xd0
[    4.244299]  [<ffffffff810f46fa>] load_module+0x12a/0x5f0
[    4.244302]  [<ffffffff810f4d6e>] SyS_finit_module+0xae/0xd0
[    4.244306]  [<ffffffff81793fad>] system_call_fastpath+0x1a/0x1f
[    4.244308] ---[ end trace e313b695aad8c05b ]---

root@localhost:~# lsmod
Module                  Size  Used by

root@localhost:~# free -m
             total       used       free     shared    buffers     cached
Mem:          3998        483       3515          0         16        393
-/+ buffers/cache:         73       3925
Swap:          511          0        511

obviously, I would be grateful for any hints on how to proceed!

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1350522

Title:
  EC2 kernel crash due to vmalloc

Status in “linux” package in Ubuntu:
  Confirmed
Status in “linux” source package in Utopic:
  Confirmed

Bug description:
  During Alpha-2 automated testing, I saw the following in a log:

  19:35:02  [    2.475810] systemd-udevd[95]: starting version 204
  19:35:02  [    2.547049] ------------[ cut here ]------------
  19:35:02  [    2.547065] WARNING: CPU: 0 PID: 97 at /build/buildd/linux-3.16.0/mm/vmalloc.c:128 vmap_page_range_noflush+0x2d1/0x370()
  19:35:02  [    2.547069] Modules linked in:
  19:35:02  [    2.547073] CPU: 0 PID: 97 Comm: systemd-udevd Not tainted 3.16.0-6-generic #11-Ubuntu
  19:35:02  [    2.547077]  0000000000000009 ffff880002defb98 ffffffff81755538 0000000000000000
  19:35:02  [    2.547082]  ffff880002defbd0 ffffffff8106bb0d ffff88000400ec88 0000000000000001
  19:35:02  [    2.547086]  ffff880002fcfb00 ffffffffc0391000 0000000000000000 ffff880002defbe0
  19:35:02  [    2.547090] Call Trace:
  19:35:02  [    2.547096]  [<ffffffff81755538>] dump_stack+0x45/0x56
  19:35:02  [    2.547101]  [<ffffffff8106bb0d>] warn_slowpath_common+0x7d/0xa0
  19:35:02  [    2.547104]  [<ffffffff8106bbea>] warn_slowpath_null+0x1a/0x20
  19:35:02  [    2.547108]  [<ffffffff81197c31>] vmap_page_range_noflush+0x2d1/0x370
  19:35:02  [    2.547112]  [<ffffffff81197cfe>] map_vm_area+0x2e/0x40
  19:35:02  [    2.547115]  [<ffffffff8119a058>] __vmalloc_node_range+0x188/0x280
  19:35:02  [    2.547120]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547124]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547129]  [<ffffffff8104f294>] module_alloc+0x74/0xd0
  19:35:02  [    2.547132]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547135]  [<ffffffff810e92b4>] module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547146]  [<ffffffff810e9a6c>] layout_and_allocate+0x74c/0xc70
  19:35:02  [    2.547149]  [<ffffffff810ea063>] load_module+0xd3/0x1b70
  19:35:02  [    2.547154]  [<ffffffff811cfeb1>] ? vfs_read+0xf1/0x170
  19:35:02  [    2.547157]  [<ffffffff810e7aa1>] ? copy_module_from_fd.isra.46+0x121/0x180
  19:35:02  [    2.547161]  [<ffffffff810ebc76>] SyS_finit_module+0x86/0xb0
  19:35:02  [    2.547167]  [<ffffffff8175de7f>] tracesys+0xe1/0xe6
  19:35:02  [    2.547169] ---[ end trace 8a5de7fc66e75fe4 ]---
  19:35:02  [    2.547172] vmalloc: allocation failure, allocated 20480 of 24576 bytes
  19:35:02  [    2.547175] systemd-udevd: page allocation failure: order:0, mode:0xd2
  19:35:02  [    2.547180] CPU: 0 PID: 97 Comm: systemd-udevd Tainted: G        W     3.16.0-6-generic #11-Ubuntu
  19:35:02  [    2.547183]  ffffffff81a88bc0 ffff880002defc08 ffffffff81755538 00000000000000d2
  19:35:02  [    2.547187]  ffff880002defc90 ffffffff811642bf ffffffff81a88bc0 ffff880002defc28
  19:35:02  [    2.547191]  00003fff00000018 ffff880002defca0 ffff880002defc40 0000000000000163
  19:35:02  [    2.547195] Call Trace:
  19:35:02  [    2.547197]  [<ffffffff81755538>] dump_stack+0x45/0x56
  19:35:02  [    2.547202]  [<ffffffff811642bf>] warn_alloc_failed+0xdf/0x130
  19:35:02  [    2.547207]  [<ffffffff8119a118>] __vmalloc_node_range+0x248/0x280
  19:35:02  [    2.547210]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547214]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547217]  [<ffffffff8104f294>] module_alloc+0x74/0xd0
  19:35:02  [    2.547220]  [<ffffffff810e92b4>] ? module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547224]  [<ffffffff810e92b4>] module_alloc_update_bounds+0x14/0x70
  19:35:02  [    2.547229]  [<ffffffff810e9a6c>] layout_and_allocate+0x74c/0xc70
  19:35:02  [    2.547232]  [<ffffffff810ea063>] load_module+0xd3/0x1b70
  19:35:02  [    2.547235]  [<ffffffff811cfeb1>] ? vfs_read+0xf1/0x170
  19:35:02  [    2.547238]  [<ffffffff810e7aa1>] ? copy_module_from_fd.isra.46+0x121/0x180
  19:35:02  [    2.547242]  [<ffffffff810ebc76>] SyS_finit_module+0x86/0xb0
  19:35:02  [    2.547246]  [<ffffffff8175de7f>] tracesys+0xe1/0xe6
  19:35:02  [    2.547248] Mem-Info:
  --- 
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Jul 30 20:19 seq
   crw-rw---- 1 root audio 116, 33 Jul 30 20:19 timer
  AplayDevices: Error: [Errno 2] No such file or directory
  ApportVersion: 2.14.4-0ubuntu2
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory
  CurrentDmesg:
   [   42.901579] systemd-logind[1378]: New seat seat0.
   [   42.932887] systemd-logind[1378]: New session 1 of user ubuntu.
  DistroRelease: Ubuntu 14.10
  Ec2AMI: ami-c571d8d8
  Ec2AMIManifest: (unknown)
  Ec2AvailabilityZone: sa-east-1b
  Ec2InstanceType: m3.medium
  Ec2Kernel: aki-5553f448
  Ec2Ramdisk: unavailable
  IwConfig: Error: [Errno 2] No such file or directory
  Lspci:
   
  Lsusb: Error: command ['lsusb'] failed with exit code 1: unable to initialize libusb: -99
  Package: linux-image-virtual 3.16.0.5.6
  PackageArchitecture: amd64
  PciMultimedia:
   
  ProcFB:
   
  ProcKernelCmdLine: root=LABEL=cloudimg-rootfs ro console=hvc0
  ProcModules:
   
  ProcVersionSignature: User Name 3.16.0-5.10-generic 3.16.0-rc6
  RelatedPackageVersions:
   linux-restricted-modules-3.16.0-5-generic N/A
   linux-backports-modules-3.16.0-5-generic  N/A
   linux-firmware                            N/A
  RfKill: Error: [Errno 2] No such file or directory
  Tags: utopic ec2-images third-party-packages
  Uname: Linux 3.16.0-5-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups: adm audio cdrom dialout dip floppy netdev plugdev sudo video
  _MarkForUpload: True
  --- 
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Jul 31 20:13 seq
   crw-rw---- 1 root audio 116, 33 Jul 31 20:13 timer
  AplayDevices: Error: [Errno 2] No such file or directory
  ApportVersion: 2.14.5-0ubuntu1
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory
  CurrentDmesg:
   [   17.975584] systemd-logind[1248]: New seat seat0.
   [   17.993902] systemd-logind[1248]: New session 1 of user ubuntu.
  DistroRelease: Ubuntu 14.10
  Ec2AMI: ami-b7ce1dc0
  Ec2AMIManifest: (unknown)
  Ec2AvailabilityZone: eu-west-1c
  Ec2InstanceType: m3.medium
  Ec2Kernel: aki-52a34525
  Ec2Ramdisk: unavailable
  IwConfig: Error: [Errno 2] No such file or directory
  Lspci:
   
  Lsusb: Error: command ['lsusb'] failed with exit code 1: unable to initialize libusb: -99
  Package: linux-image-virtual 3.16.0.6.7
  PackageArchitecture: amd64
  PciMultimedia:
   
  ProcFB:
   
  ProcKernelCmdLine: root=LABEL=cloudimg-rootfs ro console=hvc0 initcall_debug debug ignore_loglevel LOGLEVEL=8
  ProcModules:
   
  ProcVersionSignature: Ubuntu 3.16.0-6.11-generic 3.16.0-rc7
  RelatedPackageVersions:
   linux-restricted-modules-3.16.0-6-generic N/A
   linux-backports-modules-3.16.0-6-generic  N/A
   linux-firmware                            N/A
  RfKill: Error: [Errno 2] No such file or directory
  Tags:  utopic ec2-images
  Uname: Linux 3.16.0-6-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  _MarkForUpload: True

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1350522/+subscriptions


References