← Back to team overview

kernel-packages team mailing list archive

[Bug 1522388] ProcModules.txt

 

apport information

** Attachment added: "ProcModules.txt"
   https://bugs.launchpad.net/bugs/1522388/+attachment/4529323/+files/ProcModules.txt

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1522388

Title:
  Soft Lockup - CPU Stuck

Status in linux package in Ubuntu:
  Confirmed

Bug description:
  The Server was running:
  * openstack icehouse
  * Linux  3.13.0-48-generic #80-Ubuntu SMP Thu Mar 12 11:16:15 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux(Ubuntu 3.13.0-48.80-generic 3.13.11-ckt16)

  
  The kernel log:

  [13551520.909322] BUG: soft lockup - CPU#4 stuck for 23s! [migration/4:76]
  [13551520.909357] Modules linked in: vhost_net vhost macvtap macvlan nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev veth ipt_MASQUERA
  DE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge ip6table_filter ip6_ta
  bles iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_is
  csi openvswitch gre vxlan ip_tunnel dm_crypt usb_storage gpio_ich joydev dm_multipath scsi_dh intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul c
  rc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd serio_raw ipmi_si sb_edac edac_core mei_me mei lpc_ich shpchp mac_hid k
  vm_intel kvm 8021q garp stp mrp llc lp parport btrfs xor hid_generic usbhid hid raid6_pq libcrc32c ses enclosure ast syscopyarea sysfillrect sysimgblt ttm psmouse drm_kms
  _helper isci drm igb ahci libsas dca libahci ptp pps_core scsi_transport_sas i2c_algo_bit megaraid_sas wmi
  [13551520.909377] CPU: 4 PID: 76 Comm: migration/4 Tainted: G      D W     3.13.0-48-generic #80-Ubuntu
  [13551520.909378] Hardware name: ASUSTek Computer INC. RS720-E7-RS12-E/Z9PE-D16 Series, BIOS 5302 11/08/2013
  [13551520.909379] task: ffff881029391800 ti: ffff88102938c000 task.ti: ffff88102938c000
  [13551520.909386] RIP: 0010:[<ffffffff810f61cb>]  [<ffffffff810f61cb>] multi_cpu_stop+0x6b/0xf0
  [13551520.909387] RSP: 0018:ffff88102938dd98  EFLAGS: 00000293
  [13551520.909388] RAX: ffffffff8180ae00 RBX: ffff88103fc934c0 RCX: 0000000000007c34
  [13551520.909389] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff881083bd37b8
  [13551520.909390] RBP: ffff88102938ddb8 R08: 0000000000000282 R09: 0000000000000001
  [13551520.909391] R10: 000000000000b590 R11: 0000000000000000 R12: ffff88102938dd20
  [13551520.909392] R13: ffff88035499e000 R14: ffffffff81098235 R15: ffff88035499e000
  [13551520.909394] FS:  0000000000000000(0000) GS:ffff88103fc80000(0000) knlGS:0000000000000000
  [13551520.909395] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  [13551520.909396] CR2: 00007f0206b09000 CR3: 00000008ee4ad000 CR4: 00000000000427e0
  [13551520.909397] Stack:
  [13551520.909401]  ffff881083bd37e0 ffff88103fc8de20 ffff88103fc8de28 ffff881083bd37b8
  [13551520.909404]  ffff88102938de78 ffffffff810f63de 0000000000000000 0000000000000000
  [13551520.909408]  ffff88103fc934c0 ffff881024f38700 0000000000000000 ffff88103fc934c0
  [13551520.909409] Call Trace:
  [13551520.909413]  [<ffffffff810f63de>] cpu_stopper_thread+0x7e/0x150
  [13551520.909418]  [<ffffffff817254a1>] ? __schedule+0x381/0x7d0
  [13551520.909423]  [<ffffffff810928cf>] smpboot_thread_fn+0xff/0x1b0
  [13551520.909426]  [<ffffffff810927d0>] ? SyS_setgroups+0x180/0x180
  [13551520.909429]  [<ffffffff8108b5b2>] kthread+0xd2/0xf0
  [13551520.909432]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [13551520.909436]  [<ffffffff81731f0c>] ret_from_fork+0x7c/0xb0
  [13551520.909439]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [13551520.909459] Code: 31 f6 31 d2 eb 23 66 2e 0f 1f 84 00 00 00 00 00 83 fb 03 75 05 45 84 ed 75 66 f0 41 ff 4c 24 24 74 26 89 da 83 fa
   04 74 3d f3 90 <41> 8b 5c 24 20 39 d3 74 f0 83 fb 02 75 d7 fa 66 66 90 66 66 90 
  [13551520.971633]  [<ffffffff81184b76>] try_to_unmap_one+0x36/0x480
  [13551520.973089]  [<ffffffff81186556>] ? rmap_walk+0x186/0x210
  [13551520.974528]  [<ffffffff81185d77>] try_to_unmap_anon+0xa7/0x120
  [13551520.975958]  [<ffffffff81185e3d>] try_to_unmap+0x4d/0x60
  [13551520.977372]  [<ffffffff811a88fe>] migrate_pages+0x43e/0x780
  [13551520.978769]  [<ffffffff81171bb0>] ? isolate_freepages_block+0x310/0x310
  [13551520.980165]  [<ffffffff81172bb9>] compact_zone+0x299/0x410
  [13551520.981549]  [<ffffffff81172dbe>] compact_zone_order+0x8e/0xd0
  [13551520.982916]  [<ffffffff81173111>] try_to_compact_pages+0x101/0x180
  [13551520.984279]  [<ffffffff8171c1a3>] __alloc_pages_direct_compact+0xac/0x196
  [13551520.985641]  [<ffffffff81159160>] __alloc_pages_nodemask+0x760/0xb80
  [13551520.986971]  [<ffffffff81199d9a>] alloc_pages_vma+0x9a/0x140
  [13551520.988267]  [<ffffffff811ad62b>] do_huge_pmd_anonymous_page+0x10b/0x3f0
  [13551520.989540]  [<ffffffff8136aa2f>] ? __rb_insert_augmented+0x8f/0x1f0
  [13551520.990779]  [<ffffffff81179c48>] handle_mm_fault+0x198/0xf10
  [13551520.991984]  [<ffffffff8117ec97>] ? vma_link+0xb7/0xc0
  [13551520.993153]  [<ffffffff8172d534>] __do_page_fault+0x184/0x560
  [13551520.994289]  [<ffffffff8118166e>] ? do_mmap_pgoff+0x34e/0x3d0
  [13551520.995387]  [<ffffffff8116bcf9>] ? vm_mmap_pgoff+0x99/0xc0
  [13551520.996443]  [<ffffffff8172d92a>] do_page_fault+0x1a/0x70
  [13551520.997476]  [<ffffffff8107aaa7>] ? sigprocmask+0x57/0x90
  [13551520.998481]  [<ffffffff81729d68>] page_fault+0x28/0x30
  [13551520.999462] Code: 55 48 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c
   0f 1f 44 00 00 <f3> 90 83 e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 

  [13551521.013327] BUG: soft lockup - CPU#6 stuck for 22s! [qemu-system-x86:14068]
  [13551521.014492] Modules linked in: vhost_net vhost macvtap macvlan nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev veth ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi openvswitch gre vxlan ip_tunnel dm_crypt usb_storage gpio_ich joydev dm_multipath scsi_dh intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd serio_raw ipmi_si sb_edac edac_core mei_me mei lpc_ich shpchp mac_hid kvm_intel kvm 8021q garp stp mrp llc lp parport btrfs xor hid_generic usbhid hid raid6_pq libcrc32c ses enclosure ast syscopyarea sysfillrect sysimgblt ttm psmouse drm_kms
  _helper isci drm igb ahci libsas dca libahci ptp pps_core scsi_transport_sas i2c_algo_bit megaraid_sas wmi
  [13551521.025305] CPU: 6 PID: 14068 Comm: qemu-system-x86 Tainted: G      D W     3.13.0-48-generic #80-Ubuntu
  [13551521.026588] Hardware name: ASUSTek Computer INC. RS720-E7-RS12-E/Z9PE-D16 Series, BIOS 5302 11/08/2013
  [13551521.027894] task: ffff88109083b000 ti: ffff8810ed20a000 task.ti: ffff8810ed20a000
  [13551521.029199] RIP: 0010:[<ffffffff810dbf92>]  [<ffffffff810dbf92>] generic_exec_single+0x82/0xb0
  [13551521.030529] RSP: 0000:ffff8810ed20ba20  EFLAGS: 00000202
  [13551521.031854] RAX: 0000000000000100 RBX: 0000000000000286 RCX: 0000000000000004
  [13551521.033195] RDX: ffff88207fc0ce20 RSI: 0000000000000000 RDI: 0000000000000286
  [13551521.034536] RBP: ffff8810ed20ba50 R08: ffff88207fc0ce08 R09: 0000000000000004
  [13551521.035878] R10: ffff88207fff8f00 R11: ffffea0059bee9e0 R12: ffff8810ed20b9f0
  [13551521.037224] R13: ffff88207fc0ce00 R14: 0000000000000040 R15: ffffffff813645f0
  [13551521.038569] FS:  00007fbb42ffd700(0000) GS:ffff88207fc00000(0000) knlGS:0000000000000000
  [13551521.039932] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  [13551521.041271] CR2: 00007fbb6ea50000 CR3: 00000006fc224000 CR4: 00000000000427e0
  [13551521.042599] Stack:
  [13551521.043897]  ffff88103fc73f80 0000000000000003 0000000000000006 ffffffff81d14380
  [13551521.045245]  ffffffff8105c7a0 0000000000000301 ffff8810ed20bac8 ffffffff810dc0a5
  [13551521.046593]  ffff88207fffb040 ffff88207fff8f68 ffff88103fc77710 ffff88103fc73f80
  [13551521.047954] Call Trace:
  [13551521.049305]  [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
  [13551521.050663]  [<ffffffff810dc0a5>] smp_call_function_single+0xe5/0x190
  [13551521.052027]  [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
  [13551521.053394]  [<ffffffff810dc4d6>] smp_call_function_many+0x286/0x2d0
  [13551521.054765]  [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
  [13551521.056130]  [<ffffffff8105c8f7>] native_flush_tlb_others+0x37/0x40
  [13551521.057503]  [<ffffffff8105cbf6>] flush_tlb_page+0x56/0xa0
  [13551521.058873]  [<ffffffff8118a5b8>] ptep_clear_flush+0x48/0x60
  [13551521.060239]  [<ffffffff81184bff>] try_to_unmap_one+0xbf/0x480
  [13551521.061597]  [<ffffffff81185d77>] try_to_unmap_anon+0xa7/0x120
  [13551521.062947]  [<ffffffff81185e3d>] try_to_unmap+0x4d/0x60
  [13551521.064298]  [<ffffffff811a88fe>] migrate_pages+0x43e/0x780
  [13551521.065642]  [<ffffffff811a7210>] ? remove_migration_pte+0x330/0x330
  [13551521.066993]  [<ffffffff811a9674>] migrate_misplaced_page+0xc4/0xf0
  [13551521.068352]  [<ffffffff81178ede>] do_numa_page+0x12e/0x1b0
  [13551521.069710]  [<ffffffff8117a0af>] handle_mm_fault+0x5ff/0xf10
  [13551521.071075]  [<ffffffff811ffc91>] ? fsnotify+0x241/0x320
  [13551521.072440]  [<ffffffff8172d534>] __do_page_fault+0x184/0x560
  [13551521.073782]  [<ffffffff811bede9>] ? do_readv_writev+0x169/0x220
  [13551521.075098]  [<ffffffff8118272b>] ? change_protection+0x9b/0xb0
  [13551521.076393]  [<ffffffff810a02c5>] ? set_next_entity+0x95/0xb0
  [13551521.077663]  [<ffffffff8101260b>] ? __switch_to+0x16b/0x4d0
  [13551521.078916]  [<ffffffffa0332504>] ? kvm_on_user_return+0x74/0x80 [kvm]
  [13551521.080121]  [<ffffffff8172d92a>] do_page_fault+0x1a/0x70
  [13551521.081286]  [<ffffffff81729d68>] page_fault+0x28/0x30
  [13551521.082415] Code: 08 4c 89 ff 4c 89 23 48 89 4b 08 48 89 19 48 89 55 d0 e8 f2 d3 64 00 4c 3b 65 d0 74 23 45 85 ed 75 09 eb 0d 0f 1f
   44 00 00 f3 90 <f6> 43 20 01 75 f8 48 83 c4 08 5b 41 5c 41 5d 41 5e 41 5f 5d c3 

  
  The server freeze and need hard reboot to get the problem.

  Please advise.
  --- 
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Dec  3 16:41 seq
   crw-rw---- 1 root audio 116, 33 Dec  3 16:41 timer
  AplayDevices: Error: [Errno 2] No such file or directory
  ApportVersion: 2.14.1-0ubuntu3.8
  Architecture: amd64
  ArecordDevices: Error: [Errno 2] No such file or directory
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory
  DistroRelease: Ubuntu 14.04
  HibernationDevice: RESUME=/dev/mapper/vg-lv_swap
  InstallationDate: Installed on 2015-02-11 (295 days ago)
  InstallationMedia: Ubuntu-Server 14.04.1 LTS "Trusty Tahr" - Release amd64 (20140722.3)
  MachineType: ASUSTek Computer INC. RS720-E7-RS12-E
  Package: linux (not installed)
  PciMultimedia:
   
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  ProcFB: 0 astdrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.13.0-48-generic root=/dev/mapper/vg-lv_root ro splash quiet vt.handoff=7
  ProcVersionSignature: Ubuntu 3.13.0-48.80-generic 3.13.11-ckt16
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-48-generic N/A
   linux-backports-modules-3.13.0-48-generic  N/A
   linux-firmware                             1.127.11
  RfKill: Error: [Errno 2] No such file or directory
  Tags:  trusty
  Uname: Linux 3.13.0-48-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups:
   
  WifiSyslog: Dec  4 07:32:02 sa-node1 kernel: [53423.144447] IPMI message handler: Event queue full, discarding incoming events
  _MarkForUpload: True
  dmi.bios.date: 11/08/2013
  dmi.bios.vendor: American Megatrends Inc.
  dmi.bios.version: 5302
  dmi.board.asset.tag: To be filled by O.E.M.
  dmi.board.name: Z9PE-D16 Series
  dmi.board.vendor: ASUSTeK COMPUTER INC.
  dmi.board.version: 1.0X
  dmi.chassis.asset.tag: To Be Filled By O.E.M.
  dmi.chassis.type: 17
  dmi.chassis.vendor: To Be Filled By O.E.M.
  dmi.chassis.version: To Be Filled By O.E.M.
  dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr5302:bd11/08/2013:svnASUSTekComputerINC.:pnRS720-E7-RS12-E:pvrRev1.xx:rvnASUSTeKCOMPUTERINC.:rnZ9PE-D16Series:rvr1.0X:cvnToBeFilledByO.E.M.:ct17:cvrToBeFilledByO.E.M.:
  dmi.product.name: RS720-E7-RS12-E
  dmi.product.version: Rev 1.xx
  dmi.sys.vendor: ASUSTek Computer INC.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1522388/+subscriptions


References