kernel-packages team mailing list archive
-
kernel-packages team
-
Mailing list archive
-
Message #149662
[Bug 1522388] ProcInterrupts.txt
apport information
** Attachment added: "ProcInterrupts.txt"
https://bugs.launchpad.net/bugs/1522388/+attachment/4529322/+files/ProcInterrupts.txt
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1522388
Title:
Soft Lockup - CPU Stuck
Status in linux package in Ubuntu:
Confirmed
Bug description:
The Server was running:
* openstack icehouse
* Linux 3.13.0-48-generic #80-Ubuntu SMP Thu Mar 12 11:16:15 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux(Ubuntu 3.13.0-48.80-generic 3.13.11-ckt16)
The kernel log:
[13551520.909322] BUG: soft lockup - CPU#4 stuck for 23s! [migration/4:76]
[13551520.909357] Modules linked in: vhost_net vhost macvtap macvlan nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev veth ipt_MASQUERA
DE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge ip6table_filter ip6_ta
bles iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_is
csi openvswitch gre vxlan ip_tunnel dm_crypt usb_storage gpio_ich joydev dm_multipath scsi_dh intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul c
rc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd serio_raw ipmi_si sb_edac edac_core mei_me mei lpc_ich shpchp mac_hid k
vm_intel kvm 8021q garp stp mrp llc lp parport btrfs xor hid_generic usbhid hid raid6_pq libcrc32c ses enclosure ast syscopyarea sysfillrect sysimgblt ttm psmouse drm_kms
_helper isci drm igb ahci libsas dca libahci ptp pps_core scsi_transport_sas i2c_algo_bit megaraid_sas wmi
[13551520.909377] CPU: 4 PID: 76 Comm: migration/4 Tainted: G D W 3.13.0-48-generic #80-Ubuntu
[13551520.909378] Hardware name: ASUSTek Computer INC. RS720-E7-RS12-E/Z9PE-D16 Series, BIOS 5302 11/08/2013
[13551520.909379] task: ffff881029391800 ti: ffff88102938c000 task.ti: ffff88102938c000
[13551520.909386] RIP: 0010:[<ffffffff810f61cb>] [<ffffffff810f61cb>] multi_cpu_stop+0x6b/0xf0
[13551520.909387] RSP: 0018:ffff88102938dd98 EFLAGS: 00000293
[13551520.909388] RAX: ffffffff8180ae00 RBX: ffff88103fc934c0 RCX: 0000000000007c34
[13551520.909389] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff881083bd37b8
[13551520.909390] RBP: ffff88102938ddb8 R08: 0000000000000282 R09: 0000000000000001
[13551520.909391] R10: 000000000000b590 R11: 0000000000000000 R12: ffff88102938dd20
[13551520.909392] R13: ffff88035499e000 R14: ffffffff81098235 R15: ffff88035499e000
[13551520.909394] FS: 0000000000000000(0000) GS:ffff88103fc80000(0000) knlGS:0000000000000000
[13551520.909395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[13551520.909396] CR2: 00007f0206b09000 CR3: 00000008ee4ad000 CR4: 00000000000427e0
[13551520.909397] Stack:
[13551520.909401] ffff881083bd37e0 ffff88103fc8de20 ffff88103fc8de28 ffff881083bd37b8
[13551520.909404] ffff88102938de78 ffffffff810f63de 0000000000000000 0000000000000000
[13551520.909408] ffff88103fc934c0 ffff881024f38700 0000000000000000 ffff88103fc934c0
[13551520.909409] Call Trace:
[13551520.909413] [<ffffffff810f63de>] cpu_stopper_thread+0x7e/0x150
[13551520.909418] [<ffffffff817254a1>] ? __schedule+0x381/0x7d0
[13551520.909423] [<ffffffff810928cf>] smpboot_thread_fn+0xff/0x1b0
[13551520.909426] [<ffffffff810927d0>] ? SyS_setgroups+0x180/0x180
[13551520.909429] [<ffffffff8108b5b2>] kthread+0xd2/0xf0
[13551520.909432] [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
[13551520.909436] [<ffffffff81731f0c>] ret_from_fork+0x7c/0xb0
[13551520.909439] [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
[13551520.909459] Code: 31 f6 31 d2 eb 23 66 2e 0f 1f 84 00 00 00 00 00 83 fb 03 75 05 45 84 ed 75 66 f0 41 ff 4c 24 24 74 26 89 da 83 fa
04 74 3d f3 90 <41> 8b 5c 24 20 39 d3 74 f0 83 fb 02 75 d7 fa 66 66 90 66 66 90
[13551520.971633] [<ffffffff81184b76>] try_to_unmap_one+0x36/0x480
[13551520.973089] [<ffffffff81186556>] ? rmap_walk+0x186/0x210
[13551520.974528] [<ffffffff81185d77>] try_to_unmap_anon+0xa7/0x120
[13551520.975958] [<ffffffff81185e3d>] try_to_unmap+0x4d/0x60
[13551520.977372] [<ffffffff811a88fe>] migrate_pages+0x43e/0x780
[13551520.978769] [<ffffffff81171bb0>] ? isolate_freepages_block+0x310/0x310
[13551520.980165] [<ffffffff81172bb9>] compact_zone+0x299/0x410
[13551520.981549] [<ffffffff81172dbe>] compact_zone_order+0x8e/0xd0
[13551520.982916] [<ffffffff81173111>] try_to_compact_pages+0x101/0x180
[13551520.984279] [<ffffffff8171c1a3>] __alloc_pages_direct_compact+0xac/0x196
[13551520.985641] [<ffffffff81159160>] __alloc_pages_nodemask+0x760/0xb80
[13551520.986971] [<ffffffff81199d9a>] alloc_pages_vma+0x9a/0x140
[13551520.988267] [<ffffffff811ad62b>] do_huge_pmd_anonymous_page+0x10b/0x3f0
[13551520.989540] [<ffffffff8136aa2f>] ? __rb_insert_augmented+0x8f/0x1f0
[13551520.990779] [<ffffffff81179c48>] handle_mm_fault+0x198/0xf10
[13551520.991984] [<ffffffff8117ec97>] ? vma_link+0xb7/0xc0
[13551520.993153] [<ffffffff8172d534>] __do_page_fault+0x184/0x560
[13551520.994289] [<ffffffff8118166e>] ? do_mmap_pgoff+0x34e/0x3d0
[13551520.995387] [<ffffffff8116bcf9>] ? vm_mmap_pgoff+0x99/0xc0
[13551520.996443] [<ffffffff8172d92a>] do_page_fault+0x1a/0x70
[13551520.997476] [<ffffffff8107aaa7>] ? sigprocmask+0x57/0x90
[13551520.998481] [<ffffffff81729d68>] page_fault+0x28/0x30
[13551520.999462] Code: 55 48 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c
0f 1f 44 00 00 <f3> 90 83 e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90
[13551521.013327] BUG: soft lockup - CPU#6 stuck for 22s! [qemu-system-x86:14068]
[13551521.014492] Modules linked in: vhost_net vhost macvtap macvlan nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev veth ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi openvswitch gre vxlan ip_tunnel dm_crypt usb_storage gpio_ich joydev dm_multipath scsi_dh intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd serio_raw ipmi_si sb_edac edac_core mei_me mei lpc_ich shpchp mac_hid kvm_intel kvm 8021q garp stp mrp llc lp parport btrfs xor hid_generic usbhid hid raid6_pq libcrc32c ses enclosure ast syscopyarea sysfillrect sysimgblt ttm psmouse drm_kms
_helper isci drm igb ahci libsas dca libahci ptp pps_core scsi_transport_sas i2c_algo_bit megaraid_sas wmi
[13551521.025305] CPU: 6 PID: 14068 Comm: qemu-system-x86 Tainted: G D W 3.13.0-48-generic #80-Ubuntu
[13551521.026588] Hardware name: ASUSTek Computer INC. RS720-E7-RS12-E/Z9PE-D16 Series, BIOS 5302 11/08/2013
[13551521.027894] task: ffff88109083b000 ti: ffff8810ed20a000 task.ti: ffff8810ed20a000
[13551521.029199] RIP: 0010:[<ffffffff810dbf92>] [<ffffffff810dbf92>] generic_exec_single+0x82/0xb0
[13551521.030529] RSP: 0000:ffff8810ed20ba20 EFLAGS: 00000202
[13551521.031854] RAX: 0000000000000100 RBX: 0000000000000286 RCX: 0000000000000004
[13551521.033195] RDX: ffff88207fc0ce20 RSI: 0000000000000000 RDI: 0000000000000286
[13551521.034536] RBP: ffff8810ed20ba50 R08: ffff88207fc0ce08 R09: 0000000000000004
[13551521.035878] R10: ffff88207fff8f00 R11: ffffea0059bee9e0 R12: ffff8810ed20b9f0
[13551521.037224] R13: ffff88207fc0ce00 R14: 0000000000000040 R15: ffffffff813645f0
[13551521.038569] FS: 00007fbb42ffd700(0000) GS:ffff88207fc00000(0000) knlGS:0000000000000000
[13551521.039932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[13551521.041271] CR2: 00007fbb6ea50000 CR3: 00000006fc224000 CR4: 00000000000427e0
[13551521.042599] Stack:
[13551521.043897] ffff88103fc73f80 0000000000000003 0000000000000006 ffffffff81d14380
[13551521.045245] ffffffff8105c7a0 0000000000000301 ffff8810ed20bac8 ffffffff810dc0a5
[13551521.046593] ffff88207fffb040 ffff88207fff8f68 ffff88103fc77710 ffff88103fc73f80
[13551521.047954] Call Trace:
[13551521.049305] [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
[13551521.050663] [<ffffffff810dc0a5>] smp_call_function_single+0xe5/0x190
[13551521.052027] [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
[13551521.053394] [<ffffffff810dc4d6>] smp_call_function_many+0x286/0x2d0
[13551521.054765] [<ffffffff8105c7a0>] ? leave_mm+0x80/0x80
[13551521.056130] [<ffffffff8105c8f7>] native_flush_tlb_others+0x37/0x40
[13551521.057503] [<ffffffff8105cbf6>] flush_tlb_page+0x56/0xa0
[13551521.058873] [<ffffffff8118a5b8>] ptep_clear_flush+0x48/0x60
[13551521.060239] [<ffffffff81184bff>] try_to_unmap_one+0xbf/0x480
[13551521.061597] [<ffffffff81185d77>] try_to_unmap_anon+0xa7/0x120
[13551521.062947] [<ffffffff81185e3d>] try_to_unmap+0x4d/0x60
[13551521.064298] [<ffffffff811a88fe>] migrate_pages+0x43e/0x780
[13551521.065642] [<ffffffff811a7210>] ? remove_migration_pte+0x330/0x330
[13551521.066993] [<ffffffff811a9674>] migrate_misplaced_page+0xc4/0xf0
[13551521.068352] [<ffffffff81178ede>] do_numa_page+0x12e/0x1b0
[13551521.069710] [<ffffffff8117a0af>] handle_mm_fault+0x5ff/0xf10
[13551521.071075] [<ffffffff811ffc91>] ? fsnotify+0x241/0x320
[13551521.072440] [<ffffffff8172d534>] __do_page_fault+0x184/0x560
[13551521.073782] [<ffffffff811bede9>] ? do_readv_writev+0x169/0x220
[13551521.075098] [<ffffffff8118272b>] ? change_protection+0x9b/0xb0
[13551521.076393] [<ffffffff810a02c5>] ? set_next_entity+0x95/0xb0
[13551521.077663] [<ffffffff8101260b>] ? __switch_to+0x16b/0x4d0
[13551521.078916] [<ffffffffa0332504>] ? kvm_on_user_return+0x74/0x80 [kvm]
[13551521.080121] [<ffffffff8172d92a>] do_page_fault+0x1a/0x70
[13551521.081286] [<ffffffff81729d68>] page_fault+0x28/0x30
[13551521.082415] Code: 08 4c 89 ff 4c 89 23 48 89 4b 08 48 89 19 48 89 55 d0 e8 f2 d3 64 00 4c 3b 65 d0 74 23 45 85 ed 75 09 eb 0d 0f 1f
44 00 00 f3 90 <f6> 43 20 01 75 f8 48 83 c4 08 5b 41 5c 41 5d 41 5e 41 5f 5d c3
The server freeze and need hard reboot to get the problem.
Please advise.
---
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Dec 3 16:41 seq
crw-rw---- 1 root audio 116, 33 Dec 3 16:41 timer
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.14.1-0ubuntu3.8
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory
DistroRelease: Ubuntu 14.04
HibernationDevice: RESUME=/dev/mapper/vg-lv_swap
InstallationDate: Installed on 2015-02-11 (295 days ago)
InstallationMedia: Ubuntu-Server 14.04.1 LTS "Trusty Tahr" - Release amd64 (20140722.3)
MachineType: ASUSTek Computer INC. RS720-E7-RS12-E
Package: linux (not installed)
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 astdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.13.0-48-generic root=/dev/mapper/vg-lv_root ro splash quiet vt.handoff=7
ProcVersionSignature: Ubuntu 3.13.0-48.80-generic 3.13.11-ckt16
RelatedPackageVersions:
linux-restricted-modules-3.13.0-48-generic N/A
linux-backports-modules-3.13.0-48-generic N/A
linux-firmware 1.127.11
RfKill: Error: [Errno 2] No such file or directory
Tags: trusty
Uname: Linux 3.13.0-48-generic x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:
WifiSyslog: Dec 4 07:32:02 sa-node1 kernel: [53423.144447] IPMI message handler: Event queue full, discarding incoming events
_MarkForUpload: True
dmi.bios.date: 11/08/2013
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 5302
dmi.board.asset.tag: To be filled by O.E.M.
dmi.board.name: Z9PE-D16 Series
dmi.board.vendor: ASUSTeK COMPUTER INC.
dmi.board.version: 1.0X
dmi.chassis.asset.tag: To Be Filled By O.E.M.
dmi.chassis.type: 17
dmi.chassis.vendor: To Be Filled By O.E.M.
dmi.chassis.version: To Be Filled By O.E.M.
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr5302:bd11/08/2013:svnASUSTekComputerINC.:pnRS720-E7-RS12-E:pvrRev1.xx:rvnASUSTeKCOMPUTERINC.:rnZ9PE-D16Series:rvr1.0X:cvnToBeFilledByO.E.M.:ct17:cvrToBeFilledByO.E.M.:
dmi.product.name: RS720-E7-RS12-E
dmi.product.version: Rev 1.xx
dmi.sys.vendor: ASUSTek Computer INC.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1522388/+subscriptions
References
