kernel-packages team mailing list archive

Thread
Date
[Bug 1269404] Re: BUG: soft lockup - CPU#2 stuck for 22s! [systemd-udevd:546]

To: kernel-packages@xxxxxxxxxxxxxxxxxxx
From: Joseph Salisbury <joseph.salisbury@xxxxxxxxxxxxx>
Date: Wed, 15 Jan 2014 20:45:08 -0000
Reply-to: Bug 1269404 <1269404@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
I'd like to perform a bisect to figure out what commit caused this
regression. We need to identify the earliest kernel where the issue
started happening as well as the latest kernel that did not have this
issue.

Can you test the following kernels and report back? We are looking for
the first kernel version that exhibits this bug:

v3.12 final: http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.12-trusty/
If v3.12 final does not exhibit the bug, we should move on to testing some of the v3.13 release candidates.

v3.13-rc3: http://kernel.ubuntu.com/~kernel-
ppa/mainline/v3.13-rc3-trusty/

If v3.13-rc3 does not exhibit the bug then test v3.13-rc6:
v3.13-rc6: http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13-rc6-trusty/

If v3.13-rc3 does exhibit the bug then test v3.13-rc2:
v3.13-rc2: http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.13-rc2-trusty

You don't have to test every kernel, just up until the kernel that first
has this bug.

Thanks in advance!

** Changed in: linux (Ubuntu)
   Importance: Undecided => High

** Tags added: performing-bisect

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1269404

Title:
  BUG: soft lockup - CPU#2 stuck for 22s! [systemd-udevd:546]

Status in “linux” package in Ubuntu:
  Incomplete

Bug description:
  I'm using Ubuntu 14.04 Trusty Tahr 64 bit and my laptop (Dell XPS
  L702x using Nvidia Optimus) can't boot starting with kernel  3.13
  (I've tried all three updates: 3.13.0-1-generic, 3.13.0-2-generic and
  3.13.0-3-generic). When booting, I get this error: "BUG: soft lockup -
  CPU#2 stuck for 22s! [systemd-udevd:546]"

  Booting the old 3.12 (3.12.0-8-generic) kernel works.

  Here's the relevant part from syslog:

  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136613] BUG: soft lockup - CPU#2 stuck for 22s! [systemd-udevd:546]
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136638] Modules linked in: parport_pc ppdev rfcomm bnep uvcvideo videobuf2_vmalloc videobuf2_memops videobuf2_core btusb videodev bluetooth snd_hda_codec_hdmi snd_hda_codec_realtek binfmt_misc joydev ip6t_REJECT xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT xt_LOG xt_limit xt_tcpudp xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 nvidia(POF) xt_conntrack ip6table_filter dell_wmi sparse_keymap ip6_tables nf_conntrack_netbios_ns arc4 nf_conntrack_broadcast snd_hda_intel nf_nat_ftp nf_nat snd_hda_codec nf_conntrack_ftp nf_conntrack intel_rapl iwldvm iptable_filter snd_hwdep x86_pkg_temp_thermal dell_laptop ip_tables intel_powerclamp dcdbas snd_pcm mac80211 x_tables kvm_intel snd_page_alloc kvm snd_seq_midi snd_seq_midi_event snd_rawmidi i915 snd_seq crct10dif_pclmul crc32_pclmul iwlwifi ghash_clmulni_intel snd_seq_device aesni_intel snd_timer aes_x86_64 lrw gf128mul cfg80211 glue_helper ablk_helper drm_kms_helper snd cryptd mei_me drm mei i2c_algo_bit psmouse soundcore wmi lpc_ich serio_raw mac_hid video coretemp lp parport hid_generic usbhid hid microcode ahci r8169 libahci mii
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136678] CPU: 2 PID: 546 Comm: systemd-udevd Tainted: PF       W  O 3.13.0-3-generic #18-Ubuntu
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136679] Hardware name: Dell Inc.          Dell System XPS L702X/0XN71K, BIOS A18 06/18/2012
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136681] task: ffff880423d5e000 ti: ffff880036b4a000 task.ti: ffff880036b4a000
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136682] RIP: 0010:[<ffffffff810d98c8>]  [<ffffffff810d98c8>] smp_call_function_many+0x268/0x2d0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136687] RSP: 0018:ffff880036b4bb78  EFLAGS: 00000202
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136688] RAX: 0000000000000006 RBX: ffff880036b4bb28 RCX: ffff88043e5981d0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136689] RDX: 0000000000000006 RSI: 0000000000000100 RDI: 0000000000000000
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136690] RBP: ffff880036b4bbc8 R08: ffff88043e495348 R09: 0000000000000004
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136691] R10: ffff88043e495348 R11: 29312e312e312820 R12: ffffffff81362dd4
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136692] R13: ffff880036b4bb40 R14: ffffffff81ec810d R15: ffffffff81a5ef2d
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136693] FS:  00007f192e8ca880(0000) GS:ffff88043e480000(0000) knlGS:0000000000000000
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136694] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136695] CR2: 0000000000f76068 CR3: 0000000036935000 CR4: 00000000000407e0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136697] Stack:
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136697]  ffff88043e495368 0000000000015300 0000000000000000 ffffffff81059da0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136700]  0000010000000001 000000000000011b ffffffff81059da0 0000000000000000
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136702]  ffff88043e5d08a8 ffff88043e5d0808 ffff880036b4bbf0 ffffffff810d9a8d
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136704] Call Trace:
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136708]  [<ffffffff81059da0>] ? flush_tlb_func+0xc0/0xc0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136710]  [<ffffffff81059da0>] ? flush_tlb_func+0xc0/0xc0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136712]  [<ffffffff810d9a8d>] on_each_cpu+0x2d/0x60
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136715]  [<ffffffff8105a1fa>] flush_tlb_kernel_range+0x4a/0x70
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136719]  [<ffffffff81182af5>] __purge_vmap_area_lazy+0x335/0x430
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136722]  [<ffffffff81182d52>] vm_unmap_aliases+0x162/0x180
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136724]  [<ffffffff81056427>] change_page_attr_set_clr+0xb7/0x470
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136726]  [<ffffffff8171134c>] ? notifier_call_chain+0x4c/0x70
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136728]  [<ffffffff81056823>] set_memory_x+0x43/0x50
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136731]  [<ffffffff810db40b>] unset_module_init_ro_nx+0x6b/0x80
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136734]  [<ffffffff810dfa9b>] load_module+0x139b/0x1b40
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136736]  [<ffffffff810db460>] ? store_uevent+0x40/0x40
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136739]  [<ffffffff810e03b6>] SyS_finit_module+0x86/0xb0
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136742]  [<ffffffff81715a3f>] tracesys+0xe1/0xe6
  Jan 15 14:27:05 ubuntu-desktop kernel: [   36.136743] Code: d2 e8 5d 00 29 00 3b 05 9f 7e c4 00 89 c2 0f 8d 25 fe ff ff 48 98 49 8b 4d 00 48 03 0c c5 c0 f8 d1 81 f6 41 20 01 74 cb 0f 1f 00 <f3> 90 f6 41 20 01 75 f8 eb be 0f b6 4d d0 48 8b 55 c0 44 89 ef 
  Jan 15 14:27:24 ubuntu-desktop NetworkManager[1269]: <warn> (eth0): DHCPv4 request timed out.
  Jan 15 14:27:27 ubuntu-desktop NetworkManager[1269]: <warn> (eth0): DHCP client pid 1343 didn't exit, will kill it.
  Jan 15 14:27:32 ubuntu-desktop kernel: [   62.429213] nf_conntrack: automatic helper assignment is deprecated and it will be removed soon. Use the iptables CT target to attach helpers instead.
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105866] BUG: soft lockup - CPU#2 stuck for 22s! [systemd-udevd:546]
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105893] Modules linked in: parport_pc ppdev rfcomm bnep uvcvideo videobuf2_vmalloc videobuf2_memops videobuf2_core btusb videodev bluetooth snd_hda_codec_hdmi snd_hda_codec_realtek binfmt_misc joydev ip6t_REJECT xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT xt_LOG xt_limit xt_tcpudp xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 nvidia(POF) xt_conntrack ip6table_filter dell_wmi sparse_keymap ip6_tables nf_conntrack_netbios_ns arc4 nf_conntrack_broadcast snd_hda_intel nf_nat_ftp nf_nat snd_hda_codec nf_conntrack_ftp nf_conntrack intel_rapl iwldvm iptable_filter snd_hwdep x86_pkg_temp_thermal dell_laptop ip_tables intel_powerclamp dcdbas snd_pcm mac80211 x_tables kvm_intel snd_page_alloc kvm snd_seq_midi snd_seq_midi_event snd_rawmidi i915 snd_seq crct10dif_pclmul crc32_pclmul iwlwifi ghash_clmulni_intel snd_seq_device aesni_intel snd_timer aes_x86_64 lrw gf128mul cfg80211 glue_helper ablk_helper drm_kms_helper snd cryptd mei_me drm mei i2c_algo_bit psmouse soundcore wmi lpc_ich serio_raw mac_hid video coretemp lp parport hid_generic usbhid hid microcode ahci r8169 libahci mii
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105945] CPU: 2 PID: 546 Comm: systemd-udevd Tainted: PF       W  O 3.13.0-3-generic #18-Ubuntu
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105947] Hardware name: Dell Inc.          Dell System XPS L702X/0XN71K, BIOS A18 06/18/2012
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105948] task: ffff880423d5e000 ti: ffff880036b4a000 task.ti: ffff880036b4a000
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105950] RIP: 0010:[<ffffffff810d98ce>]  [<ffffffff810d98ce>] smp_call_function_many+0x26e/0x2d0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105955] RSP: 0018:ffff880036b4bb78  EFLAGS: 00000202
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105956] RAX: 0000000000000006 RBX: ffff880036b4bb28 RCX: ffff88043e5981d0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105957] RDX: 0000000000000006 RSI: 0000000000000100 RDI: 0000000000000000
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105958] RBP: ffff880036b4bbc8 R08: ffff88043e495348 R09: 0000000000000004
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105959] R10: ffff88043e495348 R11: 29312e312e312820 R12: ffffffff81362dd4
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105960] R13: ffff880036b4bb40 R14: ffffffff81ec810d R15: ffffffff81a5ef2d
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105961] FS:  00007f192e8ca880(0000) GS:ffff88043e480000(0000) knlGS:0000000000000000
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105962] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105963] CR2: 0000000000f76068 CR3: 0000000036935000 CR4: 00000000000407e0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105964] Stack:
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105966]  ffff88043e495368 0000000000015300 0000000000000000 ffffffff81059da0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105968]  0000010000000001 000000000000011b ffffffff81059da0 0000000000000000
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105970]  ffff88043e5d08a8 ffff88043e5d0808 ffff880036b4bbf0 ffffffff810d9a8d
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105972] Call Trace:
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105978]  [<ffffffff81059da0>] ? flush_tlb_func+0xc0/0xc0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105980]  [<ffffffff81059da0>] ? flush_tlb_func+0xc0/0xc0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105982]  [<ffffffff810d9a8d>] on_each_cpu+0x2d/0x60
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105984]  [<ffffffff8105a1fa>] flush_tlb_kernel_range+0x4a/0x70
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105988]  [<ffffffff81182af5>] __purge_vmap_area_lazy+0x335/0x430
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105991]  [<ffffffff81182d52>] vm_unmap_aliases+0x162/0x180
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105993]  [<ffffffff81056427>] change_page_attr_set_clr+0xb7/0x470
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105997]  [<ffffffff8171134c>] ? notifier_call_chain+0x4c/0x70
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.105999]  [<ffffffff81056823>] set_memory_x+0x43/0x50
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106002]  [<ffffffff810db40b>] unset_module_init_ro_nx+0x6b/0x80
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106005]  [<ffffffff810dfa9b>] load_module+0x139b/0x1b40
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106007]  [<ffffffff810db460>] ? store_uevent+0x40/0x40
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106010]  [<ffffffff810e03b6>] SyS_finit_module+0x86/0xb0
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106013]  [<ffffffff81715a3f>] tracesys+0xe1/0xe6
  Jan 15 14:27:33 ubuntu-desktop kernel: [   64.106014] Code: 3b 05 9f 7e c4 00 89 c2 0f 8d 25 fe ff ff 48 98 49 8b 4d 00 48 03 0c c5 c0 f8 d1 81 f6 41 20 01 74 cb 0f 1f 00 f3 90 f6 41 20 01 <75> f8 eb be 0f b6 4d d0 48 8b 55 c0 44 89 ef 48 8b 75 c8 e8 ea 
  Jan 15 14:27:37 ubuntu-desktop kernel: [   68.069508] INFO: rcu_sched detected stalls on CPUs/tasks: { 6} (detected by 4, t=15002 jiffies, g=357, c=356, q=0)
  Jan 15 14:27:37 ubuntu-desktop kernel: [   68.069560] sending NMI to all CPUs:
  Jan 15 14:27:37 ubuntu-desktop kernel: [   68.069564] NMI backtrace for cpu 6
  Jan 15 14:27:37 ubuntu-desktop kernel: [   68.069568] CPU: 6 PID: 102 Comm: irq/23-ehci_hcd Tainted: PF       W  O 3.13.0-3-generic #18-Ubuntu

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-headers-3.13.0-3-generic 3.13.0-3.18
  ProcVersionSignature: Ubuntu 3.12.0-8.16-generic 3.12.6
  Uname: Linux 3.12.0-8-generic x86_64
  ApportVersion: 2.13.1-0ubuntu1
  Architecture: amd64
  AudioDevicesInUse:
   USER        PID ACCESS COMMAND
   /dev/snd/controlC0:  andrei     5038 F.... pulseaudio
  CurrentDesktop: Unity
  Date: Wed Jan 15 14:51:37 2014
  HibernationDevice: RESUME=UUID=92e5858f-a853-468f-b8fe-c95d3a2f4242
  InstallationDate: Installed on 2012-12-30 (381 days ago)
  InstallationMedia: Ubuntu 12.10 "Quantal Quetzal" - Release amd64 (20121017.5)
  MachineType: Dell Inc. Dell System XPS L702X
  ProcFB: 0 inteldrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.12.0-8-generic root=UUID=1cd2fc4f-7d99-4c7a-8ea7-6f9a2d4e5960 ro quiet splash threadirqs pcie_aspm=force i915.i915_enable_rc6=1
  RelatedPackageVersions:
   linux-restricted-modules-3.12.0-8-generic N/A
   linux-backports-modules-3.12.0-8-generic  N/A
   linux-firmware                            1.121
  SourcePackage: linux
  StagingDrivers: zram
  UpgradeStatus: Upgraded to trusty on 2013-01-12 (367 days ago)
  dmi.bios.date: 06/18/2012
  dmi.bios.vendor: Dell Inc.
  dmi.bios.version: A18
  dmi.board.asset.tag: Base Board Asset Tag
  dmi.board.name: 0XN71K
  dmi.board.vendor: Dell Inc.
  dmi.board.version: FAB1
  dmi.chassis.type: 8
  dmi.chassis.vendor: Dell Inc.
  dmi.chassis.version: 0.1
  dmi.modalias: dmi:bvnDellInc.:bvrA18:bd06/18/2012:svnDellInc.:pnDellSystemXPSL702X:pvr:rvnDellInc.:rn0XN71K:rvrFAB1:cvnDellInc.:ct8:cvr0.1:
  dmi.product.name: Dell System XPS L702X
  dmi.sys.vendor: Dell Inc.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1269404/+subscriptions
References

[Bug 1269404] [NEW] BUG: soft lockup - CPU#2 stuck for 22s! [systemd-udevd:546]
From: Alin Andrei, 2014-01-15