kernel-packages team mailing list archive

Thread
Date
[Bug 1356558] Re: BUG: soft lockup - CPU stuck for 22s! [md3_raid1]

To: kernel-packages@xxxxxxxxxxxxxxxxxxx
From: Uli Middelberg <uli@xxxxxxxxxxxxx>
Date: Sun, 16 Nov 2014 11:14:59 -0000
Reply-to: Bug 1356558 <1356558@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
I tried the 3.18-rc4 kernel, the bug is also there:

Nov 16 07:16:39 box kernel: [34280.152007] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [clamscan:2868]
Nov 16 07:16:39 box kernel: [34280.152007] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbse
rial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci 
psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linearNov 16 07:16:39 box kernel: [34280.152007] CPU: 1 PID: 2868 Comm: clamscan Not tainted 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34280.152007] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34280.152007] task: f6acb100 ti: ec63a000 task.ti: ec63a000
Nov 16 07:16:39 box kernel: [34280.152007] EIP: 0060:[<c115e7fa>] EFLAGS: 00000246 CPU: 1
Nov 16 07:16:39 box kernel: [34280.152007] EIP is at compact_finished+0xea/0x150
Nov 16 07:16:39 box kernel: [34280.152007] EAX: 00000002 EBX: ec63bb20 ECX: 00000008 EDX: 00000009
Nov 16 07:16:39 box kernel: [34280.152007] ESI: c1a41ac0 EDI: 00000002 EBP: ec63bad8 ESP: ec63bac0
Nov 16 07:16:39 box kernel: [34280.152007]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34280.152007] CR0: 80050033 CR2: a5000000 CR3: 2c0d6000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34280.152007] Stack:
Nov 16 07:16:39 box kernel: [34280.152007]  00000000 00000000 00000002 ec63bb20 c1a41ac0 c1a41ac0 ec63bb18 c1160062
Nov 16 07:16:39 box kernel: [34280.152007]  ec63bb20 00000000 00000000 fffff000 00000014 000377fe 000377fe 00000000
Nov 16 07:16:39 box kernel: [34280.152007]  ec63bb28 00000002 00001000 c1a41ac0 004352da ec63bb58 ec63bb64 c116043c
Nov 16 07:16:39 box kernel: [34280.152007] Call Trace:
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34280.152007]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34280.152007]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1195cd0>] ? commit_charge+0x20/0x70
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1190887>] do_huge_pmd_wp_page+0xf7/0x570
Nov 16 07:16:39 box kernel: [34280.152007]  [<c11685cf>] ? handle_pte_fault+0x1bf/0x1f0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c11688c1>] __handle_mm_fault+0x211/0x290
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1168a27>] handle_mm_fault+0xe7/0x150
Nov 16 07:16:39 box kernel: [34280.152007]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c104d197>] __do_page_fault+0x187/0x520
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1143c20>] ? prep_new_page+0xe0/0x1b0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1146649>] ? get_page_from_freelist+0x1b9/0x3c0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c104d621>] do_page_fault+0x21/0x30
Nov 16 07:16:39 box kernel: [34280.152007]  [<c16ca613>] error_code+0x67/0x6c
Nov 16 07:16:39 box kernel: [34280.152007]  [<c116233f>] ? copy_page_to_iter_iovec+0x4f/0x240
Nov 16 07:16:39 box kernel: [34280.152007]  [<c11628d6>] copy_page_to_iter+0x26/0x70
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1140699>] do_generic_file_read+0x159/0x4d0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c114169e>] generic_file_read_iter+0x11e/0x190
Nov 16 07:16:39 box kernel: [34280.152007]  [<c1168887>] ? __handle_mm_fault+0x1d7/0x290
Nov 16 07:16:39 box kernel: [34280.152007]  [<c119e1fc>] new_sync_read+0x6c/0xa0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c119eac6>] vfs_read+0x86/0x160
Nov 16 07:16:39 box kernel: [34280.152007]  [<c119e190>] ? __kernel_write+0x140/0x140
Nov 16 07:16:39 box kernel: [34280.152007]  [<c119edb3>] SyS_pread64+0x93/0xa0
Nov 16 07:16:39 box kernel: [34280.152007]  [<c16c96df>] sysenter_do_call+0x12/0x12
Nov 16 07:16:39 box kernel: [34280.152007] Code: 00 00 00 8d 1c 3a 3b 1b 75 67 83 f9 08 7e 07 8b 52 30 85 d2 75 5b 83 c0 01 83 f8 0b 75 db bf 02 00 00 00 8d b6 00 00 00 00 89 f8 <8b> 5d f4 8b 75 f8 8b 7d fc 89 ec 5d c3 90 8b 46 2c bf 04 00 00
Nov 16 07:16:39 box kernel: [34284.152005] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34284.152005] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34284.152005] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34284.152005] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34284.152005] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34284.152005] EIP: 0060:[<c115e806>] EFLAGS: 00000246 CPU: 0
Nov 16 07:16:39 box kernel: [34284.152005] EIP is at compact_finished+0xf6/0x150
Nov 16 07:16:39 box kernel: [34284.152005] EAX: 00000002 EBX: f45dfd9c ECX: 00000008 EDX: 00000009
Nov 16 07:16:39 box kernel: [34284.152005] ESI: c1a41ac0 EDI: c1a41ac0 EBP: f45dfd94 ESP: f45dfd58
Nov 16 07:16:39 box kernel: [34284.152005]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34284.152005] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34284.152005] Stack:
Nov 16 07:16:39 box kernel: [34284.152005]  c1160062 f45dfd9c 00000000 00000000 00000000 ffffffff 000377fe 000377fe
Nov 16 07:16:39 box kernel: [34284.152005]  00000000 f45dfda4 00000002 00001000 c1a41ac0 004352da f45dfdd4 f45dfde0
Nov 16 07:16:39 box kernel: [34284.152005]  c116043c f45dfd9c f45dfd9c f45dfda4 f45dfda4 00000000 00000000 000377fe
Nov 16 07:16:39 box kernel: [34284.152005] Call Trace:
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1160062>] ? compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34284.152005]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34284.152005]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34284.152005]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34284.152005]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34284.152005]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34284.152005]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34284.152005]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34284.152005]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34284.152005] Code: 08 7e 07 8b 52 30 85 d2 75 5b 83 c0 01 83 f8 0b 75 db bf 02 00 00 00 8d b6 00 00 00 00 89 f8 8b 5d f4 8b 75 f8 8b 7d fc 89 ec 5d <c3> 90 8b 46 2c bf 04 00 00 00 89 86 4c 03 00 00 89 86 50 03 00
Nov 16 07:16:39 box kernel: [34308.152007] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [clamscan:2868]
Nov 16 07:16:39 box kernel: [34308.152007] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34308.152007] CPU: 1 PID: 2868 Comm: clamscan Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34308.152007] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34308.152007] task: f6acb100 ti: ec63a000 task.ti: ec63a000
Nov 16 07:16:39 box kernel: [34308.152007] EIP: 0060:[<c11443c0>] EFLAGS: 00000206 CPU: 1
Nov 16 07:16:39 box kernel: [34308.152007] EIP is at zone_watermark_ok+0xa0/0xe0
Nov 16 07:16:39 box kernel: [34308.152007] EAX: 00000c88 EBX: 00000365 ECX: 00000004 EDX: 00003051
Nov 16 07:16:39 box kernel: [34308.152007] ESI: c1a41b5c EDI: 00000009 EBP: ec63bab8 ESP: ec63baa8
Nov 16 07:16:39 box kernel: [34308.152007]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34308.152007] CR0: 80050033 CR2: a5000000 CR3: 2c0d6000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34308.152007] Stack:
Nov 16 07:16:39 box kernel: [34308.152007]  00005619 ec63bb20 c1a41ac0 00000002 ec63bad8 c115e791 00000000 00000000
Nov 16 07:16:39 box kernel: [34308.152007]  00000002 ec63bb20 c1a41ac0 c1a41ac0 ec63bb18 c1160062 ec63bb20 00000000
Nov 16 07:16:39 box kernel: [34308.152007]  00000000 fffff000 00000014 000377fe 000377fe 00000000 ec63bb28 00000002
Nov 16 07:16:39 box kernel: [34308.152007] Call Trace:
Nov 16 07:16:39 box kernel: [34308.152007]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34308.152007]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34308.152007]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1195cd0>] ? commit_charge+0x20/0x70
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1190887>] do_huge_pmd_wp_page+0xf7/0x570
Nov 16 07:16:39 box kernel: [34308.152007]  [<c11685cf>] ? handle_pte_fault+0x1bf/0x1f0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c11688c1>] __handle_mm_fault+0x211/0x290
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1168a27>] handle_mm_fault+0xe7/0x150
Nov 16 07:16:39 box kernel: [34308.152007]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c104d197>] __do_page_fault+0x187/0x520
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1143c20>] ? prep_new_page+0xe0/0x1b0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1146649>] ? get_page_from_freelist+0x1b9/0x3c0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c104d621>] do_page_fault+0x21/0x30
Nov 16 07:16:39 box kernel: [34308.152007]  [<c16ca613>] error_code+0x67/0x6c
Nov 16 07:16:39 box kernel: [34308.152007]  [<c116233f>] ? copy_page_to_iter_iovec+0x4f/0x240
Nov 16 07:16:39 box kernel: [34308.152007]  [<c11628d6>] copy_page_to_iter+0x26/0x70
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1140699>] do_generic_file_read+0x159/0x4d0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c114169e>] generic_file_read_iter+0x11e/0x190
Nov 16 07:16:39 box kernel: [34308.152007]  [<c1168887>] ? __handle_mm_fault+0x1d7/0x290
Nov 16 07:16:39 box kernel: [34308.152007]  [<c119e1fc>] new_sync_read+0x6c/0xa0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c119eac6>] vfs_read+0x86/0x160
Nov 16 07:16:39 box kernel: [34308.152007]  [<c119e190>] ? __kernel_write+0x140/0x140
Nov 16 07:16:39 box kernel: [34308.152007]  [<c119edb3>] SyS_pread64+0x93/0xa0
Nov 16 07:16:39 box kernel: [34308.152007]  [<c16c96df>] sysenter_do_call+0x12/0x12
Nov 16 07:16:39 box kernel: [34308.152007] Code: 89 4d f0 8b 4c 86 0c 31 c0 01 d9 39 4d f0 7e 3a 85 ff b8 01 00 00 00 74 31 2b 96 b4 00 00 00 31 c0 d1 fb 31 c9 39 da 7f 15 eb 1f <8b> 86 e8 00 00 00 d1 fb 83 c6 34 d3 e0 29 c2 39 da 7e 15 83 c1
Nov 16 07:16:39 box kernel: [34312.152005] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34312.152005] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34312.152005] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34312.152005] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34312.152005] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34312.152005] EIP: 0060:[<c1144329>] EFLAGS: 00000286 CPU: 0
Nov 16 07:16:39 box kernel: [34312.152005] EIP is at zone_watermark_ok+0x9/0xe0
Nov 16 07:16:39 box kernel: [34312.152005] EAX: c1a41ac0 EBX: f45dfd9c ECX: 00003659 EDX: 00000009
Nov 16 07:16:39 box kernel: [34312.152005] ESI: c1a41ac0 EDI: 00000002 EBP: f45dfd34 ESP: f45dfd24
Nov 16 07:16:39 box kernel: [34312.152005]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34312.152005] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34312.152005] Stack:
Nov 16 07:16:39 box kernel: [34312.152005]  f45dfd9c f45dfd9c c1a41ac0 00000002 f45dfd54 c115e791 00000000 00000000
Nov 16 07:16:39 box kernel: [34312.152005]  00000002 f45dfd9c c1a41ac0 c1a41ac0 f45dfd94 c1160062 f45dfd9c 00000000
Nov 16 07:16:39 box kernel: [34312.152005]  00000000 00000000 ffffffff 000377fe 000377fe 00000000 f45dfda4 00000002
Nov 16 07:16:39 box kernel: [34312.152005] Call Trace:
Nov 16 07:16:39 box kernel: [34312.152005]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34312.152005]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34312.152005]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34312.152005]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34312.152005]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34312.152005]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34312.152005]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34312.152005]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34312.152005]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34312.152005] Code: 45 d8 01 83 7d d8 0b 0f 85 45 ff ff ff 8b 55 d0 8b 45 d4 e8 ca 4e 58 00 83 c4 24 5b 5e 5f 5d c3 66 90 55 89 e5 57 56 53 83 ec 04 <3e> 8d 74 26 00 89 d7 89 c6 8b 80 80 03 00 00 89 cb ba 01 00 00
Nov 16 07:16:39 box kernel: [34316.996006] INFO: rcu_sched self-detected stall on CPU { 1}  (t=15000 jiffies g=60074 c=60073 q=8)
Nov 16 07:16:39 box kernel: [34316.996006] Task dump for CPU 1:
Nov 16 07:16:39 box kernel: [34316.996006] clamscan        R running      0  2868   2866 0x00000008
Nov 16 07:16:39 box kernel: [34316.996006]  f6acb100 f6acb100 ec63b8e0 c1080b6d c18e4341 00000000 00000b34 00000b32
Nov 16 07:16:39 box kernel: [34316.996006]  00000008 00000001 c19e7340 ec63b8f4 c1082ce6 c18e4388 00000001 c19e7340
Nov 16 07:16:39 box kernel: [34316.996006]  ec63b90c c10aff31 00000082 00000008 c19e7340 c1a5c7e4 ec63b934 c10b129a
Nov 16 07:16:39 box kernel: [34316.996006] Call Trace:
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1080b6d>] sched_show_task+0xad/0x120
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1082ce6>] dump_cpu_task+0x36/0x40
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10aff31>] rcu_dump_cpu_stacks+0x71/0xa0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b129a>] print_cpu_stall+0xca/0x120
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b13b5>] check_cpu_stall.isra.57+0xc5/0xd0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b13ea>] __rcu_pending+0x2a/0x120
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b30b7>] rcu_check_callbacks+0x87/0x150
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b79cb>] update_process_times+0x3b/0x70
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10c810d>] tick_sched_handle.isra.12+0x2d/0x70
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10c8243>] tick_sched_timer+0x43/0x90
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b7c00>] ? __remove_hrtimer+0x40/0xa0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b861e>] __run_hrtimer+0x6e/0x1d0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10c8200>] ? tick_nohz_handler+0xb0/0xb0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c10b8f80>] hrtimer_interrupt+0x210/0x2d0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c103d07e>] local_apic_timer_interrupt+0x2e/0x60
Nov 16 07:16:39 box kernel: [34316.996006]  [<c105e02d>] ? irq_enter+0xd/0x60
Nov 16 07:16:39 box kernel: [34316.996006]  [<c16ca903>] smp_apic_timer_interrupt+0x33/0x50
Nov 16 07:16:39 box kernel: [34316.996006]  [<c16ca03c>] apic_timer_interrupt+0x34/0x3c
Nov 16 07:16:39 box kernel: [34316.996006]  [<c115e7fa>] ? compact_finished+0xea/0x150
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34316.996006]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34316.996006]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1195cd0>] ? commit_charge+0x20/0x70
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1190887>] do_huge_pmd_wp_page+0xf7/0x570
Nov 16 07:16:39 box kernel: [34316.996006]  [<c11685cf>] ? handle_pte_fault+0x1bf/0x1f0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c11688c1>] __handle_mm_fault+0x211/0x290
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1168a27>] handle_mm_fault+0xe7/0x150
Nov 16 07:16:39 box kernel: [34316.996006]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c104d197>] __do_page_fault+0x187/0x520
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1143c20>] ? prep_new_page+0xe0/0x1b0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1146649>] ? get_page_from_freelist+0x1b9/0x3c0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c104d621>] do_page_fault+0x21/0x30
Nov 16 07:16:39 box kernel: [34316.996006]  [<c16ca613>] error_code+0x67/0x6c
Nov 16 07:16:39 box kernel: [34316.996006]  [<c116233f>] ? copy_page_to_iter_iovec+0x4f/0x240
Nov 16 07:16:39 box kernel: [34316.996006]  [<c11628d6>] copy_page_to_iter+0x26/0x70
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1140699>] do_generic_file_read+0x159/0x4d0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c114169e>] generic_file_read_iter+0x11e/0x190
Nov 16 07:16:39 box kernel: [34316.996006]  [<c1168887>] ? __handle_mm_fault+0x1d7/0x290
Nov 16 07:16:39 box kernel: [34316.996006]  [<c119e1fc>] new_sync_read+0x6c/0xa0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c119eac6>] vfs_read+0x86/0x160
Nov 16 07:16:39 box kernel: [34316.996006]  [<c119e190>] ? __kernel_write+0x140/0x140
Nov 16 07:16:39 box kernel: [34316.996006]  [<c119edb3>] SyS_pread64+0x93/0xa0
Nov 16 07:16:39 box kernel: [34316.996006]  [<c16c96df>] sysenter_do_call+0x12/0x12
Nov 16 07:16:39 box kernel: [34340.152005] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34340.152005] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34340.152005] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34340.152005] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34340.152005] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34340.152005] EIP: 0060:[<c115f972>] EFLAGS: 00000286 CPU: 0
Nov 16 07:16:39 box kernel: [34340.152005] EIP is at isolate_migratepages+0x102/0x190
Nov 16 07:16:39 box kernel: [34340.152005] EAX: 00000001 EBX: f45dfd9c ECX: f45dfda4 EDX: f45dfda4
Nov 16 07:16:39 box kernel: [34340.152005] ESI: 00037800 EDI: f45dfd9c EBP: f45dfd54 ESP: f45dfd4c
Nov 16 07:16:39 box kernel: [34340.152005]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34340.152005] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34340.152005] Stack:
Nov 16 07:16:39 box kernel: [34340.152005]  c1a41ac0 c1a41ac0 f45dfd94 c1160074 f45dfd9c 00000000 00000000 00000000
Nov 16 07:16:39 box kernel: [34340.152005]  ffffffff 000377fe 000377fe 00000000 f45dfda4 00000002 00001000 c1a41ac0
Nov 16 07:16:39 box kernel: [34340.152005]  004352da f45dfdd4 f45dfde0 c116043c f45dfd9c f45dfd9c f45dfda4 f45dfda4
Nov 16 07:16:39 box kernel: [34340.152005] Call Trace:
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1160074>] compact_zone+0x124/0x360
Nov 16 07:16:39 box kernel: [34340.152005]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34340.152005]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34340.152005]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34340.152005]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34340.152005]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34340.152005]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34340.152005]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34340.152005]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34340.152005] Code: f0 31 c0 85 f6 74 20 8b 5f 34 85 db 75 19 8b 45 ec 89 fa e8 b1 f0 ff ff 8b 45 f0 83 7f 14 01 89 47 1c 19 c0 83 c0 02 83 c4 14 5b <5e> 5f 5d c3 66 90 8b 00 89 da b9 03 00 00 00 c7 04 24 01 00 00
Nov 16 07:16:39 box kernel: [34344.152006] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [clamscan:2868]
Nov 16 07:16:39 box kernel: [34344.152006] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34344.152006] CPU: 1 PID: 2868 Comm: clamscan Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34344.152006] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34344.152006] task: f6acb100 ti: ec63a000 task.ti: ec63a000
Nov 16 07:16:39 box kernel: [34344.152006] EIP: 0060:[<c11443d1>] EFLAGS: 00000212 CPU: 1
Nov 16 07:16:39 box kernel: [34344.152006] EIP is at zone_watermark_ok+0xb1/0xe0
Nov 16 07:16:39 box kernel: [34344.152006] EAX: 00000bd8 EBX: 000006cb ECX: 00000002 EDX: 00003cd9
Nov 16 07:16:39 box kernel: [34344.152006] ESI: c1a41b28 EDI: 00000009 EBP: ec63bab8 ESP: ec63baa8
Nov 16 07:16:39 box kernel: [34344.152006]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34344.152006] CR0: 80050033 CR2: a5000000 CR3: 2c0d6000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34344.152006] Stack:
Nov 16 07:16:39 box kernel: [34344.152006]  00005619 ec63bb20 c1a41ac0 00000002 ec63bad8 c115e791 00000000 00000000
Nov 16 07:16:39 box kernel: [34344.152006]  00000002 ec63bb20 c1a41ac0 c1a41ac0 ec63bb18 c1160062 ec63bb20 00000000
Nov 16 07:16:39 box kernel: [34344.152006]  00000000 fffff000 00000014 000377fe 000377fe 00000000 ec63bb28 00000002
Nov 16 07:16:39 box kernel: [34344.152006] Call Trace:
Nov 16 07:16:39 box kernel: [34344.152006]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34344.152006]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34344.152006]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1195cd0>] ? commit_charge+0x20/0x70
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1190887>] do_huge_pmd_wp_page+0xf7/0x570
Nov 16 07:16:39 box kernel: [34344.152006]  [<c11685cf>] ? handle_pte_fault+0x1bf/0x1f0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c11688c1>] __handle_mm_fault+0x211/0x290
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1168a27>] handle_mm_fault+0xe7/0x150
Nov 16 07:16:39 box kernel: [34344.152006]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c104d197>] __do_page_fault+0x187/0x520
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1143c20>] ? prep_new_page+0xe0/0x1b0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1146649>] ? get_page_from_freelist+0x1b9/0x3c0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c104d621>] do_page_fault+0x21/0x30
Nov 16 07:16:39 box kernel: [34344.152006]  [<c16ca613>] error_code+0x67/0x6c
Nov 16 07:16:39 box kernel: [34344.152006]  [<c116233f>] ? copy_page_to_iter_iovec+0x4f/0x240
Nov 16 07:16:39 box kernel: [34344.152006]  [<c11628d6>] copy_page_to_iter+0x26/0x70
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1140699>] do_generic_file_read+0x159/0x4d0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c114169e>] generic_file_read_iter+0x11e/0x190
Nov 16 07:16:39 box kernel: [34344.152006]  [<c1168887>] ? __handle_mm_fault+0x1d7/0x290
Nov 16 07:16:39 box kernel: [34344.152006]  [<c119e1fc>] new_sync_read+0x6c/0xa0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c119eac6>] vfs_read+0x86/0x160
Nov 16 07:16:39 box kernel: [34344.152006]  [<c119e190>] ? __kernel_write+0x140/0x140
Nov 16 07:16:39 box kernel: [34344.152006]  [<c119edb3>] SyS_pread64+0x93/0xa0
Nov 16 07:16:39 box kernel: [34344.152006]  [<c16c96df>] sysenter_do_call+0x12/0x12
Nov 16 07:16:39 box kernel: [34344.152006] Code: ff b8 01 00 00 00 74 31 2b 96 b4 00 00 00 31 c0 d1 fb 31 c9 39 da 7f 15 eb 1f 8b 86 e8 00 00 00 d1 fb 83 c6 34 d3 e0 29 c2 39 da <7e> 15 83 c1 01 39 cf 75 e6 b8 01 00 00 00 83 c4 04 5b 5e 5f 5d
Nov 16 07:16:39 box kernel: [34353.929955] sched: RT throttling activated
Nov 16 07:16:39 box kernel: [34448.152009] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34448.152009] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34448.152009] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34448.152009] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34448.152009] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34448.152009] EIP: 0060:[<c11443c8>] EFLAGS: 00000202 CPU: 0
Nov 16 07:16:39 box kernel: [34448.152009] EIP is at zone_watermark_ok+0xa8/0xe0
Nov 16 07:16:39 box kernel: [34448.152009] EAX: 000002f6 EBX: 000006cb ECX: 00000002 EDX: 000048e1
Nov 16 07:16:39 box kernel: [34448.152009] ESI: c1a41af4 EDI: 00000009 EBP: f45dfd34 ESP: f45dfd24
Nov 16 07:16:39 box kernel: [34448.152009]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34448.152009] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34448.152009] Stack:
Nov 16 07:16:39 box kernel: [34448.152009]  0000561d f45dfd9c c1a41ac0 00000002 f45dfd54 c115e791 00000000 00000000
Nov 16 07:16:39 box kernel: [34448.152009]  00000002 f45dfd9c c1a41ac0 c1a41ac0 f45dfd94 c1160062 f45dfd9c 00000000
Nov 16 07:16:39 box kernel: [34448.152009]  00000000 f6fcf300 f45dfd74 000377fe 000377fe 00000000 f45dfda4 00000002
Nov 16 07:16:39 box kernel: [34448.152009] Call Trace:
Nov 16 07:16:39 box kernel: [34448.152009]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34448.152009]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34448.152009]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34448.152009]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34448.152009]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34448.152009]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34448.152009]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34448.152009]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34448.152009]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34448.152009] Code: c0 01 d9 39 4d f0 7e 3a 85 ff b8 01 00 00 00 74 31 2b 96 b4 00 00 00 31 c0 d1 fb 31 c9 39 da 7f 15 eb 1f 8b 86 e8 00 00 00 d1 fb <83> c6 34 d3 e0 29 c2 39 da 7e 15 83 c1 01 39 cf 75 e6 b8 01 00
Nov 16 07:16:39 box kernel: [34473.936071] INFO: task md3_raid1:184 blocked for more than 120 seconds.
Nov 16 07:16:39 box kernel: [34473.944656]       Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34473.953209] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 16 07:16:39 box kernel: [34473.961866] md3_raid1       D 00003000     0   184      2 0x00000000
Nov 16 07:16:39 box kernel: [34473.961880]  f68bde38 00000046 00000001 00003000 f3c33180 a5cf1399 00001f3e 00000000
Nov 16 07:16:39 box kernel: [34473.961898]  f6920c40 c1b48300 f42521c0 c1b48300 c12f1797 f6fbf300 f6920c40 f6496e40
Nov 16 07:16:39 box kernel: [34473.961916]  f68bddf4 c12f37bf f3c33180 f68bde4c c12f383a f72d4520 00818789 00000000
Nov 16 07:16:39 box kernel: [34473.961935] Call Trace:
Nov 16 07:16:39 box kernel: [34473.961958]  [<c12f1797>] ? generic_make_request.part.74+0x57/0x90
Nov 16 07:16:39 box kernel: [34473.961969]  [<c12f37bf>] ? generic_make_request+0x4f/0x60
Nov 16 07:16:39 box kernel: [34473.961980]  [<c12f383a>] ? submit_bio+0x6a/0x140
Nov 16 07:16:39 box kernel: [34473.961993]  [<c1091d51>] ? prepare_to_wait_event+0x71/0xd0
Nov 16 07:16:39 box kernel: [34473.962007]  [<c16c5fa3>] schedule+0x23/0x60
Nov 16 07:16:39 box kernel: [34473.962019]  [<c155934d>] md_super_wait+0x3d/0x70
Nov 16 07:16:39 box kernel: [34473.962030]  [<c1091db0>] ? prepare_to_wait_event+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34473.962041]  [<c1559578>] md_update_sb.part.58+0x1f8/0x630
Nov 16 07:16:39 box kernel: [34473.962053]  [<c154fbc9>] ? md_wakeup_thread+0x39/0x70
Nov 16 07:16:39 box kernel: [34473.962064]  [<c15599c4>] md_update_sb+0x14/0x40
Nov 16 07:16:39 box kernel: [34473.962075]  [<c155a9c9>] md_check_recovery.part.60+0x259/0x460
Nov 16 07:16:39 box kernel: [34473.962086]  [<c155abe4>] md_check_recovery+0x14/0x20
Nov 16 07:16:39 box kernel: [34473.962120]  [<f81d99b1>] raid1d+0x21/0x140 [raid1]
Nov 16 07:16:39 box kernel: [34473.962132]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34473.962143]  [<c1553374>] md_thread+0xe4/0x110
Nov 16 07:16:39 box kernel: [34473.962154]  [<c1091db0>] ? prepare_to_wait_event+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34473.962164]  [<c1553290>] ? md_rdev_init+0x100/0x100
Nov 16 07:16:39 box kernel: [34473.962176]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34473.962188]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34473.962199]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34473.962241] INFO: task kworker/u4:2:3200 blocked for more than 120 seconds.
Nov 16 07:16:39 box kernel: [34473.971039]       Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34473.979796] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 16 07:16:39 box kernel: [34473.988490] kworker/u4:2    D f6fcee80     0  3200      2 0x00000000
Nov 16 07:16:39 box kernel: [34473.988509] Workqueue: writeback bdi_writeback_workfn (flush-252:4)
Nov 16 07:16:39 box kernel: [34473.988517]  f46a3a68 00000046 f6fd0300 f6fcee80 f46a39f4 a5bf204e 00001f3e f46a39fc
Nov 16 07:16:39 box kernel: [34473.988535]  00000001 c1b48300 f6bf9880 c1b48300 f6fd0300 f6fcf300 f40b7460 f6749880
Nov 16 07:16:39 box kernel: [34473.988552]  c106e477 00000000 00000003 f6a2d40c f6a2d408 00000082 f6a2d408 00000008
Nov 16 07:16:39 box kernel: [34473.988570] Call Trace:
Nov 16 07:16:39 box kernel: [34473.988583]  [<c106e477>] ? __queue_work+0x107/0x2c0
Nov 16 07:16:39 box kernel: [34473.988596]  [<c1091d51>] ? prepare_to_wait_event+0x71/0xd0
Nov 16 07:16:39 box kernel: [34473.988608]  [<c16c5fa3>] schedule+0x23/0x60
Nov 16 07:16:39 box kernel: [34473.988619]  [<c1557f0d>] md_write_start.part.41+0x6d/0x180
Nov 16 07:16:39 box kernel: [34473.988630]  [<c1091db0>] ? prepare_to_wait_event+0xd0/0xd0
Nov 16 07:16:39 box kernel: [34473.988641]  [<c1558039>] md_write_start+0x19/0x20
Nov 16 07:16:39 box kernel: [34473.988662]  [<f81da972>] make_request+0x52/0xa40 [raid1]
Nov 16 07:16:39 box kernel: [34473.988674]  [<c1562f17>] ? __split_and_process_bio+0xd7/0x130
Nov 16 07:16:39 box kernel: [34473.988685]  [<c1552600>] md_make_request+0xc0/0x1e0
Nov 16 07:16:39 box kernel: [34473.988698]  [<c12f1797>] generic_make_request.part.74+0x57/0x90
Nov 16 07:16:39 box kernel: [34473.988708]  [<c12f37bf>] generic_make_request+0x4f/0x60
Nov 16 07:16:39 box kernel: [34473.988718]  [<c12f383a>] submit_bio+0x6a/0x140
Nov 16 07:16:39 box kernel: [34473.988731]  [<c14b0680>] ? ata_scsiop_mode_sense+0x310/0x310
Nov 16 07:16:39 box kernel: [34473.988742]  [<c12ecff4>] ? bio_alloc_bioset+0x94/0x1b0
Nov 16 07:16:39 box kernel: [34473.988753]  [<c11cbfc4>] _submit_bh+0xf4/0x140
Nov 16 07:16:39 box kernel: [34473.988763]  [<c11cc01f>] submit_bh+0xf/0x20
Nov 16 07:16:39 box kernel: [34473.988774]  [<c11cd86b>] __block_write_full_page.constprop.36+0x1db/0x380
Nov 16 07:16:39 box kernel: [34473.988784]  [<c11cdc60>] ? I_BDEV+0x10/0x10
Nov 16 07:16:39 box kernel: [34473.988795]  [<c11cdb9a>] block_write_full_page+0x9a/0xd0
Nov 16 07:16:39 box kernel: [34473.988805]  [<c11cdc60>] ? I_BDEV+0x10/0x10
Nov 16 07:16:39 box kernel: [34473.988815]  [<c11ce514>] blkdev_writepage+0x14/0x20
Nov 16 07:16:39 box kernel: [34473.988827]  [<c1148150>] __writepage+0x10/0x40
Nov 16 07:16:39 box kernel: [34473.988838]  [<c1148760>] write_cache_pages+0x190/0x3e0
Nov 16 07:16:39 box kernel: [34473.988849]  [<c1148140>] ? set_page_dirty_lock+0x50/0x50
Nov 16 07:16:39 box kernel: [34473.988862]  [<c11489ec>] generic_writepages+0x3c/0x60
Nov 16 07:16:39 box kernel: [34473.988873]  [<c1149961>] do_writepages+0x21/0x40
Nov 16 07:16:39 box kernel: [34473.988884]  [<c11c19b8>] __writeback_single_inode+0x38/0x170
Nov 16 07:16:39 box kernel: [34473.988895]  [<c11c2f15>] writeback_sb_inodes+0x1c5/0x290
Nov 16 07:16:39 box kernel: [34473.988905]  [<c1087e46>] ? update_curr+0x206/0x2d0
Nov 16 07:16:39 box kernel: [34473.988917]  [<c11c3054>] __writeback_inodes_wb+0x74/0xa0
Nov 16 07:16:39 box kernel: [34473.988927]  [<c11c329a>] wb_writeback+0x21a/0x2b0
Nov 16 07:16:39 box kernel: [34473.988939]  [<c11c33b0>] wb_check_old_data_flush+0x80/0x90
Nov 16 07:16:39 box kernel: [34473.988950]  [<c11c34b0>] wb_do_writeback+0xf0/0x150
Nov 16 07:16:39 box kernel: [34473.988961]  [<c1329efe>] ? vsnprintf+0x1be/0x3a0
Nov 16 07:16:39 box kernel: [34473.988973]  [<c11c4eb0>] bdi_writeback_workfn+0x70/0x1a0
Nov 16 07:16:39 box kernel: [34473.988984]  [<c108146f>] ? wake_up_process+0x1f/0x40
Nov 16 07:16:39 box kernel: [34473.988995]  [<c106fb91>] process_one_work+0x121/0x3a0
Nov 16 07:16:39 box kernel: [34473.989006]  [<c10b7707>] ? mod_timer+0xd7/0x1b0
Nov 16 07:16:39 box kernel: [34473.989017]  [<c1081420>] ? default_wake_function+0x10/0x20
Nov 16 07:16:39 box kernel: [34473.989028]  [<c10703a0>] worker_thread+0xf0/0x370
Nov 16 07:16:39 box kernel: [34473.989039]  [<c109185f>] ? __wake_up_locked+0x1f/0x30
Nov 16 07:16:39 box kernel: [34473.989049]  [<c10702b0>] ? create_worker+0x1b0/0x1b0
Nov 16 07:16:39 box kernel: [34473.989060]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34473.989071]  [<c105cfef>] ? do_exit+0x22f/0x3d0
Nov 16 07:16:39 box kernel: [34473.989083]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34473.989094]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34473.989104] INFO: task kworker/u4:1:3217 blocked for more than 120 seconds.
Nov 16 07:16:39 box kernel: [34473.997763]       Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34474.006398] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 16 07:16:39 box kernel: [34474.015016] kworker/u4:1    D 62633737     0  3217      2 0x00000000
Nov 16 07:16:39 box kernel: [34474.015033] Workqueue: writeback bdi_writeback_workfn (flush-252:2)
Nov 16 07:16:39 box kernel: [34474.015041]  ec75b958 00000046 34326335 62633737 38643934 a5cad739 00001f3e 33616466
Nov 16 07:16:39 box kernel: [34474.015059]  61393431 c1b48300 f42521c0 c1b48300 00000000 f6fbf300 f6923100 f6accfa0
Nov 16 07:16:39 box kernel: [34474.015076]  6d616c63 342d7661 35323763 35666532 64376563 61343031 36353763 ec75b954
Nov 16 07:16:39 box kernel: [34474.015094] Call Trace:
Nov 16 07:16:39 box kernel: [34474.015109]  [<c10be933>] ? ktime_get+0x53/0x110
Nov 16 07:16:39 box kernel: [34474.015121]  [<c16c5fa3>] schedule+0x23/0x60
Nov 16 07:16:39 box kernel: [34474.015132]  [<c16c6058>] io_schedule+0x78/0xb0
Nov 16 07:16:39 box kernel: [34474.015143]  [<c16c6775>] bit_wait_io+0x25/0x40
Nov 16 07:16:39 box kernel: [34474.015153]  [<c16c655f>] __wait_on_bit+0x4f/0x70
Nov 16 07:16:39 box kernel: [34474.015164]  [<c16c6750>] ? bit_wait_timeout+0x70/0x70
Nov 16 07:16:39 box kernel: [34474.015175]  [<c16c6750>] ? bit_wait_timeout+0x70/0x70
Nov 16 07:16:39 box kernel: [34474.015186]  [<c16c6661>] out_of_line_wait_on_bit+0x61/0x70
Nov 16 07:16:39 box kernel: [34474.015198]  [<c1091e50>] ? wake_atomic_t_function+0x50/0x50
Nov 16 07:16:39 box kernel: [34474.015210]  [<c1253112>] do_get_write_access+0x172/0x400
Nov 16 07:16:39 box kernel: [34474.015222]  [<c1204c29>] ? ext4_read_block_bitmap_nowait+0x79/0x310
Nov 16 07:16:39 box kernel: [34474.015233]  [<c12534b7>] jbd2_journal_get_write_access+0x27/0x40
Nov 16 07:16:39 box kernel: [34474.015244]  [<c1239f34>] __ext4_journal_get_write_access+0x34/0x80
Nov 16 07:16:39 box kernel: [34474.015256]  [<c1241540>] ext4_mb_mark_diskspace_used+0x60/0x550
Nov 16 07:16:39 box kernel: [34474.015266]  [<c123fba3>] ? ext4_mb_regular_allocator+0x253/0x3e0
Nov 16 07:16:39 box kernel: [34474.015278]  [<c1242c86>] ext4_mb_new_blocks+0x3a6/0x500
Nov 16 07:16:39 box kernel: [34474.015290]  [<c1232175>] ? ext4_ext_find_goal+0x95/0xa0
Nov 16 07:16:39 box kernel: [34474.015302]  [<c1238830>] ext4_ext_map_blocks+0x720/0x8f0
Nov 16 07:16:39 box kernel: [34474.015316]  [<c120cf15>] ext4_map_blocks+0x145/0x530
Nov 16 07:16:39 box kernel: [34474.015328]  [<c114af6d>] ? release_pages+0x19d/0x210
Nov 16 07:16:39 box kernel: [34474.015340]  [<c120d36c>] mpage_map_one_extent+0x6c/0x190
Nov 16 07:16:39 box kernel: [34474.015352]  [<c1211e9e>] mpage_map_and_submit_extent+0x5e/0x290
Nov 16 07:16:39 box kernel: [34474.015362]  [<c1239d2c>] ? __ext4_journal_start_sb+0x5c/0xc0
Nov 16 07:16:39 box kernel: [34474.015374]  [<c1212589>] ext4_writepages+0x4b9/0x6b0
Nov 16 07:16:39 box kernel: [34474.015385]  [<c108b623>] ? update_cpu_capacity+0x53/0xd0
Nov 16 07:16:39 box kernel: [34474.015396]  [<c108ba1c>] ? update_sd_lb_stats+0x27c/0x370
Nov 16 07:16:39 box kernel: [34474.015409]  [<c1149961>] do_writepages+0x21/0x40
Nov 16 07:16:39 box kernel: [34474.015420]  [<c11c19b8>] __writeback_single_inode+0x38/0x170
Nov 16 07:16:39 box kernel: [34474.015431]  [<c11c2f15>] writeback_sb_inodes+0x1c5/0x290
Nov 16 07:16:39 box kernel: [34474.015442]  [<c11c3054>] __writeback_inodes_wb+0x74/0xa0
Nov 16 07:16:39 box kernel: [34474.015453]  [<c11c329a>] wb_writeback+0x21a/0x2b0
Nov 16 07:16:39 box kernel: [34474.015464]  [<c10832eb>] ? sched_clock_local+0xcb/0x1c0
Nov 16 07:16:39 box kernel: [34474.015476]  [<c11c33b0>] wb_check_old_data_flush+0x80/0x90
Nov 16 07:16:39 box kernel: [34474.015486]  [<c11c34b0>] wb_do_writeback+0xf0/0x150
Nov 16 07:16:39 box kernel: [34474.015496]  [<c1329efe>] ? vsnprintf+0x1be/0x3a0
Nov 16 07:16:39 box kernel: [34474.015508]  [<c11c4eb0>] bdi_writeback_workfn+0x70/0x1a0
Nov 16 07:16:39 box kernel: [34474.015519]  [<c108146f>] ? wake_up_process+0x1f/0x40
Nov 16 07:16:39 box kernel: [34474.015530]  [<c106fb91>] process_one_work+0x121/0x3a0
Nov 16 07:16:39 box kernel: [34474.015541]  [<c1081420>] ? default_wake_function+0x10/0x20
Nov 16 07:16:39 box kernel: [34474.015552]  [<c10703a0>] worker_thread+0xf0/0x370
Nov 16 07:16:39 box kernel: [34474.015562]  [<c109185f>] ? __wake_up_locked+0x1f/0x30
Nov 16 07:16:39 box kernel: [34474.015573]  [<c10702b0>] ? create_worker+0x1b0/0x1b0
Nov 16 07:16:39 box kernel: [34474.015584]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34474.015594]  [<c105cfef>] ? do_exit+0x22f/0x3d0
Nov 16 07:16:39 box kernel: [34474.015606]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34474.015617]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34476.152007] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34476.152007] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34476.152007] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34476.152007] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34476.152007] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34476.152007] EIP: 0060:[<c115e764>] EFLAGS: 00000202 CPU: 0
Nov 16 07:16:39 box kernel: [34476.152007] EIP is at compact_finished+0x54/0x150
Nov 16 07:16:39 box kernel: [34476.152007] EAX: 00037600 EBX: f45dfd9c ECX: 00000000 EDX: 00000009
Nov 16 07:16:39 box kernel: [34476.152007] ESI: c1a41ac0 EDI: 00000002 EBP: f45dfd54 ESP: f45dfd3c
Nov 16 07:16:39 box kernel: [34476.152007]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34476.152007] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34476.152007] Stack:
Nov 16 07:16:39 box kernel: [34476.152007]  00000004 c1a41ac0 00000002 f45dfd9c c1a41ac0 c1a41ac0 f45dfd94 c1160062
Nov 16 07:16:39 box kernel: [34476.152007]  f45dfd9c 00000000 00000000 f6fcf300 f45dfd74 000377fe 000377fe 00000000
Nov 16 07:16:39 box kernel: [34476.152007]  f45dfda4 00000002 00001000 c1a41ac0 004352da f45dfdd4 f45dfde0 c116043c
Nov 16 07:16:39 box kernel: [34476.152007] Call Trace:
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34476.152007]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34476.152007]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34476.152007]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34476.152007]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34476.152007]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34476.152007]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34476.152007]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34476.152007]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34476.152007] Code: 00 00 64 a1 d4 1f b4 c1 8b 50 04 8b 52 08 83 e2 04 0f 85 f7 00 00 00 8b 43 1c 39 43 18 0f 86 ac 00 00 00 8b 53 28 bf 02 00 00 00 <83> fa ff 0f 84 8b 00 00 00 89 d1 b8 01 00 00 00 d3 e0 03 46 04
Nov 16 07:16:39 box kernel: [34497.976007] INFO: rcu_sched self-detected stall on CPU { 0}  (t=15000 jiffies g=60100 c=60099 q=21)
Nov 16 07:16:39 box kernel: [34497.976007] Task dump for CPU 0:
Nov 16 07:16:39 box kernel: [34497.976007] khugepaged      R running      0    23      2 0x00000008
Nov 16 07:16:39 box kernel: [34497.976007]  f4c9f460 f4c9f460 f45dfb54 c1080b6d c18e4341 00000000 00000017 00000002
Nov 16 07:16:39 box kernel: [34497.976007]  00000008 00000000 c19e7340 f45dfb68 c1082ce6 c18e4388 00000000 c19e7340
Nov 16 07:16:39 box kernel: [34497.976007]  f45dfb80 c10aff31 00000082 00000015 c19e7340 c1a5c7e4 f45dfba8 c10b129a
Nov 16 07:16:39 box kernel: [34497.976007] Call Trace:
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1080b6d>] sched_show_task+0xad/0x120
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1082ce6>] dump_cpu_task+0x36/0x40
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10aff31>] rcu_dump_cpu_stacks+0x71/0xa0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b129a>] print_cpu_stall+0xca/0x120
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b13b5>] check_cpu_stall.isra.57+0xc5/0xd0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b13ea>] __rcu_pending+0x2a/0x120
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b30b7>] rcu_check_callbacks+0x87/0x150
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b79cb>] update_process_times+0x3b/0x70
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10c810d>] tick_sched_handle.isra.12+0x2d/0x70
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10c8243>] tick_sched_timer+0x43/0x90
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b7c00>] ? __remove_hrtimer+0x40/0xa0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b861e>] __run_hrtimer+0x6e/0x1d0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10c8200>] ? tick_nohz_handler+0xb0/0xb0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c10b8f80>] hrtimer_interrupt+0x210/0x2d0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c103d07e>] local_apic_timer_interrupt+0x2e/0x60
Nov 16 07:16:39 box kernel: [34497.976007]  [<c105e02d>] ? irq_enter+0xd/0x60
Nov 16 07:16:39 box kernel: [34497.976007]  [<c16ca903>] smp_apic_timer_interrupt+0x33/0x50
Nov 16 07:16:39 box kernel: [34497.976007]  [<c16ca03c>] apic_timer_interrupt+0x34/0x3c
Nov 16 07:16:39 box kernel: [34497.976007]  [<c16c007b>] ? add_children+0x3a2/0x4e5
Nov 16 07:16:39 box kernel: [34497.976007]  [<c115f8a0>] ? isolate_migratepages+0x30/0x190
Nov 16 07:16:39 box kernel: [34497.976007]  [<c115e791>] ? compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1160074>] compact_zone+0x124/0x360
Nov 16 07:16:39 box kernel: [34497.976007]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34497.976007]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34497.976007]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34497.976007]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34497.976007]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34497.976007]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34497.976007]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34497.976007]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34524.152007] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [khugepaged:23]
Nov 16 07:16:39 box kernel: [34524.152007] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:16:39 box kernel: [34524.152007] CPU: 0 PID: 23 Comm: khugepaged Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:16:39 box kernel: [34524.152007] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:16:39 box kernel: [34524.152007] task: f4c9f460 ti: f45de000 task.ti: f45de000
Nov 16 07:16:39 box kernel: [34524.152007] EIP: 0060:[<c11443d3>] EFLAGS: 00000206 CPU: 0
Nov 16 07:16:39 box kernel: [34524.152007] EIP is at zone_watermark_ok+0xb3/0xe0
Nov 16 07:16:39 box kernel: [34524.152007] EAX: 00000be0 EBX: 000001b2 ECX: 00000004 EDX: 00002493
Nov 16 07:16:39 box kernel: [34524.152007] ESI: c1a41b90 EDI: 00000009 EBP: f45dfd34 ESP: f45dfd24
Nov 16 07:16:39 box kernel: [34524.152007]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:16:39 box kernel: [34524.152007] CR0: 8005003b CR2: b6c3d196 CR3: 01b54000 CR4: 000007f0
Nov 16 07:16:39 box kernel: [34524.152007] Stack:
Nov 16 07:16:39 box kernel: [34524.152007]  0000561d f45dfd9c c1a41ac0 00000002 f45dfd54 c115e791 00000000 00000000
Nov 16 07:16:39 box kernel: [34524.152007]  00000002 f45dfd9c c1a41ac0 c1a41ac0 f45dfd94 c1160062 f45dfd9c 00000000
Nov 16 07:16:39 box kernel: [34524.152007]  00000000 f6fcf300 f45dfd74 000377fe 000377fe 00000000 f45dfda4 00000002
Nov 16 07:16:39 box kernel: [34524.152007] Call Trace:
Nov 16 07:16:39 box kernel: [34524.152007]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:16:39 box kernel: [34524.152007]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:16:39 box kernel: [34524.152007]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:16:39 box kernel: [34524.152007]  [<c118d8cc>] khugepaged_alloc_hugepage+0x4c/0x130
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1091efd>] ? finish_wait+0x4d/0x70
Nov 16 07:16:39 box kernel: [34524.152007]  [<c118eb90>] khugepaged_do_scan+0xb0/0x100
Nov 16 07:16:39 box kernel: [34524.152007]  [<c118ebe0>] ? khugepaged_do_scan+0x100/0x100
Nov 16 07:16:39 box kernel: [34524.152007]  [<c118ec05>] khugepaged+0x25/0x70
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1074deb>] kthread+0x9b/0xb0
Nov 16 07:16:39 box kernel: [34524.152007]  [<c16c9601>] ret_from_kernel_thread+0x21/0x30
Nov 16 07:16:39 box kernel: [34524.152007]  [<c1074d50>] ? flush_kthread_worker+0x80/0x80
Nov 16 07:16:39 box kernel: [34524.152007] Code: 01 00 00 00 74 31 2b 96 b4 00 00 00 31 c0 d1 fb 31 c9 39 da 7f 15 eb 1f 8b 86 e8 00 00 00 d1 fb 83 c6 34 d3 e0 29 c2 39 da 7e 15 <83> c1 01 39 cf 75 e6 b8 01 00 00 00 83 c4 04 5b 5e 5f 5d c3 90
Nov 16 07:16:39 box kernel: [34548.813787] blk_update_request: I/O error, dev sda, sector 16779272
Nov 16 07:16:39 box kernel: [34548.816007] md: super_written gets error=-5, uptodate=0
Nov 16 07:16:39 box kernel: [34548.816007] md/raid1:md3: Disk failure on sda3, disabling device.
Nov 16 07:16:39 box kernel: [34548.816007] md/raid1:md3: Operation continuing on 1 devices.
Nov 16 07:16:39 box kernel: [34548.832093] blk_update_request: I/O error, dev sdb, sector 16779272
Nov 16 07:16:39 box kernel: [34548.836007] md: super_written gets error=-5, uptodate=0
Nov 16 07:16:39 box kernel: [34549.673404] RAID1 conf printout:
Nov 16 07:16:39 box kernel: [34549.673427]  --- wd:1 rd:2
Nov 16 07:16:39 box kernel: [34549.673444]  disk 0, wo:1, o:0, dev:sda3
Nov 16 07:16:39 box kernel: [34549.673459]  disk 1, wo:0, o:1, dev:sdb3
Nov 16 07:16:39 box kernel: [34549.688163] RAID1 conf printout:
Nov 16 07:16:39 box kernel: [34549.688180]  --- wd:1 rd:2
Nov 16 07:16:39 box kernel: [34549.688192]  disk 1, wo:0, o:1, dev:sdb3
Nov 16 07:16:40 box mdadm[1634]: Fail event detected on md device /dev/md/03, component device /dev/sda3
Nov 16 07:16:40 box postfix/pickup[2751]: F32BD2034A: uid=0 from=<root>
Nov 16 07:16:41 box postfix/cleanup[3229]: F32BD2034A: message-id=<20141116061640.F32BD2034A@box>
Nov 16 07:16:41 box postfix/qmgr[1566]: F32BD2034A: from=<root@box>, size=938, nrcpt=1 (queue active)
Nov 16 07:16:41 box postfix/local[3231]: F32BD2034A: to=<root@box>, orig_to=<root>, relay=local, delay=0.55, delays=0.38/0.11/0/0.06, dsn=2.0.0, status=sent (delivered to mailbox)
Nov 16 07:16:41 box postfix/qmgr[1566]: F32BD2034A: removed
Nov 16 07:17:02 box CRON[3233]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Nov 16 07:17:30 box kernel: [34600.152010] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [clamscan:2868]
Nov 16 07:17:30 box kernel: [34600.152010] Modules linked in: xt_multiport iptable_filter ip_tables x_tables gpio_ich snd_hda_codec_realtek snd_hda_codec_generic coretemp snd_hda_intel serio_raw snd_hda_controller pl2303 snd_hda_codec i915 usbserial lpc_ich snd_hwdep snd_pcm drm_kms_helper snd_timer 8250_fintek snd drm soundcore video mac_hid i2c_algo_bit parport_pc ppdev lp parport dm_snapshot dm_bufio raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor ahci psmouse libahci r8169 raid6_pq sata_via raid1 raid0 multipath mii linear
Nov 16 07:17:30 box kernel: [34600.152010] CPU: 0 PID: 2868 Comm: clamscan Tainted: G             L 3.18.0-031800rc4-generic #201411091835
Nov 16 07:17:30 box kernel: [34600.152010] Hardware name:                  /D945GSEJT, BIOS JT94510H.86A.0045.2010.0519.1750 05/19/2010
Nov 16 07:17:30 box kernel: [34600.152010] task: f6acb100 ti: ec63a000 task.ti: ec63a000
Nov 16 07:17:30 box kernel: [34600.152010] EIP: 0060:[<c11443c8>] EFLAGS: 00000207 CPU: 0
Nov 16 07:17:30 box kernel: [34600.152010] EIP is at zone_watermark_ok+0xa8/0xe0
Nov 16 07:17:30 box kernel: [34600.152010] EAX: 0000003b EBX: 0000006c ECX: 00000006 EDX: 000016c5
Nov 16 07:17:30 box kernel: [34600.152010] ESI: c1a41bc4 EDI: 00000009 EBP: ec63bab8 ESP: ec63baa8
Nov 16 07:17:30 box kernel: [34600.152010]  DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Nov 16 07:17:30 box kernel: [34600.152010] CR0: 80050033 CR2: a6600000 CR3: 2c0d6000 CR4: 000007f0
Nov 16 07:17:30 box kernel: [34600.152010] Stack:
Nov 16 07:17:30 box kernel: [34600.152010]  00005541 ec63bb20 c1a41ac0 00000002 ec63bad8 c115e791 00000000 00000000
Nov 16 07:17:30 box kernel: [34600.152010]  00000002 ec63bb20 c1a41ac0 c1a41ac0 ec63bb18 c1160062 ec63bb20 00000000
Nov 16 07:17:30 box kernel: [34600.152010]  00000000 fffff000 00000000 000377fe 000377fe 00000000 ec63bb28 00000002
Nov 16 07:17:30 box kernel: [34600.152010] Call Trace:
Nov 16 07:17:30 box kernel: [34600.152010]  [<c115e791>] compact_finished+0x81/0x150
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1160062>] compact_zone+0x112/0x360
Nov 16 07:17:30 box kernel: [34600.152010]  [<c116043c>] compact_zone_order+0x4c/0x70
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1160536>] try_to_compact_pages+0xd6/0x280
Nov 16 07:17:30 box kernel: [34600.152010]  [<c16b5de8>] __alloc_pages_direct_compact+0x5b/0x167
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1146d4b>] __alloc_pages_nodemask+0x4fb/0x910
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1195cd0>] ? commit_charge+0x20/0x70
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1190887>] do_huge_pmd_wp_page+0xf7/0x570
Nov 16 07:17:30 box kernel: [34600.152010]  [<c11685cf>] ? handle_pte_fault+0x1bf/0x1f0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c11688c1>] __handle_mm_fault+0x211/0x290
Nov 16 07:17:30 box kernel: [34600.152010]  [<c11d2f2a>] ? mpage_bio_submit+0x2a/0x40
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1168a27>] handle_mm_fault+0xe7/0x150
Nov 16 07:17:30 box kernel: [34600.152010]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c104d197>] __do_page_fault+0x187/0x520
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1143c20>] ? prep_new_page+0xe0/0x1b0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c12f6032>] ? blk_finish_plug+0x12/0x40
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1149c2a>] ? read_pages+0x4a/0xd0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c104d600>] ? trace_do_page_fault+0xd0/0xd0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c104d621>] do_page_fault+0x21/0x30
Nov 16 07:17:30 box kernel: [34600.152010]  [<c16ca613>] error_code+0x67/0x6c
Nov 16 07:17:30 box kernel: [34600.152010]  [<c116233f>] ? copy_page_to_iter_iovec+0x4f/0x240
Nov 16 07:17:30 box kernel: [34600.152010]  [<c11628d6>] copy_page_to_iter+0x26/0x70
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1140699>] do_generic_file_read+0x159/0x4d0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c114169e>] generic_file_read_iter+0x11e/0x190
Nov 16 07:17:30 box kernel: [34600.152010]  [<c1168887>] ? __handle_mm_fault+0x1d7/0x290
Nov 16 07:17:30 box kernel: [34600.152010]  [<c119e1fc>] new_sync_read+0x6c/0xa0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c119eac6>] vfs_read+0x86/0x160
Nov 16 07:17:30 box kernel: [34600.152010]  [<c119e190>] ? __kernel_write+0x140/0x140
Nov 16 07:17:30 box kernel: [34600.152010]  [<c119edb3>] SyS_pread64+0x93/0xa0
Nov 16 07:17:30 box kernel: [34600.152010]  [<c16c96df>] sysenter_do_call+0x12/0x12
Nov 16 07:17:30 box kernel: [34600.152010] Code: c0 01 d9 39 4d f0 7e 3a 85 ff b8 01 00 00 00 74 31 2b 96 b4 00 00 00 31 c0 d1 fb 31 c9 39 da 7f 15 eb 1f 8b 86 e8 00 00 00 d1 fb <83> c6 34 d3 e0 29 c2 39 da 7e 15 83 c1 01 39 cf 75 e6 b8 01 00

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1356558

Title:
  BUG: soft lockup - CPU stuck for 22s! [md3_raid1]

Status in “linux” package in Ubuntu:
  Confirmed

Bug description:
  Hi,

  this bug appeared in Ubuntu 14.04, Ubuntu 12.04 didn't show this behavior. 
  I've found a possible predecessor in bug #212684.
  Switching to a recent mainline kernel didn't fix this issue.

  Starting

   $ /usr/share/mdadm/checkarray /dev/md3

  will repeat this behavior.

  /dev/md3 is a LVM PV:

    --- Physical volume ---
    PV Name               /dev/md3
    VG Name               local_vg1
    PV Size               1.36 TiB / not usable 2.25 MiB
    Allocatable           yes 
    PE Size               4.00 MiB
    Total PE              355619
    Free PE               31011
    Allocated PE          324608

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-3.13.0-33-generic 3.13.0-33.58
  ProcVersionSignature: Ubuntu 3.13.0-33.58-generic 3.13.11.4
  Uname: Linux 3.13.0-33-generic i686
  AlsaVersion: Advanced Linux Sound Architecture Driver Version k3.13.0-33-generic.
  AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
  ApportVersion: 2.14.1-0ubuntu3.3
  Architecture: i386
  ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', '/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', '/dev/snd/pcmC0D0p', '/dev/snd/pcmC0D1p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory: 'iw'
  Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer'
  Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer'
  Date: Wed Aug 13 21:42:12 2014
  HibernationDevice: RESUME=UUID=c4a03c5e-f650-4ca8-9dab-f0c4ad12c901
  InstallationDate: Installed on 2014-07-06 (37 days ago)
  InstallationMedia: Ubuntu-Server 14.04 LTS "Trusty Tahr" - Release i386 (20140416.2)
  IwConfig:
   lo        no wireless extensions.
   
   em1       no wireless extensions.
  ProcEnviron:
   LANGUAGE=en_GB:en
   TERM=xterm-256color
   PATH=(custom, no user)
   LANG=en_GB.UTF-8
   SHELL=/bin/bash
  ProcFB: 0 inteldrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-33-generic root=UUID=9c2715cb-dd8a-4687-9537-009e1e4e83d8 ro nomdmonddf nomdmonisw
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-33-generic N/A
   linux-backports-modules-3.13.0-33-generic  N/A
   linux-firmware                             1.127.5
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 05/19/2010
  dmi.bios.vendor: Intel Corp.
  dmi.bios.version: JT94510H.86A.0045.2010.0519.1750
  dmi.board.name: D945GSEJT
  dmi.board.vendor: Intel Corporation
  dmi.board.version: AAE57850-300
  dmi.chassis.type: 3
  dmi.modalias: dmi:bvnIntelCorp.:bvrJT94510H.86A.0045.2010.0519.1750:bd05/19/2010:svn:pn:pvr:rvnIntelCorporation:rnD945GSEJT:rvrAAE57850-300:cvn:ct3:cvr:

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1356558/+subscriptions
References

[Bug 1356558] [NEW] BUG: soft lockup - CPU stuck for 22s! [md3_raid1]
From: Uli Middelberg, 2014-08-13