kernel-packages team mailing list archive

Thread
Date
[Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts

To: kernel-packages@xxxxxxxxxxxxxxxxxxx
From: Rafael David Tinoco <rafael.tinoco@xxxxxxxxxxxxx>
Date: Tue, 11 Aug 2015 20:23:57 -0000
Reply-to: Bug 1443648 <1443648@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
I was able to verify that the new kernel fixes the issue:

root@dixie:~# uname -a
Linux dixie 3.13.0-62-generic #101-Ubuntu SMP Thu Jul 30 09:01:36 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

root@dixie:~# iscsiadm -m discovery --op=show --type sendtargets --portal 172.16.0.1 -I iser
172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1

root@dixie:~# iscsiadm -m discovery --op=new --op=del --type sendtargets --portal 172.16.0.1 -I iser
172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1

root@dixie:~# iscsiadm -m node -l
Logging in to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] (multiple)
Login to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful.

root@dixie:~# ls /dev/sdc
/dev/sdc

root@dixie:~# dd if=/dev/zero of=/dev/sdc bs=1M count=1024 oflag=direct
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 1.01833 s, 1.1 GB/s

root@dixie:~# service open-iscsi stop
 * Unmounting iscsi-backed filesystems                                            [ OK ]
 * Disconnecting iSCSI targets                                                           Logging out of session [sid: 3, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260]

### NO KERNEL PANIC!!! (as it used to happen)

Logout of [sid: 3, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful.
                                                                                  [ OK ]
 * Stopping iSCSI initiator service                                               [ OK ]
root@dixie:~#
root@dixie:~#
root@dixie:~# service open-iscsi start
 * Starting iSCSI initiator service iscsid                                        [ OK ]
 * Setting up iSCSI targets
iscsiadm: No records found
                                                                                  [ OK ]
 * Mounting network filesystems                                                   [ OK ]

** Tags removed: verification-needed-trusty
** Tags added: verification-done

** Tags added: sts

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1443648

Title:
  Kernel panics on iSER (iscsi over IB) logouts

Status in linux package in Ubuntu:
  Invalid
Status in linux source package in Trusty:
  Fix Committed

Bug description:
  SRU Justification:

  Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics.
  Fix: Upstream development and devel bisection between 3.13 and 3.16.
  Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). 

  ---------------------

  While shutting down the "open-iscsi" daemon (with an iSER mapped
  volume from other host) I'm getting the following kernel panic for
  kernel 3.13.0-49:

  """
  [272820.948946] scsi15 : iSCSI Initiator over iSER
  [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache
  [272843.998231] BUG: unable to handle kernel paging request at ffffffffa03840b7
  [272843.998258] IP: [<ffffffffa03840b7>] 0xffffffffa03840b7
  [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0
  [272843.998306] Oops: 0010 [#1] SMP
  [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa
  [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu
  [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013
  [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm]
  [272843.998789] task: ffff88080b72c800 ti: ffff880802522000 task.ti: ffff880802522000
  [272843.998827] RIP: 0010:[<ffffffffa03840b7>]  [<ffffffffa03840b7>] 0xffffffffa03840b7
  [272843.998870] RSP: 0018:ffff880802523c28  EFLAGS: 00010296
  [272843.998893] RAX: ffff8800b851d801 RBX: ffff8807af8482b8 RCX: 0000000180200008
  [272843.998929] RDX: 0000000180200009 RSI: 0000000080200008 RDI: ffff88081f003900
  [272843.998965] RBP: ffff880802523c30 R08: 0000000000000000 R09: 0000000000000001
  [272843.999002] R10: ffffea0002e14740 R11: ffffffffa00e0b9a R12: ffff88080953e400
  [272843.999038] R13: ffff8807af8482b8 R14: ffff88080953e400 R15: 0000000000000000
  [272843.999075] FS:  0000000000000000(0000) GS:ffff88083f420000(0000) knlGS:0000000000000000
  [272843.999113] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  [272843.999136] CR2: ffffffffa03840b7 CR3: 00000008024f1000 CR4: 00000000000407e0
  [272843.999173] Stack:
  [272843.999191]  ffff8807af540000 ffff880802523c60 ffffffffa0386425 ffff8807af8482b8
  [272843.999245]  ffff88080953e400 ffff88080acf9fa8 ffff880802523cf0 ffff880802523ca0
  [272843.999297]  ffffffffa0384f58 ffffffff810aacc4 ffff8807af8482b8 ffff8807af8482d0
  [272843.999349] Call Trace:
  [272843.999378]  [<ffffffff810aacc4>] ? __wake_up+0x44/0x50
  [272843.999406]  [<ffffffffa03c436b>] ? cma_comp_exch+0x4b/0x60 [rdma_cm]
  [272843.999432]  [<ffffffffa03c6429>] ? cma_ib_handler+0xf9/0x230 [rdma_cm]
  [272843.999460]  [<ffffffffa01b2166>] ? cm_process_work+0x26/0x150 [ib_cm]
  [272843.999487]  [<ffffffffa01b4183>] ? cm_work_handler+0xa83/0x161c [ib_cm]
  [272843.999515]  [<ffffffff81083a82>] ? process_one_work+0x182/0x450
  [272843.999540]  [<ffffffff81084871>] ? worker_thread+0x121/0x410
  [272843.999565]  [<ffffffff81084750>] ? rescuer_thread+0x430/0x430
  [272843.999590]  [<ffffffff8108b5b2>] ? kthread+0xd2/0xf0
  [272843.999615]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [272843.999641]  [<ffffffff8173258c>] ? ret_from_fork+0x7c/0xb0
  [272843.999666]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [272843.999691] Code:  Bad RIP value.
  [272843.999721] RIP  [<ffffffffa03840b7>] 0xffffffffa03840b7
  [272843.999749]  RSP <ffff880802523c28>
  [272843.999770] CR2: ffffffffa03840b7
  """
  I got also this one (looks the same):

  """
  [  479.240278] BUG: unable to handle kernel paging request at ffffffffa04af0b7
  [  479.240453] IP: [<ffffffffa04af0b7>] 0xffffffffa04af0b7
  [  479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0
  [  479.240849] Oops: 0010 [#1] SMP
  [  479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_
  [  479.245546]
  [  479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu
  [  479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013
  [  479.245734] Workqueue: ib_cm cm_work_handler [ib_cm]
  [  479.245847] task: ffff880811ad6000 ti: ffff880811420000 task.ti: ffff880811420000
  [  479.245923] RIP: 0010:[<ffffffffa04af0b7>]  [<ffffffffa04af0b7>] 0xffffffffa04af0b7
  [  479.246065] RSP: 0018:ffff880811421c28  EFLAGS: 00010296
  [  479.246138] RAX: ffff8807f6d85501 RBX: ffff8807e613a2b8 RCX: 0000000180200009
  [  479.246212] RDX: 000000018020000a RSI: 0000000080200009 RDI: ffff88081f003900
  [  479.246287] RBP: ffff880811421c30 R08: 0000000000000000 R09: 0000000000000001
  [  479.246361] R10: ffffea001fdb6140 R11: ffffffffa00f7b9a R12: ffff8807e6238c00
  [  479.246435] R13: ffff8807e613a2b8 R14: ffff8807e6238c00 R15: 0000000000000000
  [  479.246510] FS:  0000000000000000(0000) GS:ffff88083f440000(0000) knlGS:0000000000000000
  [  479.246597] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  [  479.246669] CR2: ffffffffa04af0b7 CR3: 0000000811549000 CR4: 00000000000407e0
  [  479.246743] Stack:
  [  479.246811]  ffff8807e6ac0000 ffff880811421c60 ffffffffa04b1425 ffff8807e613a2b8
  [  479.247113]  ffff8807e6238c00 ffff88081218f6a8 ffff880811421cf0 ffff880811421ca0
  [  479.247412]  ffffffffa04aff58 ffffffff810aacc4 ffff8807e613a2b8 ffff8807e613a2d0
  [  479.247712] Call Trace:
  [  479.247790]  [<ffffffff810aacc4>] ? __wake_up+0x44/0x50
  [  479.247867]  [<ffffffffa045436b>] ? cma_comp_exch+0x4b/0x60 [rdma_cm]
  [  479.247943]  [<ffffffffa0456429>] ? cma_ib_handler+0xf9/0x230 [rdma_cm]
  [  479.248019]  [<ffffffffa0247166>] ? cm_process_work+0x26/0x150 [ib_cm]
  [  479.248095]  [<ffffffffa0249183>] ? cm_work_handler+0xa83/0x161c [ib_cm]
  [  479.248172]  [<ffffffff81083a82>] ? process_one_work+0x182/0x450
  [  479.248247]  [<ffffffff81084871>] ? worker_thread+0x121/0x410
  [  479.248321]  [<ffffffff81084750>] ? rescuer_thread+0x430/0x430
  [  479.248396]  [<ffffffff8108b5b2>] ? kthread+0xd2/0xf0
  [  479.248469]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [  479.248546]  [<ffffffff8173258c>] ? ret_from_fork+0x7c/0xb0
  [  479.248620]  [<ffffffff8108b4e0>] ? kthread_create_on_node+0x1c0/0x1c0
  [  479.248693] Code:  Bad RIP value.
  [  479.248871] RIP  [<ffffffffa04af0b7>] 0xffffffffa04af0b7
  [  479.248999]  RSP <ffff880811421c28>
  [  479.249068] CR2: ffffffffa04af0b7
  """
  I'll be working on fixing this since I'm fixing also:

  https://bugs.launchpad.net/ubuntu/+source/open-iscsi/+bug/1401575

  By backporting TGT daemon to support iSER.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1443648/+subscriptions
References

[Bug 1443648] [NEW] Kernel panics on iSER (iscsi over IB) logouts
From: Rafael David Tinoco, 2015-04-13