kernel-packages team mailing list archive

Thread
Date
[Bug 1516736] Re: STC840: Brazos: Can't install Ubuntu to NPIV SAN drives.

To: kernel-packages@xxxxxxxxxxxxxxxxxxx
From: Steve Langasek <steve.langasek@xxxxxxxxxxxxx>
Date: Mon, 16 Nov 2015 20:04:41 -0000
Reply-to: Bug 1516736 <1516736@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Assigning this bug to the linux package since it's requesting a backport
of commits to the 14.04 kernel (3.13 upstream).  However, it's not
obvious why you are trying to boot using the 3.13-based images, instead
of the 3.19 based images that already support this.

** Package changed: ubuntu => linux (Ubuntu)

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1516736

Title:
  STC840: Brazos: Can't install Ubuntu to NPIV SAN drives.

Status in linux package in Ubuntu:
  New

Bug description:
  I am trying to setup a dual VIOS, virtual SAN environment on Brazos
  system br403.  The system is using Spookfish fiber adapters.  I was
  able to install Ubuntu (both version 13 and 14 kernels) to partitions
  if the LUNs were setup as virtual SCSI.  However, with the LUNs setup
  using NPIV, we have been unable to get any Ubuntu kernel to recognize
  that there's any drives attached.

  The ibmvfc driver on 14.04.3 is missing important commits (including a
  LE fix), and 15.10 has all of them.

  From what I could see, ibmvfc can not complete the NPIV login, so neither the SCSI scan, then it goes offline.
  This might be related to the missing commits - 
    so, to confirm it, the next step is to test w/ 15.10.

  
  Commits Missing in 14.04.3 (present in 15.10 and mainline)
  ------------------------

  2014-12-04	ibmvfc: remove unused tag variable
  2014-12-04	scsi: remove ->change_queue_type method
  2014-11-24	scsi: drop reason argument from ->change_queue_depth
  2014-11-24	scsi: avoid ->change_queue_depth indirection for queue full tracking
  2014-11-12	scsi: don't set tagging state from scsi_adjust_queue_depth
  2014-11-12	scsi: always assign block layer tags if enabled
  2014-11-12	scsi: remove abuses of scsi_populate_tag
  2014-11-12	scsi: provide a generic change_queue_type method
  2014-07-25	ibmvfc: fix little endian issues
  2014-07-17	scsi: use 64-bit value for 'max_luns'
  2014-04-18	sched, treewide: Replace hardcoded nice values with MIN_NICE/MAX_NICE

  upstream: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/log/drivers/scsi/ibmvscsi/ibmvfc.c
  15.10: http://kernel.ubuntu.com/git/ubuntu/ubuntu-wily.git/log/drivers/scsi/ibmvscsi/ibmvfc.c
  14.04.3: http://kernel.ubuntu.com/git/ubuntu/ubuntu-trusty.git/log/drivers/scsi/ibmvscsi/ibmvfc.c


  Analysis:
  -----------

  On the installer, after no disks were detected, dropped to a shell.

  ~ # dmesg
  ...
  [    0.000000] Linux version 3.13.0-55-generic (buildd@fisher04) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #94-Ubuntu SMP Thu Jun 18 00:27:16 UTC 2015 (Ubuntu 3.13.0-55.94-generic 3.13.11-ckt20)
  ...
  [  132.534167] ibmvfc: IBM Virtual Fibre Channel Driver version: 1.0.11 (April 12, 2013)
  [  132.534739] scsi0 : IBM POWER Virtual FC Adapter
  [  132.535657] ibmvfc 30000003: Partner initialization complete
  [  132.535684] ibmvfc 30000003: Send error (rc=-4)
  [  147.535735] ibmvfc 30000003: Send error (rc=-4)
  [  162.545739] ibmvfc 30000003: Send error (rc=-4)
  [  177.555742] ibmvfc 30000003: Send error (rc=-4)
  [  192.565740] ibmvfc 30000003: Send error (rc=-4)
  [  207.575736] ibmvfc 30000003: Send error (rc=-4)
  [  213.185825] ibmvfc 30000003: Partner initialization complete
  [  228.195741] ibmvfc 30000003: Send error (rc=-4)
  [  228.195744] ibmvfc 30000003: Host initialization retries exceeded. Taking adapter offline
  [  252.535731] ibmvfc 30000003: Scan taking longer than 120 seconds, continuing initialization
  [  252.536205] scsi1 : IBM POWER Virtual FC Adapter
  [  252.537195] ibmvfc 30000004: Partner initialization complete
  [  252.537214] ibmvfc 30000004: Send error (rc=-4)
  [  267.545735] ibmvfc 30000004: Send error (rc=-4)
  [  282.555737] ibmvfc 30000004: Send error (rc=-4)
  [  297.565736] ibmvfc 30000004: Send error (rc=-4)
  [  312.575745] ibmvfc 30000004: Send error (rc=-4)
  [  327.585742] ibmvfc 30000004: Send error (rc=-4)
  [  333.195802] ibmvfc 30000004: Partner initialization complete
  [  348.205742] ibmvfc 30000004: Send error (rc=-4)
  [  348.205745] ibmvfc 30000004: Host initialization retries exceeded. Taking adapter offline
  [  372.545732] ibmvfc 30000004: Scan taking longer than 120 seconds, continuing initialization

  
  Which seems quite clear by itself, but let's get more details:

  ~ # dmesg -c >/dev/null
  ~ # modprobe -r ibmvfc
  ~ # modprobe ibmvfc debug=1 log_level=4
  <wait>
  ~ # dmesg
  [  872.342687] ibmvfc: IBM Virtual Fibre Channel Driver version: 1.0.11 (April 12, 2013)
  [  872.342699] ibmvfc: Entering ibmvfc_probe
  [  872.342768] ibmvfc: Entering ibmvfc_alloc_mem
  [  872.342802] ibmvfc: Leaving ibmvfc_alloc_mem
  [  872.342858] ibmvfc: Entering ibmvfc_init_crq
  [  872.343175] ibmvfc: Leaving ibmvfc_init_crq
  [  872.343176] ibmvfc: Entering ibmvfc_init_event_pool
  [  872.343189] ibmvfc: Leaving ibmvfc_init_event_pool
  [  872.343191] scsi2 : IBM POWER Virtual FC Adapter
  [  872.343884] ibmvfc 30000003: Sending CRQ init
  [  872.343922] ibmvfc 30000003: Partner initialization complete
  [  872.343940] ibmvfc 30000003: Send error (rc=-4)
  [  872.343943] ibmvfc 30000003: Sent NPIV login
  [  887.345734] ibmvfc 30000003: Send error (rc=-4)
  [  887.345737] ibmvfc 30000003: Sent NPIV login
  [  902.355737] ibmvfc 30000003: Send error (rc=-4)
  [  902.355739] ibmvfc 30000003: Sent NPIV login
  [  917.365734] ibmvfc 30000003: Send error (rc=-4)
  [  917.365736] ibmvfc 30000003: Sent NPIV login
  [  932.375739] ibmvfc 30000003: Send error (rc=-4)
  [  932.375742] ibmvfc 30000003: Sent NPIV login
  [  947.385734] ibmvfc 30000003: Send error (rc=-4)
  [  947.385736] ibmvfc 30000003: Purging all requests
  [  947.385737] ibmvfc: Entering ibmvfc_link_down
  [  947.385738] ibmvfc: Leaving ibmvfc_link_down
  [  947.385739] ibmvfc 30000003: Sent NPIV login
  [  952.995787] ibmvfc 30000003: Sending CRQ init
  [  952.995826] ibmvfc 30000003: Partner initialization complete
  [  968.005734] ibmvfc 30000003: Send error (rc=-4)
  [  968.005736] ibmvfc 30000003: Host initialization retries exceeded. Taking adapter offline
  [  968.005737] ibmvfc: Entering ibmvfc_link_down
  [  968.005738] ibmvfc: Leaving ibmvfc_link_down
  [  968.005739] ibmvfc 30000003: Sent NPIV login
  [  992.335730] ibmvfc 30000003: Scan taking longer than 120 seconds, continuing initialization
  [  992.335741] ibmvfc: Entering ibmvfc_probe
  [  992.335805] ibmvfc: Entering ibmvfc_alloc_mem
  [  992.335835] ibmvfc: Leaving ibmvfc_alloc_mem
  [  992.335887] ibmvfc: Entering ibmvfc_init_crq
  [  992.336173] ibmvfc: Leaving ibmvfc_init_crq
  [  992.336174] ibmvfc: Entering ibmvfc_init_event_pool
  [  992.336187] ibmvfc: Leaving ibmvfc_init_event_pool
  [  992.336188] scsi3 : IBM POWER Virtual FC Adapter
  [  992.337018] ibmvfc 30000004: Sending CRQ init
  [  992.337056] ibmvfc 30000004: Partner initialization complete
  [  992.337075] ibmvfc 30000004: Send error (rc=-4)
  [  992.337080] ibmvfc 30000004: Sent NPIV login
  [ 1007.345742] ibmvfc 30000004: Send error (rc=-4)
  [ 1007.345745] ibmvfc 30000004: Sent NPIV login
  [ 1022.355737] ibmvfc 30000004: Send error (rc=-4)
  [ 1022.355739] ibmvfc 30000004: Sent NPIV login
  [ 1037.365739] ibmvfc 30000004: Send error (rc=-4)
  [ 1037.365741] ibmvfc 30000004: Sent NPIV login
  [ 1052.375740] ibmvfc 30000004: Send error (rc=-4)
  [ 1052.375743] ibmvfc 30000004: Sent NPIV login
  [ 1067.385732] ibmvfc 30000004: Send error (rc=-4)
  [ 1067.385734] ibmvfc 30000004: Purging all requests
  [ 1067.385736] ibmvfc: Entering ibmvfc_link_down
  [ 1067.385737] ibmvfc: Leaving ibmvfc_link_down
  [ 1067.385738] ibmvfc 30000004: Sent NPIV login
  [ 1072.995805] ibmvfc 30000004: Sending CRQ init
  [ 1072.995851] ibmvfc 30000004: Partner initialization complete
  [ 1088.005734] ibmvfc 30000004: Send error (rc=-4)
  [ 1088.005736] ibmvfc 30000004: Host initialization retries exceeded. Taking adapter offline
  [ 1088.005737] ibmvfc: Entering ibmvfc_link_down
  [ 1088.005738] ibmvfc: Leaving ibmvfc_link_down
  [ 1088.005739] ibmvfc 30000004: Sent NPIV login
  [ 1112.335729] ibmvfc 30000004: Scan taking longer than 120 seconds, continuing initialization

  I don't think ibmvfc LE enablement went in until the vivid kernel
  (3.19).

  > Canonical,
  > 
  > Please cherry pick this commit from mainline to Trusty SRU:
  > 
  >     0aab6c3f125e9efcc493caae0cffefe501202a71 ibmvfc: fix little endian issues
  > 
  > It is present in Ubuntu since Vivid, and we missed the backport request.
  > 
  > Thanks!

  That commit is already in a HWE backport kernel. Namely the vivid
  backport kernel. I think the problem here is that the NIM image needs
  to provide a HWE kernel for users who need to install on NPIV disks.
  If these are netboot images it should be the 3.19 one from here:

  http://cdimage.ubuntu.com/netboot/14.04/

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1516736/+subscriptions