kernel-packages team mailing list archive

[Launchpad Bug Tracker <1516736@xxxxxxxxxxxxxxxxxx>]

You have been subscribed to a public bug:

I am trying to setup a dual VIOS, virtual SAN environment on Brazos
system br403.  The system is using Spookfish fiber adapters.  I was able
to install Ubuntu (both version 13 and 14 kernels) to partitions if the
LUNs were setup as virtual SCSI.  However, with the LUNs setup using
NPIV, we have been unable to get any Ubuntu kernel to recognize that
there's any drives attached.

The ibmvfc driver on 14.04.3 is missing important commits (including a
LE fix), and 15.10 has all of them.

>From what I could see, ibmvfc can not complete the NPIV login, so neither the SCSI scan, then it goes offline.
This might be related to the missing commits - 
  so, to confirm it, the next step is to test w/ 15.10.


Commits Missing in 14.04.3 (present in 15.10 and mainline)
------------------------

2014-12-04	ibmvfc: remove unused tag variable
2014-12-04	scsi: remove ->change_queue_type method
2014-11-24	scsi: drop reason argument from ->change_queue_depth
2014-11-24	scsi: avoid ->change_queue_depth indirection for queue full tracking
2014-11-12	scsi: don't set tagging state from scsi_adjust_queue_depth
2014-11-12	scsi: always assign block layer tags if enabled
2014-11-12	scsi: remove abuses of scsi_populate_tag
2014-11-12	scsi: provide a generic change_queue_type method
2014-07-25	ibmvfc: fix little endian issues
2014-07-17	scsi: use 64-bit value for 'max_luns'
2014-04-18	sched, treewide: Replace hardcoded nice values with MIN_NICE/MAX_NICE

upstream: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/log/drivers/scsi/ibmvscsi/ibmvfc.c
15.10: http://kernel.ubuntu.com/git/ubuntu/ubuntu-wily.git/log/drivers/scsi/ibmvscsi/ibmvfc.c
14.04.3: http://kernel.ubuntu.com/git/ubuntu/ubuntu-trusty.git/log/drivers/scsi/ibmvscsi/ibmvfc.c


Analysis:
-----------

On the installer, after no disks were detected, dropped to a shell.

~ # dmesg
...
[    0.000000] Linux version 3.13.0-55-generic (buildd@fisher04) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #94-Ubuntu SMP Thu Jun 18 00:27:16 UTC 2015 (Ubuntu 3.13.0-55.94-generic 3.13.11-ckt20)
...
[  132.534167] ibmvfc: IBM Virtual Fibre Channel Driver version: 1.0.11 (April 12, 2013)
[  132.534739] scsi0 : IBM POWER Virtual FC Adapter
[  132.535657] ibmvfc 30000003: Partner initialization complete
[  132.535684] ibmvfc 30000003: Send error (rc=-4)
[  147.535735] ibmvfc 30000003: Send error (rc=-4)
[  162.545739] ibmvfc 30000003: Send error (rc=-4)
[  177.555742] ibmvfc 30000003: Send error (rc=-4)
[  192.565740] ibmvfc 30000003: Send error (rc=-4)
[  207.575736] ibmvfc 30000003: Send error (rc=-4)
[  213.185825] ibmvfc 30000003: Partner initialization complete
[  228.195741] ibmvfc 30000003: Send error (rc=-4)
[  228.195744] ibmvfc 30000003: Host initialization retries exceeded. Taking adapter offline
[  252.535731] ibmvfc 30000003: Scan taking longer than 120 seconds, continuing initialization
[  252.536205] scsi1 : IBM POWER Virtual FC Adapter
[  252.537195] ibmvfc 30000004: Partner initialization complete
[  252.537214] ibmvfc 30000004: Send error (rc=-4)
[  267.545735] ibmvfc 30000004: Send error (rc=-4)
[  282.555737] ibmvfc 30000004: Send error (rc=-4)
[  297.565736] ibmvfc 30000004: Send error (rc=-4)
[  312.575745] ibmvfc 30000004: Send error (rc=-4)
[  327.585742] ibmvfc 30000004: Send error (rc=-4)
[  333.195802] ibmvfc 30000004: Partner initialization complete
[  348.205742] ibmvfc 30000004: Send error (rc=-4)
[  348.205745] ibmvfc 30000004: Host initialization retries exceeded. Taking adapter offline
[  372.545732] ibmvfc 30000004: Scan taking longer than 120 seconds, continuing initialization


Which seems quite clear by itself, but let's get more details:

~ # dmesg -c >/dev/null
~ # modprobe -r ibmvfc
~ # modprobe ibmvfc debug=1 log_level=4
<wait>
~ # dmesg
[  872.342687] ibmvfc: IBM Virtual Fibre Channel Driver version: 1.0.11 (April 12, 2013)
[  872.342699] ibmvfc: Entering ibmvfc_probe
[  872.342768] ibmvfc: Entering ibmvfc_alloc_mem
[  872.342802] ibmvfc: Leaving ibmvfc_alloc_mem
[  872.342858] ibmvfc: Entering ibmvfc_init_crq
[  872.343175] ibmvfc: Leaving ibmvfc_init_crq
[  872.343176] ibmvfc: Entering ibmvfc_init_event_pool
[  872.343189] ibmvfc: Leaving ibmvfc_init_event_pool
[  872.343191] scsi2 : IBM POWER Virtual FC Adapter
[  872.343884] ibmvfc 30000003: Sending CRQ init
[  872.343922] ibmvfc 30000003: Partner initialization complete
[  872.343940] ibmvfc 30000003: Send error (rc=-4)
[  872.343943] ibmvfc 30000003: Sent NPIV login
[  887.345734] ibmvfc 30000003: Send error (rc=-4)
[  887.345737] ibmvfc 30000003: Sent NPIV login
[  902.355737] ibmvfc 30000003: Send error (rc=-4)
[  902.355739] ibmvfc 30000003: Sent NPIV login
[  917.365734] ibmvfc 30000003: Send error (rc=-4)
[  917.365736] ibmvfc 30000003: Sent NPIV login
[  932.375739] ibmvfc 30000003: Send error (rc=-4)
[  932.375742] ibmvfc 30000003: Sent NPIV login
[  947.385734] ibmvfc 30000003: Send error (rc=-4)
[  947.385736] ibmvfc 30000003: Purging all requests
[  947.385737] ibmvfc: Entering ibmvfc_link_down
[  947.385738] ibmvfc: Leaving ibmvfc_link_down
[  947.385739] ibmvfc 30000003: Sent NPIV login
[  952.995787] ibmvfc 30000003: Sending CRQ init
[  952.995826] ibmvfc 30000003: Partner initialization complete
[  968.005734] ibmvfc 30000003: Send error (rc=-4)
[  968.005736] ibmvfc 30000003: Host initialization retries exceeded. Taking adapter offline
[  968.005737] ibmvfc: Entering ibmvfc_link_down
[  968.005738] ibmvfc: Leaving ibmvfc_link_down
[  968.005739] ibmvfc 30000003: Sent NPIV login
[  992.335730] ibmvfc 30000003: Scan taking longer than 120 seconds, continuing initialization
[  992.335741] ibmvfc: Entering ibmvfc_probe
[  992.335805] ibmvfc: Entering ibmvfc_alloc_mem
[  992.335835] ibmvfc: Leaving ibmvfc_alloc_mem
[  992.335887] ibmvfc: Entering ibmvfc_init_crq
[  992.336173] ibmvfc: Leaving ibmvfc_init_crq
[  992.336174] ibmvfc: Entering ibmvfc_init_event_pool
[  992.336187] ibmvfc: Leaving ibmvfc_init_event_pool
[  992.336188] scsi3 : IBM POWER Virtual FC Adapter
[  992.337018] ibmvfc 30000004: Sending CRQ init
[  992.337056] ibmvfc 30000004: Partner initialization complete
[  992.337075] ibmvfc 30000004: Send error (rc=-4)
[  992.337080] ibmvfc 30000004: Sent NPIV login
[ 1007.345742] ibmvfc 30000004: Send error (rc=-4)
[ 1007.345745] ibmvfc 30000004: Sent NPIV login
[ 1022.355737] ibmvfc 30000004: Send error (rc=-4)
[ 1022.355739] ibmvfc 30000004: Sent NPIV login
[ 1037.365739] ibmvfc 30000004: Send error (rc=-4)
[ 1037.365741] ibmvfc 30000004: Sent NPIV login
[ 1052.375740] ibmvfc 30000004: Send error (rc=-4)
[ 1052.375743] ibmvfc 30000004: Sent NPIV login
[ 1067.385732] ibmvfc 30000004: Send error (rc=-4)
[ 1067.385734] ibmvfc 30000004: Purging all requests
[ 1067.385736] ibmvfc: Entering ibmvfc_link_down
[ 1067.385737] ibmvfc: Leaving ibmvfc_link_down
[ 1067.385738] ibmvfc 30000004: Sent NPIV login
[ 1072.995805] ibmvfc 30000004: Sending CRQ init
[ 1072.995851] ibmvfc 30000004: Partner initialization complete
[ 1088.005734] ibmvfc 30000004: Send error (rc=-4)
[ 1088.005736] ibmvfc 30000004: Host initialization retries exceeded. Taking adapter offline
[ 1088.005737] ibmvfc: Entering ibmvfc_link_down
[ 1088.005738] ibmvfc: Leaving ibmvfc_link_down
[ 1088.005739] ibmvfc 30000004: Sent NPIV login
[ 1112.335729] ibmvfc 30000004: Scan taking longer than 120 seconds, continuing initialization

I don't think ibmvfc LE enablement went in until the vivid kernel
(3.19).

> Canonical,
> 
> Please cherry pick this commit from mainline to Trusty SRU:
> 
>     0aab6c3f125e9efcc493caae0cffefe501202a71 ibmvfc: fix little endian issues
> 
> It is present in Ubuntu since Vivid, and we missed the backport request.
> 
> Thanks!

That commit is already in a HWE backport kernel. Namely the vivid
backport kernel. I think the problem here is that the NIM image needs to
provide a HWE kernel for users who need to install on NPIV disks. If
these are netboot images it should be the 3.19 one from here:

http://cdimage.ubuntu.com/netboot/14.04/

** Affects: linux (Ubuntu)
     Importance: Undecided
     Assignee: Taco Screen team (taco-screen-team)
         Status: New


** Tags: architecture-ppc64 bugnameltc-131765 severity-high targetmilestone-inin14043
-- 
STC840: Brazos: Can't install Ubuntu to NPIV SAN drives.
https://bugs.launchpad.net/bugs/1516736
You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu.