kernel-packages team mailing list archive

[Daniel <1590072@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

When trying to install 16.04 LTS on a BL465c Gen8, the default kernel
4.4.0-21.37-generic does not detect the disks with IOMMU enabled.

Using the HP iLO Cli, shows that the server have some hardware error:

enclosure68-a> show server status 4
Blade #4 Status:
        Power: On
        Current Wattage used: 343
        Health: Failed
        Unit Identification LED: Blinking
        Virtual Fan: 100%
        Diagnostic Status:
                Internal Data                            OK
                Management Processor                     OK
                I/O Configuration                        OK
                Power                                    OK
                Cooling                                  OK
                Location                                 OK
                Device Failure                           Failed
                Device Degraded                          OK
                VCM Configured                           Other
                iLO Network                              OK
                Mezzanine Card                           OK

This device failure in the blade is OK after a reboot.

Disabling IOMMU on BIOS and the 16.04 installation goes successfully. 
I tried to enable IOMMU after the installation and the problem appears. The disk is not detected and it can't boot normally.
Ubuntu 14.04 LTS boots and run fine on these machines.

dmesg ouput with IOMMU enabled.

[   82.295300] HP HPSA Driver (v 3.4.14-0)
[   82.295327] hpsa 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
[   82.295350] hpsa 0000:03:00.0: MSI-X capable controller
[   82.295993] pps_core: LinuxPPS API ver. 1 registered
[   82.295996] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[   82.297857] PTP clock support registered
[   82.316730] bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10)
[   82.320096] AVX version of gcm_enc/dec engaged.
[   82.320100] AES CTR mode by8 optimization enabled
[   82.320501] ACPI: PCI Interrupt Link [I0C0] enabled at IRQ 36
[   82.320614] bnx2x 0000:04:00.0: msix capability found
[   82.320755] bnx2x 0000:04:00.0: part number 0-0-0-0
[   82.443473] ACPI: PCI Interrupt Link [I0C1] enabled at IRQ 37
[   82.443510] bnx2x 0000:04:00.1: msix capability found
[   82.443615] bnx2x 0000:04:00.1: part number 0-0-0-0
[   82.563309] ipmi_si IPI0001:00: Found new BMC (man_id: 0x00000b, prod_id: 0x2020, dev_id: 0x13)
[   82.563320] ipmi_si IPI0001:00: IPMI kcs interface initialized
[   82.566422] bnx2x 0000:04:00.0 eno1: renamed from eth0
[   82.585454] bnx2x 0000:04:00.1 eno2: renamed from eth1
[  207.105793] hpsa 0000:03:00.0: board not ready, timed out.

dmesg with IOMMU disabled.

[   80.818467] HP HPSA Driver (v 3.4.14-0)
[   80.818493] hpsa 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
[   80.818514] hpsa 0000:03:00.0: MSI-X capable controller
[   80.818878] hpsa 0000:03:00.0: Logical aborts not supported
[   80.818881] hpsa 0000:03:00.0: HP SSD Smart Path aborts not supported
[   80.819325] pps_core: LinuxPPS API ver. 1 registered
[   80.819328] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[   80.821272] PTP clock support registered
[   80.838135] bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10)
[   80.838402] bnx2x 0000:04:00.0: msix capability found
[   80.838535] bnx2x 0000:04:00.0: part number 0-0-0-0
[   80.841536] AVX version of gcm_enc/dec engaged.
[   80.841541] AES CTR mode by8 optimization enabled
[   80.864399] scsi host4: hpsa
[   80.872507] hpsa 0000:03:00.0: scsi 4:3:0:0: added RAID              HP       P220i            controller SSDSmartPathCap- En- Exp=1
[   80.872513] hpsa 0000:03:00.0: scsi 4:0:0:0: masked Direct-Access     ATA      VK0240GDJXU      PHYS DRV SSDSmartPathCap- En- Exp=0
[   80.872517] hpsa 0000:03:00.0: scsi 4:0:1:0: masked Direct-Access     ATA      VK0240GDJXU      PHYS DRV SSDSmartPathCap- En- Exp=0
[   80.872521] hpsa 0000:03:00.0: scsi 4:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap- En- Exp=1
[   80.873094] scsi 4:0:0:0: RAID              HP       P220i            6.68 PQ: 0 ANSI: 5
[   80.873416] scsi 4:1:0:0: Direct-Access     HP       LOGICAL VOLUME   6.68 PQ: 0 ANSI: 5
[   80.873775] scsi 4:0:0:0: Attached scsi generic sg1 type 12
[   80.874046] sd 4:1:0:0: Attached scsi generic sg2 type 0
[   80.874081] sd 4:1:0:0: [sda] 468792000 512-byte logical blocks: (240 GB/224 GiB)
[   80.874308] sd 4:1:0:0: [sda] Write Protect is off
[   80.874312] sd 4:1:0:0: [sda] Mode Sense: 73 00 00 08
[   80.874395] sd 4:1:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   80.875958] sd 4:1:0:0: [sda] Attached SCSI disk

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: New


** Tags: blade

** Attachment added: "lscpi-vnv-iommu-disabled"
   https://bugs.launchpad.net/bugs/1590072/+attachment/4679047/+files/lspci-vnv-iommu-disabled.log

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1590072

Title:
  kernel 4.4.0-21.37-generic in 16.04 sees no disks on HP ProLiant
  BL465c Gen8  if IOMMU is enabled

Status in linux package in Ubuntu:
  New

Bug description:
  When trying to install 16.04 LTS on a BL465c Gen8, the default kernel
  4.4.0-21.37-generic does not detect the disks with IOMMU enabled.

  Using the HP iLO Cli, shows that the server have some hardware error:

  enclosure68-a> show server status 4
  Blade #4 Status:
          Power: On
          Current Wattage used: 343
          Health: Failed
          Unit Identification LED: Blinking
          Virtual Fan: 100%
          Diagnostic Status:
                  Internal Data                            OK
                  Management Processor                     OK
                  I/O Configuration                        OK
                  Power                                    OK
                  Cooling                                  OK
                  Location                                 OK
                  Device Failure                           Failed
                  Device Degraded                          OK
                  VCM Configured                           Other
                  iLO Network                              OK
                  Mezzanine Card                           OK

  This device failure in the blade is OK after a reboot.

  Disabling IOMMU on BIOS and the 16.04 installation goes successfully. 
  I tried to enable IOMMU after the installation and the problem appears. The disk is not detected and it can't boot normally.
  Ubuntu 14.04 LTS boots and run fine on these machines.

  dmesg ouput with IOMMU enabled.

  [   82.295300] HP HPSA Driver (v 3.4.14-0)
  [   82.295327] hpsa 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
  [   82.295350] hpsa 0000:03:00.0: MSI-X capable controller
  [   82.295993] pps_core: LinuxPPS API ver. 1 registered
  [   82.295996] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
  [   82.297857] PTP clock support registered
  [   82.316730] bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10)
  [   82.320096] AVX version of gcm_enc/dec engaged.
  [   82.320100] AES CTR mode by8 optimization enabled
  [   82.320501] ACPI: PCI Interrupt Link [I0C0] enabled at IRQ 36
  [   82.320614] bnx2x 0000:04:00.0: msix capability found
  [   82.320755] bnx2x 0000:04:00.0: part number 0-0-0-0
  [   82.443473] ACPI: PCI Interrupt Link [I0C1] enabled at IRQ 37
  [   82.443510] bnx2x 0000:04:00.1: msix capability found
  [   82.443615] bnx2x 0000:04:00.1: part number 0-0-0-0
  [   82.563309] ipmi_si IPI0001:00: Found new BMC (man_id: 0x00000b, prod_id: 0x2020, dev_id: 0x13)
  [   82.563320] ipmi_si IPI0001:00: IPMI kcs interface initialized
  [   82.566422] bnx2x 0000:04:00.0 eno1: renamed from eth0
  [   82.585454] bnx2x 0000:04:00.1 eno2: renamed from eth1
  [  207.105793] hpsa 0000:03:00.0: board not ready, timed out.

  dmesg with IOMMU disabled.

  [   80.818467] HP HPSA Driver (v 3.4.14-0)
  [   80.818493] hpsa 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
  [   80.818514] hpsa 0000:03:00.0: MSI-X capable controller
  [   80.818878] hpsa 0000:03:00.0: Logical aborts not supported
  [   80.818881] hpsa 0000:03:00.0: HP SSD Smart Path aborts not supported
  [   80.819325] pps_core: LinuxPPS API ver. 1 registered
  [   80.819328] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
  [   80.821272] PTP clock support registered
  [   80.838135] bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10)
  [   80.838402] bnx2x 0000:04:00.0: msix capability found
  [   80.838535] bnx2x 0000:04:00.0: part number 0-0-0-0
  [   80.841536] AVX version of gcm_enc/dec engaged.
  [   80.841541] AES CTR mode by8 optimization enabled
  [   80.864399] scsi host4: hpsa
  [   80.872507] hpsa 0000:03:00.0: scsi 4:3:0:0: added RAID              HP       P220i            controller SSDSmartPathCap- En- Exp=1
  [   80.872513] hpsa 0000:03:00.0: scsi 4:0:0:0: masked Direct-Access     ATA      VK0240GDJXU      PHYS DRV SSDSmartPathCap- En- Exp=0
  [   80.872517] hpsa 0000:03:00.0: scsi 4:0:1:0: masked Direct-Access     ATA      VK0240GDJXU      PHYS DRV SSDSmartPathCap- En- Exp=0
  [   80.872521] hpsa 0000:03:00.0: scsi 4:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap- En- Exp=1
  [   80.873094] scsi 4:0:0:0: RAID              HP       P220i            6.68 PQ: 0 ANSI: 5
  [   80.873416] scsi 4:1:0:0: Direct-Access     HP       LOGICAL VOLUME   6.68 PQ: 0 ANSI: 5
  [   80.873775] scsi 4:0:0:0: Attached scsi generic sg1 type 12
  [   80.874046] sd 4:1:0:0: Attached scsi generic sg2 type 0
  [   80.874081] sd 4:1:0:0: [sda] 468792000 512-byte logical blocks: (240 GB/224 GiB)
  [   80.874308] sd 4:1:0:0: [sda] Write Protect is off
  [   80.874312] sd 4:1:0:0: [sda] Mode Sense: 73 00 00 08
  [   80.874395] sd 4:1:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
  [   80.875958] sd 4:1:0:0: [sda] Attached SCSI disk

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1590072/+subscriptions