kernel-packages team mailing list archive

[andrew bezella <abezella@xxxxxxxxxxx>]

Public bug reported:

we're in the process of migrating from 12.04 to 14.04 and are noticing a
problem apparently related to the kernel and ipmi.  after an
indeterminate period of regular ipmi queries (e.g., nagios checks using
ipmitool) the kipmi0 process pegs a cpu to ~100% usage and further
ipmitool commands hang.  the former is not a huge problem as the process
is niced and its cpu usage can be limited using the
/sys/module/ipmi_si/parameters/kipmid_max_busy_us interface.  however,
ipmitool's hanging severely degrades hardware monitoring.

this problem initially reared its head in our enviroment on a handful of
12.04 hosts on which hwe kernels were installed.  of the dozen deployed
14.04 hosts, four have started displaying these symptoms in the past
week.  all of the 12.04+hwe hosts were eventually affected; i believe
that given enough time all of the 14.04 hosts would be, as well.  a
reboot clears it up until its recurrence.

red hat has a bug logged that appears to match this:
https://bugzilla.redhat.com/show_bug.cgi?id=1090619  unfortunately the
work-around and proposed fix (from a duplicate bug) are currently non-
public.  it does look like they were able to identify the "ipmi:
simplify locking" patch from commit id
f60adf42ad55405d1b17e9e5c33fdb63f1eb8861 as the culprit. i have just
finished building a kernel from linux-source-3.13.0=3.13.0-37.64 w/this
patch reversed and will deploy it to see if the problem is alleviated.

thank you for your time and effort.

ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: linux-image-3.13.0-37-generic 3.13.0-37.64
ProcVersionSignature: Ubuntu 3.13.0-37.64-generic 3.13.11.7
Uname: Linux 3.13.0-37-generic x86_64
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116,  1 Oct 18 13:11 seq
 crw-rw---- 1 root audio 116, 33 Oct 18 13:11 timer
AplayDevices: aplay: device_list:268: no soundcards found...
ApportVersion: 2.14.1-0ubuntu3.5
Architecture: amd64
ArecordDevices: arecord: device_list:268: no soundcards found...
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory: 'iw'
Date: Tue Oct 21 12:55:43 2014
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
MachineType: Supermicro X8DT6
PciMultimedia:
 
ProcEnviron:
 TERM=rxvt-unicode-256color
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/usr/bin/zsh
ProcFB:
 
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-37-generic root=/dev/md0 ro consoleblank=0 console=tty0 console=ttyS2,115200n8 nomdmonddf nomdmonisw bootdegraded=true
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-37-generic N/A
 linux-backports-modules-3.13.0-37-generic  N/A
 linux-firmware                             1.127.7
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 05/15/2012
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 2.0c
dmi.board.asset.tag: 1234567890
dmi.board.name: X8DT6
dmi.board.vendor: Supermicro
dmi.board.version: 1234567890
dmi.chassis.asset.tag: To Be Filled By O.E.M.
dmi.chassis.type: 17
dmi.chassis.vendor: Supermicro
dmi.chassis.version: 1234567890
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr2.0c:bd05/15/2012:svnSupermicro:pnX8DT6:pvr1234567890:rvnSupermicro:rnX8DT6:rvr1234567890:cvnSupermicro:ct17:cvr1234567890:
dmi.product.name: X8DT6
dmi.product.version: 1234567890
dmi.sys.vendor: Supermicro

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: New


** Tags: amd64 apport-bug trusty

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1383921

Title:
  kipmi0 process hangs with ipmitool

Status in “linux” package in Ubuntu:
  New

Bug description:
  we're in the process of migrating from 12.04 to 14.04 and are noticing
  a problem apparently related to the kernel and ipmi.  after an
  indeterminate period of regular ipmi queries (e.g., nagios checks
  using ipmitool) the kipmi0 process pegs a cpu to ~100% usage and
  further ipmitool commands hang.  the former is not a huge problem as
  the process is niced and its cpu usage can be limited using the
  /sys/module/ipmi_si/parameters/kipmid_max_busy_us interface.  however,
  ipmitool's hanging severely degrades hardware monitoring.

  this problem initially reared its head in our enviroment on a handful
  of 12.04 hosts on which hwe kernels were installed.  of the dozen
  deployed 14.04 hosts, four have started displaying these symptoms in
  the past week.  all of the 12.04+hwe hosts were eventually affected; i
  believe that given enough time all of the 14.04 hosts would be, as
  well.  a reboot clears it up until its recurrence.

  red hat has a bug logged that appears to match this:
  https://bugzilla.redhat.com/show_bug.cgi?id=1090619  unfortunately the
  work-around and proposed fix (from a duplicate bug) are currently non-
  public.  it does look like they were able to identify the "ipmi:
  simplify locking" patch from commit id
  f60adf42ad55405d1b17e9e5c33fdb63f1eb8861 as the culprit. i have just
  finished building a kernel from linux-source-3.13.0=3.13.0-37.64
  w/this patch reversed and will deploy it to see if the problem is
  alleviated.

  thank you for your time and effort.

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-3.13.0-37-generic 3.13.0-37.64
  ProcVersionSignature: Ubuntu 3.13.0-37.64-generic 3.13.11.7
  Uname: Linux 3.13.0-37-generic x86_64
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Oct 18 13:11 seq
   crw-rw---- 1 root audio 116, 33 Oct 18 13:11 timer
  AplayDevices: aplay: device_list:268: no soundcards found...
  ApportVersion: 2.14.1-0ubuntu3.5
  Architecture: amd64
  ArecordDevices: arecord: device_list:268: no soundcards found...
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory: 'iw'
  Date: Tue Oct 21 12:55:43 2014
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  MachineType: Supermicro X8DT6
  PciMultimedia:
   
  ProcEnviron:
   TERM=rxvt-unicode-256color
   PATH=(custom, no user)
   LANG=en_US.UTF-8
   SHELL=/usr/bin/zsh
  ProcFB:
   
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-37-generic root=/dev/md0 ro consoleblank=0 console=tty0 console=ttyS2,115200n8 nomdmonddf nomdmonisw bootdegraded=true
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-37-generic N/A
   linux-backports-modules-3.13.0-37-generic  N/A
   linux-firmware                             1.127.7
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 05/15/2012
  dmi.bios.vendor: American Megatrends Inc.
  dmi.bios.version: 2.0c
  dmi.board.asset.tag: 1234567890
  dmi.board.name: X8DT6
  dmi.board.vendor: Supermicro
  dmi.board.version: 1234567890
  dmi.chassis.asset.tag: To Be Filled By O.E.M.
  dmi.chassis.type: 17
  dmi.chassis.vendor: Supermicro
  dmi.chassis.version: 1234567890
  dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr2.0c:bd05/15/2012:svnSupermicro:pnX8DT6:pvr1234567890:rvnSupermicro:rnX8DT6:rvr1234567890:cvnSupermicro:ct17:cvr1234567890:
  dmi.product.name: X8DT6
  dmi.product.version: 1234567890
  dmi.sys.vendor: Supermicro

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1383921/+subscriptions