← Back to team overview

kernel-packages team mailing list archive

[Bug 1383921] Re: kipmi0 process hangs with ipmitool

 

Is there any news on this issue ? we have many nodes in our Openstack
cluster starting to suffer from this problem as we have a puppet fact
which runs ipmitool lan print and so triggers the bug often. Could you
also tell us what the workaround was for RHEL as we can't access the
page on RedHat's site. The workaround we have found is to remove and re-
add the ipmi_si module, but removing it takes a VERY long time ie. many
many hours

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1383921

Title:
  kipmi0 process hangs with ipmitool

Status in “linux” package in Ubuntu:
  In Progress
Status in “linux” source package in Precise:
  Invalid
Status in “linux” source package in Trusty:
  In Progress
Status in “linux” source package in Utopic:
  In Progress
Status in “linux” source package in Vivid:
  In Progress

Bug description:
  we're in the process of migrating from 12.04 to 14.04 and are noticing
  a problem apparently related to the kernel and ipmi.  after an
  indeterminate period of regular ipmi queries (e.g., nagios checks
  using ipmitool) the kipmi0 process pegs a cpu to ~100% usage and
  further ipmitool commands hang.  the former is not a huge problem as
  the process is niced and its cpu usage can be limited using the
  /sys/module/ipmi_si/parameters/kipmid_max_busy_us interface.  however,
  ipmitool's hanging severely degrades hardware monitoring.

  this problem initially reared its head in our enviroment on a handful
  of 12.04 hosts on which hwe kernels were installed.  of the dozen
  deployed 14.04 hosts, four have started displaying these symptoms in
  the past week.  all of the 12.04+hwe hosts were eventually affected; i
  believe that given enough time all of the 14.04 hosts would be, as
  well.  a reboot clears it up until its recurrence.

  red hat has a bug logged that appears to match this:
  https://bugzilla.redhat.com/show_bug.cgi?id=1090619  unfortunately the
  work-around and proposed fix (from a duplicate bug) are currently non-
  public.  it does look like they were able to identify the "ipmi:
  simplify locking" patch from commit id
  f60adf42ad55405d1b17e9e5c33fdb63f1eb8861 as the culprit. i have just
  finished building a kernel from linux-source-3.13.0=3.13.0-37.64
  w/this patch reversed and will deploy it to see if the problem is
  alleviated.

  thank you for your time and effort.

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-3.13.0-37-generic 3.13.0-37.64
  ProcVersionSignature: Ubuntu 3.13.0-37.64-generic 3.13.11.7
  Uname: Linux 3.13.0-37-generic x86_64
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Oct 18 13:11 seq
   crw-rw---- 1 root audio 116, 33 Oct 18 13:11 timer
  AplayDevices: aplay: device_list:268: no soundcards found...
  ApportVersion: 2.14.1-0ubuntu3.5
  Architecture: amd64
  ArecordDevices: arecord: device_list:268: no soundcards found...
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory: 'iw'
  Date: Tue Oct 21 12:55:43 2014
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  MachineType: Supermicro X8DT6
  PciMultimedia:
   
  ProcEnviron:
   TERM=rxvt-unicode-256color
   PATH=(custom, no user)
   LANG=en_US.UTF-8
   SHELL=/usr/bin/zsh
  ProcFB:
   
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-37-generic root=/dev/md0 ro consoleblank=0 console=tty0 console=ttyS2,115200n8 nomdmonddf nomdmonisw bootdegraded=true
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-37-generic N/A
   linux-backports-modules-3.13.0-37-generic  N/A
   linux-firmware                             1.127.7
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 05/15/2012
  dmi.bios.vendor: American Megatrends Inc.
  dmi.bios.version: 2.0c
  dmi.board.asset.tag: 1234567890
  dmi.board.name: X8DT6
  dmi.board.vendor: Supermicro
  dmi.board.version: 1234567890
  dmi.chassis.asset.tag: To Be Filled By O.E.M.
  dmi.chassis.type: 17
  dmi.chassis.vendor: Supermicro
  dmi.chassis.version: 1234567890
  dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr2.0c:bd05/15/2012:svnSupermicro:pnX8DT6:pvr1234567890:rvnSupermicro:rnX8DT6:rvr1234567890:cvnSupermicro:ct17:cvr1234567890:
  dmi.product.name: X8DT6
  dmi.product.version: 1234567890
  dmi.sys.vendor: Supermicro

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1383921/+subscriptions


References