← Back to team overview

kernel-packages team mailing list archive

[Bug 1383921] Re: kipmi0 process hangs with ipmitool

 

Matt - i am using the following (takes advantage of the ipmi_si module's hot add and remove):
KIPMI_INST="0" # the web suggests this should increment but i've always seen 0
IPMI_PARAMS="$(cat /proc/ipmi/"${KIPMI_INST}"/params)"
sudo sh -c "echo "remove,${IPMI_PARAMS}" > /sys/module/ipmi_si/parameters/hotmod"
sleep 5
sudo sh -c "echo "add,${IPMI_PARAMS}" > /sys/module/ipmi_si/parameters/hotmod"

takes a while (30min+) but that sounds better than "many many hours"

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1383921

Title:
  kipmi0 process hangs with ipmitool

Status in “linux” package in Ubuntu:
  In Progress
Status in “linux” source package in Precise:
  Invalid
Status in “linux” source package in Trusty:
  In Progress
Status in “linux” source package in Utopic:
  In Progress
Status in “linux” source package in Vivid:
  In Progress

Bug description:
  we're in the process of migrating from 12.04 to 14.04 and are noticing
  a problem apparently related to the kernel and ipmi.  after an
  indeterminate period of regular ipmi queries (e.g., nagios checks
  using ipmitool) the kipmi0 process pegs a cpu to ~100% usage and
  further ipmitool commands hang.  the former is not a huge problem as
  the process is niced and its cpu usage can be limited using the
  /sys/module/ipmi_si/parameters/kipmid_max_busy_us interface.  however,
  ipmitool's hanging severely degrades hardware monitoring.

  this problem initially reared its head in our enviroment on a handful
  of 12.04 hosts on which hwe kernels were installed.  of the dozen
  deployed 14.04 hosts, four have started displaying these symptoms in
  the past week.  all of the 12.04+hwe hosts were eventually affected; i
  believe that given enough time all of the 14.04 hosts would be, as
  well.  a reboot clears it up until its recurrence.

  red hat has a bug logged that appears to match this:
  https://bugzilla.redhat.com/show_bug.cgi?id=1090619  unfortunately the
  work-around and proposed fix (from a duplicate bug) are currently non-
  public.  it does look like they were able to identify the "ipmi:
  simplify locking" patch from commit id
  f60adf42ad55405d1b17e9e5c33fdb63f1eb8861 as the culprit. i have just
  finished building a kernel from linux-source-3.13.0=3.13.0-37.64
  w/this patch reversed and will deploy it to see if the problem is
  alleviated.

  thank you for your time and effort.

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-3.13.0-37-generic 3.13.0-37.64
  ProcVersionSignature: Ubuntu 3.13.0-37.64-generic 3.13.11.7
  Uname: Linux 3.13.0-37-generic x86_64
  AlsaDevices:
   total 0
   crw-rw---- 1 root audio 116,  1 Oct 18 13:11 seq
   crw-rw---- 1 root audio 116, 33 Oct 18 13:11 timer
  AplayDevices: aplay: device_list:268: no soundcards found...
  ApportVersion: 2.14.1-0ubuntu3.5
  Architecture: amd64
  ArecordDevices: arecord: device_list:268: no soundcards found...
  AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
  CRDA: Error: [Errno 2] No such file or directory: 'iw'
  Date: Tue Oct 21 12:55:43 2014
  IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
  MachineType: Supermicro X8DT6
  PciMultimedia:
   
  ProcEnviron:
   TERM=rxvt-unicode-256color
   PATH=(custom, no user)
   LANG=en_US.UTF-8
   SHELL=/usr/bin/zsh
  ProcFB:
   
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-37-generic root=/dev/md0 ro consoleblank=0 console=tty0 console=ttyS2,115200n8 nomdmonddf nomdmonisw bootdegraded=true
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-37-generic N/A
   linux-backports-modules-3.13.0-37-generic  N/A
   linux-firmware                             1.127.7
  RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 05/15/2012
  dmi.bios.vendor: American Megatrends Inc.
  dmi.bios.version: 2.0c
  dmi.board.asset.tag: 1234567890
  dmi.board.name: X8DT6
  dmi.board.vendor: Supermicro
  dmi.board.version: 1234567890
  dmi.chassis.asset.tag: To Be Filled By O.E.M.
  dmi.chassis.type: 17
  dmi.chassis.vendor: Supermicro
  dmi.chassis.version: 1234567890
  dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr2.0c:bd05/15/2012:svnSupermicro:pnX8DT6:pvr1234567890:rvnSupermicro:rnX8DT6:rvr1234567890:cvnSupermicro:ct17:cvr1234567890:
  dmi.product.name: X8DT6
  dmi.product.version: 1234567890
  dmi.sys.vendor: Supermicro

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1383921/+subscriptions


References