← Back to team overview

kernel-packages team mailing list archive

[Bug 1415510] [NEW] Frequent kernel panics when doing heavy I/O in LXC containers on Btrfs

 

Public bug reported:

I initially reported this as a bug in LXC
(https://github.com/lxc/lxc/issues/424), but I was (rightfully) advised
to report this as a kernel issue instead:

I'm running Ubuntu 14.04.1 LTS (x86_64) on my Laptop. Current Kernel
version is "3.13.0-44-generic". The LXC version is "1.0.7-0ubuntu0.1",
installed from the "ubuntu-lxc" PPA on Launchpad.

I have a dedicated Btrfs file system mounted on /container/, which I use
for storing all LXC containers.

The file system is created on top of a logical volume:

lenz@lenz-ThinkPad-T440 ~ % mount | grep container
/dev/mapper/ubuntu--vg-container on /container type btrfs (rw)
lenz@lenz-ThinkPad-T440 ~ % sudo lvdisplay /dev/mapper/ubuntu--vg-container
  --- Logical volume ---
  LV Path                /dev/ubuntu-vg/container
  LV Name                container
  VG Name                ubuntu-vg
  LV UUID                JUq21P-SSoS-UeU5-rdDS-k6V4-d30e-gJM1FA
  LV Write Access        read/write
  LV Creation host, time lenz-ThinkPad-T440, 2014-09-15 13:42:27 +0200
  LV Status              available
  # open                 1
  LV Size                65,00 GiB
  Current LE             16640
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           252:5

The hard disk drive is a Samsung SSD ("Samsung SSD 840 EVO 500GB,
EXT0BB0Q, max UDMA/133", according to dmesg).

I have a number containers based on CentOS 6, these were created by
cloning a base image using lxc-clone -s.

Quite frequently, when I create heavy disk I/O in one or several of
these containers (e.g. by running yum update concurrently, or by
transferring large files e.g. via a HTTP upload to one of the container
instances), my host system freezes. This only happens when container
activity is involved, the system runs stable otherwise. Most of the time
the X desktop freezes, sometimes a Kernel panic can be observed on the
console. Unfortunately I'm unable to capture it other than by taking a
picture. The only solution is to perform a cold reboot using the power
button.

This occurred to me before. I then re-created the /container/ file
system from scratch and started again. But now it's happening again, so
I would like to report it for investigation.

ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: linux-image-generic 3.13.0.44.51
ProcVersionSignature: Ubuntu 3.13.0-44.73-generic 3.13.11-ckt12
Uname: Linux 3.13.0-44-generic x86_64
ApportVersion: 2.14.1-0ubuntu3.6
Architecture: amd64
AudioDevicesInUse:
 USER        PID ACCESS COMMAND
 /dev/snd/controlC1:  lenz       2782 F.... pulseaudio
 /dev/snd/controlC0:  lenz       2782 F.... pulseaudio
CurrentDesktop: Unity
Date: Wed Jan 28 16:16:20 2015
HibernationDevice: RESUME=UUID=a60307c3-e53f-473e-ba9e-90cbfe484bb8
InstallationDate: Installed on 2014-09-15 (135 days ago)
InstallationMedia: Ubuntu 14.04.1 LTS "Trusty Tahr" - Release amd64 (20140722.2)
MachineType: LENOVO 20B6005YGE
ProcFB: 0 inteldrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.13.0-44-generic root=/dev/mapper/ubuntu--vg-root ro softlockup_panic=1 elevator=noop quiet splash nomdmonddf nomdmonisw vt.handoff=7
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-44-generic N/A
 linux-backports-modules-3.13.0-44-generic  N/A
 linux-firmware                             1.127.11
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 09/03/2014
dmi.bios.vendor: LENOVO
dmi.bios.version: GJET79WW (2.29 )
dmi.board.asset.tag: Not Available
dmi.board.name: 20B6005YGE
dmi.board.vendor: LENOVO
dmi.board.version: 0B98401 PRO
dmi.chassis.asset.tag: No Asset Information
dmi.chassis.type: 10
dmi.chassis.vendor: LENOVO
dmi.chassis.version: Not Available
dmi.modalias: dmi:bvnLENOVO:bvrGJET79WW(2.29):bd09/03/2014:svnLENOVO:pn20B6005YGE:pvrThinkPadT440:rvnLENOVO:rn20B6005YGE:rvr0B98401PRO:cvnLENOVO:ct10:cvrNotAvailable:
dmi.product.name: 20B6005YGE
dmi.product.version: ThinkPad T440
dmi.sys.vendor: LENOVO

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: Confirmed


** Tags: amd64 apport-bug third-party-packages trusty

** Attachment added: "Screen shot of a kernel panic"
   https://bugs.launchpad.net/bugs/1415510/+attachment/4307289/+files/IMG_20150128_133720.jpg

** Summary changed:

- Frequent kernel panics when doing heavy I/O in containers on Btrfs
+ Frequent kernel panics when doing heavy I/O in LXC containers on Btrfs

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1415510

Title:
  Frequent kernel panics when doing heavy I/O in LXC containers on Btrfs

Status in linux package in Ubuntu:
  Confirmed

Bug description:
  I initially reported this as a bug in LXC
  (https://github.com/lxc/lxc/issues/424), but I was (rightfully)
  advised to report this as a kernel issue instead:

  I'm running Ubuntu 14.04.1 LTS (x86_64) on my Laptop. Current Kernel
  version is "3.13.0-44-generic". The LXC version is "1.0.7-0ubuntu0.1",
  installed from the "ubuntu-lxc" PPA on Launchpad.

  I have a dedicated Btrfs file system mounted on /container/, which I
  use for storing all LXC containers.

  The file system is created on top of a logical volume:

  lenz@lenz-ThinkPad-T440 ~ % mount | grep container
  /dev/mapper/ubuntu--vg-container on /container type btrfs (rw)
  lenz@lenz-ThinkPad-T440 ~ % sudo lvdisplay /dev/mapper/ubuntu--vg-container
    --- Logical volume ---
    LV Path                /dev/ubuntu-vg/container
    LV Name                container
    VG Name                ubuntu-vg
    LV UUID                JUq21P-SSoS-UeU5-rdDS-k6V4-d30e-gJM1FA
    LV Write Access        read/write
    LV Creation host, time lenz-ThinkPad-T440, 2014-09-15 13:42:27 +0200
    LV Status              available
    # open                 1
    LV Size                65,00 GiB
    Current LE             16640
    Segments               1
    Allocation             inherit
    Read ahead sectors     auto
    - currently set to     256
    Block device           252:5

  The hard disk drive is a Samsung SSD ("Samsung SSD 840 EVO 500GB,
  EXT0BB0Q, max UDMA/133", according to dmesg).

  I have a number containers based on CentOS 6, these were created by
  cloning a base image using lxc-clone -s.

  Quite frequently, when I create heavy disk I/O in one or several of
  these containers (e.g. by running yum update concurrently, or by
  transferring large files e.g. via a HTTP upload to one of the
  container instances), my host system freezes. This only happens when
  container activity is involved, the system runs stable otherwise. Most
  of the time the X desktop freezes, sometimes a Kernel panic can be
  observed on the console. Unfortunately I'm unable to capture it other
  than by taking a picture. The only solution is to perform a cold
  reboot using the power button.

  This occurred to me before. I then re-created the /container/ file
  system from scratch and started again. But now it's happening again,
  so I would like to report it for investigation.

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-generic 3.13.0.44.51
  ProcVersionSignature: Ubuntu 3.13.0-44.73-generic 3.13.11-ckt12
  Uname: Linux 3.13.0-44-generic x86_64
  ApportVersion: 2.14.1-0ubuntu3.6
  Architecture: amd64
  AudioDevicesInUse:
   USER        PID ACCESS COMMAND
   /dev/snd/controlC1:  lenz       2782 F.... pulseaudio
   /dev/snd/controlC0:  lenz       2782 F.... pulseaudio
  CurrentDesktop: Unity
  Date: Wed Jan 28 16:16:20 2015
  HibernationDevice: RESUME=UUID=a60307c3-e53f-473e-ba9e-90cbfe484bb8
  InstallationDate: Installed on 2014-09-15 (135 days ago)
  InstallationMedia: Ubuntu 14.04.1 LTS "Trusty Tahr" - Release amd64 (20140722.2)
  MachineType: LENOVO 20B6005YGE
  ProcFB: 0 inteldrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.13.0-44-generic root=/dev/mapper/ubuntu--vg-root ro softlockup_panic=1 elevator=noop quiet splash nomdmonddf nomdmonisw vt.handoff=7
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-44-generic N/A
   linux-backports-modules-3.13.0-44-generic  N/A
   linux-firmware                             1.127.11
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 09/03/2014
  dmi.bios.vendor: LENOVO
  dmi.bios.version: GJET79WW (2.29 )
  dmi.board.asset.tag: Not Available
  dmi.board.name: 20B6005YGE
  dmi.board.vendor: LENOVO
  dmi.board.version: 0B98401 PRO
  dmi.chassis.asset.tag: No Asset Information
  dmi.chassis.type: 10
  dmi.chassis.vendor: LENOVO
  dmi.chassis.version: Not Available
  dmi.modalias: dmi:bvnLENOVO:bvrGJET79WW(2.29):bd09/03/2014:svnLENOVO:pn20B6005YGE:pvrThinkPadT440:rvnLENOVO:rn20B6005YGE:rvr0B98401PRO:cvnLENOVO:ct10:cvrNotAvailable:
  dmi.product.name: 20B6005YGE
  dmi.product.version: ThinkPad T440
  dmi.sys.vendor: LENOVO

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1415510/+subscriptions


Follow ups

References