kernel-packages team mailing list archive

[Matt Riedemann <mriedem@xxxxxxxxxx>]

Ever since we started picking up the 3.13.0-65 kernel in the openstack
CI system on 9/29 we've been seeing lots of random failures across 3
branches (juno/kilo/master) with ebtables, details are in:

https://bugs.launchpad.net/nova/+bug/1501558

An example failure:

http://logs.openstack.org/62/229962/1/check/gate-tempest-dsvm-full/28bb6b6/logs/screen-n-cpu.txt.gz?level=TRACE#_2015-10-01_17_39_59_1872015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] Traceback (most recent call last):
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2155, in _build_resources
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     yield resources
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2009, in _build_and_run_instance
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     block_device_info=block_device_info)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 2444, in spawn
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     block_device_info=block_device_info)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 4516, in _create_domain_and_network
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     xml, pause=pause, power_on=power_on)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 4446, in _create_domain
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     guest.launch(pause=pause)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/virt/libvirt/guest.py", line 141, in launch
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     self._encoded_xml, errors='ignore')
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 195, in __exit__
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     six.reraise(self.type_, self.value, self.tb)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/opt/stack/new/nova/nova/virt/libvirt/guest.py", line 136, in launch
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     return self._domain.createWithFlags(flags)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 183, in doit
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 141, in proxy_call
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     rv = execute(f, *args, **kwargs)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 122, in execute
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     six.reraise(c, e, tb)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 80, in tworker
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     rv = meth(*args, **kwargs)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]   File "/usr/local/lib/python2.7/dist-packages/libvirt.py", line 900, in createWithFlags
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] libvirtError: Error while building firewall: Some rules could not be created for interface vnet7: Failure to execute command '$EBT -t nat -A libvirt-J-vnet7  -j J-vnet7-mac' : 'Unable to update the kernel. Two possible causes:
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] 1. Multiple ebtables programs were executing simultaneously. The ebtables
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]    userspace tool doesn't by default support multiple ebtables programs running
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]    concurrently. The ebtables option --concurrent or a tool like flock can be
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]    used to support concurrent scripts that update the ebtables kernel tables.
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] 2. The kernel doesn't support a certain ebtables extension, consider
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]    recompiling your kernel or insmod the extension.
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] .'.
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f] 
2015-10-01 17:39:59.187 6060 ERROR nova.compute.manager [instance: 79207baa-d735-401c-9f81-4f7ea75aaa4f]

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1497184

Title:
  Kernel-panic with 3.13.0-64.104 generic kernel (BUG at
  net/core/skbuff:1290)

Status in linux package in Ubuntu:
  Invalid
Status in linux source package in Trusty:
  Fix Released
Status in linux source package in Vivid:
  Fix Released

Bug description:
  Hi. 
  I get randomly kernel panic with 3.13-64 kernel after some hours of work.
  This happens on 2 different computers with x86 and x86_kernel.
  First(x86_64): Toshiba Tecra A10-181 Intel Core i3-370M 8Gb DDR3 ram
  Second(x86): Desktop with AMD Athlon 64 x2 4800+ 4Gb DDR1 ram

  In attached photo you can see panic on laptop.
  Every time i other kernel panic message.

  With kernel 3.13-63-generic kernel i have uptime more than week.

  
  Techa host: uname -a
  Linux nb-ubuntu-ioann 3.13.0-64-generic #104-Ubuntu SMP Wed Sep 9 12:36:12 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
   
  Desktop host:
  Linux ioann-old-desktop  3.13.0-64-generic #104-Ubuntu SMP Wed Sep 9 12:36:12 UTC 2015 x86 x86 x86 GNU/Linux

  Description:	Ubuntu 14.04.3 LTS
  Release:	14.04

  ProblemType: Bug
  DistroRelease: Ubuntu 14.04
  Package: linux-image-3.13.0-64-generic 3.13.0-64.104
  ProcVersionSignature: Ubuntu 3.13.0-64.104-generic 3.13.11-ckt26
  Uname: Linux 3.13.0-64-generic x86_64
  ApportVersion: 2.14.1-0ubuntu3.13
  Architecture: amd64
  AudioDevicesInUse:
   USER        PID ACCESS COMMAND
   /dev/snd/controlC0:  unim95     2004 F.... pulseaudio
  CRDA: Error: [Errno 2] No such file or directory: 'iw'
  CurrentDesktop: XFCE
  CurrentDmesg:
   [   26.552940] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
   [   52.301084] audit_printk_skb: 108 callbacks suppressed
   [   52.301088] type=1400 audit(1442566720.780:48): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/cups/backend/cups-pdf" pid=2283 comm="apparmor_parser"
   [   52.301096] type=1400 audit(1442566720.780:49): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/sbin/cupsd" pid=2283 comm="apparmor_parser"
   [   52.301679] type=1400 audit(1442566720.780:50): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/sbin/cupsd" pid=2283 comm="apparmor_parser"
  Date: Fri Sep 18 11:02:21 2015
  HibernationDevice: RESUME=UUID=7bb2db85-2152-4e84-ba1a-fb4a3c7c82ca
  MachineType: TOSHIBA TECRA A11
  ProcFB: 0 inteldrmfb
  ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.13.0-64-generic root=UUID=314c867a-d6f1-4af2-b92b-510042a6940b ro quiet splash vt.handoff=7
  RelatedPackageVersions:
   linux-restricted-modules-3.13.0-64-generic N/A
   linux-backports-modules-3.13.0-64-generic  N/A
   linux-firmware                             1.127.15
  SourcePackage: linux
  UpgradeStatus: No upgrade log present (probably fresh install)
  dmi.bios.date: 06/27/2011
  dmi.bios.vendor: TOSHIBA
  dmi.bios.version: Version 3.20
  dmi.board.asset.tag: 0000000000
  dmi.board.name: Portable PC
  dmi.board.vendor: TOSHIBA
  dmi.board.version: Version A0
  dmi.chassis.asset.tag: 0000000000
  dmi.chassis.type: 10
  dmi.chassis.vendor: TOSHIBA
  dmi.chassis.version: Version 1.0
  dmi.modalias: dmi:bvnTOSHIBA:bvrVersion3.20:bd06/27/2011:svnTOSHIBA:pnTECRAA11:pvrPTSE0E-0LP046GR:rvnTOSHIBA:rnPortablePC:rvrVersionA0:cvnTOSHIBA:ct10:cvrVersion1.0:
  dmi.product.name: TECRA A11
  dmi.product.version: PTSE0E-0LP046GR
  dmi.sys.vendor: TOSHIBA

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1497184/+subscriptions