yahoo-eng-team team mailing list archive

[Sean Dague <sean@xxxxxxxxx>]

havana is now closed

** Changed in: nova
       Status: Confirmed => Won't Fix

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1246852

Title:
  havana on CentOS instance file injection problem

Status in OpenStack Compute (Nova):
  Won't Fix

Bug description:
  Using havana with CentOS packages from EPEL

  On an instance launch, there is a qemu-kvm process that lingers after
  the instance is launched (in addition to the regular qemu process that
  the instance is running under).  This appears to be caused by file
  injection.

  
  2013-10-31 19:07:43.542 5275 DEBUG nova.virt.disk.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Checking if we can resize image /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk. size=1073741824 can_resize_image /usr/lib/python2.6/site-packages/nova/virt/disk/api.py:157
  2013-10-31 19:07:43.659 5275 DEBUG nova.virt.disk.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Checking if we can resize filesystem inside /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk. CoW=True is_image_partitionless /usr/lib/python2.6/site-packages/nova/virt/disk/api.py:171
  2013-10-31 19:07:43.661 5275 DEBUG nova.virt.disk.vfs.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Instance for image imgfile=/var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk imgfmt=qcow2 partition=None instance_for_image /usr/lib/python2.6/site-packages/nova/virt/disk/vfs/api.py:31
  2013-10-31 19:07:43.662 5275 DEBUG nova.virt.disk.vfs.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Trying to import guestfs instance_for_image /usr/lib/python2.6/site-packages/nova/virt/disk/vfs/api.py:34
  2013-10-31 19:07:43.680 5275 DEBUG nova.virt.disk.vfs.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Using primary VFSGuestFS instance_for_image /usr/lib/python2.6/site-packages/nova/virt/disk/vfs/api.py:41
  2013-10-31 19:07:43.685 5275 DEBUG nova.virt.disk.vfs.guestfs [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Setting up appliance for /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk qcow2 setup /usr/lib/python2.6/site-packages/nova/virt/disk/vfs/guestfs.py:111
  2013-10-31 19:08:30.379 5275 DEBUG nova.virt.disk.vfs.guestfs [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Mount guest OS image /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk partition None setup_os_static /usr/lib/python2.6/site-packages/nova/virt/disk/vfs/guestfs.py:57
  2013-10-31 19:08:30.644 5275 DEBUG nova.virt.disk.api [req-f2aee8ed-e382-4487-8b75-b4d1eed76ae4 b82b8e94e4b64a2bb8b21eef98b1f5e8 51c36ca36a37475da1d1a2662576688f] Unable to mount image /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk with error Error mounting /var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk with libguestfs (mount_options: /dev/vda on / (options: ''): mount: you must specify the filesystem type). Cannot resize. is_image_partitionless /usr/lib/python2.6/site-packages/nova/virt/disk/api.py:183

  Process list:
  nova      5403 30.6  6.8 1009036 271024 ?      S    19:07   1:44 /usr/libexec/qemu-kvm -global virtio-blk-pci.scsi=off -nodefconfig -nodefaults -nographic -drive file=/var/lib/nova/instances/5f69468b-544c-4162-88ce-dfcc3a3e7568/disk,cache=none,format=qcow2,if=virtio -nodefconfig -machine accel=kvm:tcg -m 500 -no-reboot -device virtio-serial -serial stdio -device sga -chardev socket,path=/tmp/libguestfsQqFC2I/guestfsd.sock,id=channel0 -device virtserialport,chardev=channel0,name=org.libguestfs.channel.0 -kernel /var/tmp/.guestfs-162/kernel.5275 -initrd /var/tmp/.guestfs-162/initrd.5275 -append panic=1 console=ttyS0 udevtimeout=300 no_timer_check acpi=off printk.time=1 cgroup_disable=memory selinux=0  TERM=screen  -drive file=/var/tmp/.guestfs-162/root.5275,snapshot=on,if=virtio,cache=unsafe

  qemu      5736 31.4  7.3 2056408 292336 ?      S    19:08   1:31
  /usr/bin/qemu-system-x86_64 -name instance-00000025 -S -M rhel6.4.0
  -cpu
  Opteron_G3,+nodeid_msr,+wdt,+skinit,+ibs,+osvw,+3dnowprefetch,+cr8legacy,+extapic,+cmp_legacy,+3dnow,+3dnowext,+pdpe1gb,+fxsr_opt,+mmxext,+ht,+vme
  -no-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -uuid 5f69468b-
  544c-4162-88ce-dfcc3a3e7568 -smbios type=1,manufacturer=Red Hat
  Inc.,product=OpenStack
  Nova,version=2013.2-2.el6,serial=cef1de3d-e616-b2d2-95d8-5c8f36a149f1,uuid
  =5f69468b-544c-4162-88ce-dfcc3a3e7568 -nodefconfig -nodefaults
  -chardev
  socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-00000025.monitor,server,nowait
  -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-
  shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive
  file=/var/lib/nova/instances/5f69468b-544c-4162-88ce-
  dfcc3a3e7568/disk,if=none,id=drive-virtio-
  disk0,format=qcow2,cache=none -device virtio-blk-
  pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-
  disk0,bootindex=1 -netdev tap,fd=23,id=hostnet0 -device
  rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:1e:6d:10,bus=pci.0,addr=0x3
  -chardev file,id=charserial0,path=/var/lib/nova/instances/5f69468b-
  544c-4162-88ce-dfcc3a3e7568/console.log -device isa-
  serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1
  -device isa-serial,chardev=charserial1,id=serial1 -device usb-
  tablet,id=input0 -vnc 0.0.0.0:0 -k en-us -vga cirrus -device virtio-
  balloon-pci,id=balloon0,bus=pci.0,addr=0x5

  
  [root@breu-mini-centos-compute2 ~]# rpm -qa | grep guestfs
  libguestfs-1.16.34-2.el6.x86_64
  libguestfs-tools-1.16.34-2.el6.x86_64
  python-libguestfs-1.16.34-2.el6.x86_64
  libguestfs-tools-c-1.16.34-2.el6.x86_64

  
  We have set the following in nova.conf in an attempt to disable file injection altogether:
  libvirt_inject_key=false
  libvirt_inject_password=false
  libvirt_inject_partition=-1
  injected_network_template=""

  
  However instance creation still appears to be using guestfs and failing.  The qemu-kvm process lingers after the instance is destroyed and is repeatable.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1246852/+subscriptions