yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1089926] Re: I couldn't launch any instance and cannot even delet the instance

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Sean Dague <sean@xxxxxxxxx>
Date: Fri, 19 Sep 2014 10:57:40 -0000
Reply-to: Bug 1089926 <1089926@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** No longer affects: nova/essex

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1089926

Title:
  I couldn't launch any instance and cannot even delet the instance

Status in OpenStack Compute (Nova):
  Invalid

Bug description:
  Hi,

  i have been yesterday trying to launch an windows 2008,windows 2003
  instance first the instance have been launched and i assigned the ip
  for the instance, but i couldn't take the instance Remote so i
  restarted all the services in nova.

  After that i can take the instance remote but not 2008 so i deleted
  the instance but i couldn't it showed the instance terminated but the
  task was in active state and status is deleting it haven't deleted yet
  till now.  i couldn't even launch any instance.

  the nova-compute is in xxx state. others are in this state ( :-) ) i
  have restarted the service the nova-compute alone is showing un Known
  instance.

  i checked the nova-compute.log file

  error details :

  2012-12-13 12:53:20 DEBUG nova.utils [req-d855656f-e036-473f-8bf4-b01e8691da34 None None] Running cmd (subprocess): sudo nova-rootwrap route -n from (pid=3424) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219
  2012-12-13 12:53:20 DEBUG nova.utils [req-d855656f-e036-473f-8bf4-b01e8691da34 None None] Running cmd (subprocess): sudo nova-rootwrap ip addr show dev eth1 scope global from (pid=3424) execute /usr/lib/python2.7/dist-packages/nova/utils.py:219
  2012-12-13 12:53:20 INFO nova.compute.manager [req-d855656f-e036-473f-8bf4-b01e8691da34 None None] [instance: 3715e4b5-692a-4d68-b1db-f18b08b2286f] Rebooting instance after nova-compute restart.
  2012-12-13 12:53:21 CRITICAL nova [-] Domain not found: no domain with matching name 'instance-0000000e'
  2012-12-13 12:53:21 TRACE nova Traceback (most recent call last):
  2012-12-13 12:53:21 TRACE nova   File "/usr/bin/nova-compute", line 49, in <module>
  2012-12-13 12:53:21 TRACE nova     service.wait()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 413, in wait
  2012-12-13 12:53:21 TRACE nova     _launcher.wait()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 131, in wait
  2012-12-13 12:53:21 TRACE nova     service.wait()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 166, in wait
  2012-12-13 12:53:21 TRACE nova     return self._exit_event.wait()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
  2012-12-13 12:53:21 TRACE nova     return hubs.get_hub().switch()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 177, in switch
  2012-12-13 12:53:21 TRACE nova     return self.greenlet.switch()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 192, in main
  2012-12-13 12:53:21 TRACE nova     result = function(*args, **kwargs)
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 101, in run_server
  2012-12-13 12:53:21 TRACE nova     server.start()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 162, in start
  2012-12-13 12:53:21 TRACE nova     self.manager.init_host()
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 269, in init_host
  2012-12-13 12:53:21 TRACE nova     block_device_info)
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
  2012-12-13 12:53:21 TRACE nova     return f(*args, **kw)
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 852, in resume_state_on_host_boot
  2012-12-13 12:53:21 TRACE nova     block_device_info=block_device_info)
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 790, in _hard_reboot
  2012-12-13 12:53:21 TRACE nova     virt_dom = self._conn.lookupByName(instance['name'])
  2012-12-13 12:53:21 TRACE nova   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 2370, in lookupByName
  2012-12-13 12:53:21 TRACE nova     if ret is None:raise libvirtError('virDomainLookupByName() failed', conn=self)
  2012-12-13 12:53:21 TRACE nova libvirtError: Domain not found: no domain with matching name 'instance-0000000e'
  2012-12-13 12:53:21 TRACE nova


  
  And in the lib virt .log file :

  Errors detail:

  2012-12-12 11:04:27.401+0000: 5792: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-12 11:04:42.208+0000: 5792: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-12 12:37:32.936+0000: 5792: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 04:50:51.320+0000: 323: info : libvirt version: 0.9.8
  2012-12-13 04:50:51.320+0000: 323: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 05:07:37.338+0000: 323: error : qemuMonitorIO:603 : internal error End of file from monitor
  2012-12-13 05:07:37.415+0000: 323: error : virNetDevGetIndex:656 : Unable to get index for interface vnet3: No such device
  2012-12-13 05:07:38.866+0000: 323: error : qemuMonitorIO:603 : internal error End of file from monitor
  2012-12-13 05:07:38.868+0000: 323: error : virNetDevGetIndex:656 : Unable to get index for interface vnet2: No such device
  2012-12-13 05:08:02.408+0000: 331: error : virNetDevGetIndex:656 : Unable to get index for interface vnet5: No such device
  2012-12-13 05:08:03.776+0000: 332: error : virNetDevGetIndex:656 : Unable to get index for interface vnet1: No such device
  2012-12-13 05:23:30.046+0000: 1864: info : libvirt version: 0.9.8
  2012-12-13 05:23:30.046+0000: 1864: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 05:26:38.557+0000: 1583: info : libvirt version: 0.9.8
  2012-12-13 05:26:38.557+0000: 1583: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 06:51:38.320+0000: 1315: info : libvirt version: 0.9.8
  2012-12-13 06:51:38.320+0000: 1315: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 06:57:32.949+0000: 1318: error : qemuSetupDiskPathAllow:82 : Unable to allow access for disk path /var/lib/nova/instances/instance-0000000e/disk.local: No such file or directory
  2012-12-13 06:57:33.131+0000: 1318: error : virSecurityDACRestoreSecurityFileLabel:143 : cannot resolve symlink /var/lib/nova/instances/instance-0000000e/disk.local: No such file or directory
  2012-12-13 06:57:33.553+0000: 1318: error : qemuRemoveCgroup:562 : internal error Unable to find cgroup for instance-0000000e
  2012-12-13 06:57:33.553+0000: 1318: warning : qemuProcessStop:3505 : Failed to remove cgroup for instance-0000000e
  2012-12-13 07:00:13.084+0000: 1315: error : qemuMonitorIO:603 : internal error End of file from monitor
  2012-12-13 07:00:13.086+0000: 1315: error : virNetDevGetIndex:656 : Unable to get index for interface vnet0: No such device
  2012-12-13 07:01:36.603+0000: 1289: info : libvirt version: 0.9.8
  2012-12-13 07:01:36.603+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 07:23:13.411+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 07:23:15.410+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 07:23:17.119+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 07:23:19.179+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error
  2012-12-13 07:23:21.352+0000: 1289: error : virNetSocketReadWire:996 : End of file while reading data: Input/output error

  
  i have installed all in single server. (ESSEX)

  So kindly help me to rectify this error i am new to openstack.

  Thanks in Advance.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1089926/+subscriptions