yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1280705] [NEW] VCDriver: nova compute failed to start up

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Jay Lau <jay.lau.513@xxxxxxxxx>
Date: Sun, 16 Feb 2014 03:10:39 -0000
Reply-to: Bug 1280705 <1280705@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:


 DC
    |
    |----Cluster1
    |          |
    |          |----9.111.249.56
    |
    |----Cluster2
               |
               |----9.111.249.49

Preconditions:
1) Using VCDriver
2) nova compute 1 manage Cluster1
3) nova compute 2 manage Cluster2

Test case:
1) Create one VM located on Cluster2
2) Stop nova compute for Cluster1 and then restart this nova compute.
3) The nova compute which manages Cluster1 failed to start up

2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 117, in wait
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     x.wait()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 49, in wait
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 168, in wait
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 194, in main
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/service.py", line 480, in run_service
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     service.start()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/service.py", line 172, in start
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     self.manager.init_host()
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 811, in init_host
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     self._destroy_evacuated_instances(context)
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 570, in _destroy_evacuated_instances
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     bdi, destroy_disks)
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 635, in destroy
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     _vmops = self._get_vmops_for_compute_node(instance['node'])
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 522, in _get_vmops_for_compute_node
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     resource = self._get_resource_for_node(nodename)
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 514, in _get_resource_for_node
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     raise exception.NotFound(msg)
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup NotFound: NV-3AB798A The resource domain-c16(Cluster2) does not exist
2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1280705

Title:
  VCDriver: nova compute failed to start up

Status in OpenStack Compute (Nova):
  New

Bug description:

   DC
      |
      |----Cluster1
      |          |
      |          |----9.111.249.56
      |
      |----Cluster2
                 |
                 |----9.111.249.49

  Preconditions:
  1) Using VCDriver
  2) nova compute 1 manage Cluster1
  3) nova compute 2 manage Cluster2

  Test case:
  1) Create one VM located on Cluster2
  2) Stop nova compute for Cluster1 and then restart this nova compute.
  3) The nova compute which manages Cluster1 failed to start up

  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 117, in wait
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     x.wait()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 49, in wait
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 168, in wait
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 194, in main
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/service.py", line 480, in run_service
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     service.start()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/service.py", line 172, in start
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     self.manager.init_host()
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 811, in init_host
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     self._destroy_evacuated_instances(context)
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 570, in _destroy_evacuated_instances
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     bdi, destroy_disks)
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 635, in destroy
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     _vmops = self._get_vmops_for_compute_node(instance['node'])
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 522, in _get_vmops_for_compute_node
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     resource = self._get_resource_for_node(nodename)
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/vmwareapi/driver.py", line 514, in _get_resource_for_node
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup     raise exception.NotFound(msg)
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup NotFound: NV-3AB798A The resource domain-c16(Cluster2) does not exist
  2014-02-16 05:43:06.086 14496 TRACE nova.openstack.common.threadgroup

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1280705/+subscriptions
Follow ups

[Bug 1280705] [NEW] VCDriver: nova compute failed to start up
From: Jay Lau, 2014-02-16
References

[Bug 1280705] [NEW] VCDriver: nova compute failed to start up
From: Jay Lau, 2014-02-16