← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #32090

[Bug 1445917] [NEW] (juno) gate-grenade-dsvm-ironic-sideways failing with NoValidHost due to PortNotUsable

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

http://logs.openstack.org/82/169782/1/gate/gate-grenade-dsvm-ironic-
sideways/d82f6a1/logs/new/screen-n-cpu.txt.gz?level=TRACE#_2015-04-19_08_36_06_412

2015-04-19 08:36:06.209 26279 ERROR nova.virt.ironic.driver [-] Error preparing deploy for instance 85a4a66e-24b0-48a4-ada6-1d29edee7adb on baremetal node f75b4bf9-6e6d-44fb-b4e8-ece394357440.
2015-04-19 08:36:06.412 26279 ERROR nova.compute.manager [-] [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] Instance failed to spawn
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] Traceback (most recent call last):
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2261, in _build_resources
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     yield resources
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2131, in _build_and_run_instance
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     block_device_info=block_device_info)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 645, in spawn
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self._cleanup_deploy(context, node, instance, network_info)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 82, in __exit__
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     six.reraise(self.type_, self.value, self.tb)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 637, in spawn
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self._plug_vifs(node, instance, network_info)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 900, in _plug_vifs
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     network_info_str = str(network_info)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 467, in __str__
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     return self._sync_wrapper(fn, *args, **kwargs)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 450, in _sync_wrapper
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self.wait()
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 482, in wait
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self[:] = self._gt.wait()
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 173, in wait
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     return self._exit_event.wait()
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 125, in wait
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     current.throw(*self._exc)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 212, in main
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     result = function(*args, **kwargs)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 1661, in _allocate_network_async
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     dhcp_options=dhcp_options)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 300, in allocate_for_instance
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     instance=instance.uuid)
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] PortNotUsable: Port b16075c4-af7a-4795-a26e-8d5eb0b39f49 not usable for instance 85a4a66e-24b0-48a4-ada6-1d29edee7adb.
2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] 


http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiSW5zdGFuY2UgZmFpbGVkIHRvIHNwYXduXCIgQU5EIG1lc3NhZ2U6XCJhbGxvY2F0ZV9mb3JfaW5zdGFuY2VcIiBBTkQgbWVzc2FnZTpcIlBvcnROb3RVc2FibGVcIiBBTkQgdGFnczpcInNjcmVlbi1uLWNwdS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQyOTQ0ODM3NjAxN30=

29 hits since 4/17.  This is only on ironic grenade jobs and only on
stable/juno.

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: ironic

** Summary changed:

- gate-grenade-dsvm-ironic-sideways failing with NoValidHost due to PortNotUsable
+ (juno) gate-grenade-dsvm-ironic-sideways failing with NoValidHost due to PortNotUsable

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1445917

Title:
  (juno) gate-grenade-dsvm-ironic-sideways failing with NoValidHost due
  to PortNotUsable

Status in OpenStack Compute (Nova):
  New

Bug description:
  http://logs.openstack.org/82/169782/1/gate/gate-grenade-dsvm-ironic-
  sideways/d82f6a1/logs/new/screen-n-cpu.txt.gz?level=TRACE#_2015-04-19_08_36_06_412

  2015-04-19 08:36:06.209 26279 ERROR nova.virt.ironic.driver [-] Error preparing deploy for instance 85a4a66e-24b0-48a4-ada6-1d29edee7adb on baremetal node f75b4bf9-6e6d-44fb-b4e8-ece394357440.
  2015-04-19 08:36:06.412 26279 ERROR nova.compute.manager [-] [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] Instance failed to spawn
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] Traceback (most recent call last):
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2261, in _build_resources
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     yield resources
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2131, in _build_and_run_instance
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     block_device_info=block_device_info)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 645, in spawn
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self._cleanup_deploy(context, node, instance, network_info)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 82, in __exit__
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     six.reraise(self.type_, self.value, self.tb)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 637, in spawn
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self._plug_vifs(node, instance, network_info)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 900, in _plug_vifs
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     network_info_str = str(network_info)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 467, in __str__
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     return self._sync_wrapper(fn, *args, **kwargs)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 450, in _sync_wrapper
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self.wait()
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/model.py", line 482, in wait
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     self[:] = self._gt.wait()
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 173, in wait
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     return self._exit_event.wait()
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 125, in wait
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     current.throw(*self._exc)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 212, in main
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     result = function(*args, **kwargs)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/compute/manager.py", line 1661, in _allocate_network_async
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     dhcp_options=dhcp_options)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 300, in allocate_for_instance
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb]     instance=instance.uuid)
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] PortNotUsable: Port b16075c4-af7a-4795-a26e-8d5eb0b39f49 not usable for instance 85a4a66e-24b0-48a4-ada6-1d29edee7adb.
  2015-04-19 08:36:06.412 26279 TRACE nova.compute.manager [instance: 85a4a66e-24b0-48a4-ada6-1d29edee7adb] 

  
  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiSW5zdGFuY2UgZmFpbGVkIHRvIHNwYXduXCIgQU5EIG1lc3NhZ2U6XCJhbGxvY2F0ZV9mb3JfaW5zdGFuY2VcIiBBTkQgbWVzc2FnZTpcIlBvcnROb3RVc2FibGVcIiBBTkQgdGFnczpcInNjcmVlbi1uLWNwdS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQyOTQ0ODM3NjAxN30=

  29 hits since 4/17.  This is only on ironic grenade jobs and only on
  stable/juno.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1445917/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next