yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1474198] [NEW] task_state not NONE after instance boot failed

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Eric Xie <mark_xiett@xxxxxxx>
Date: Tue, 14 Jul 2015 03:21:50 -0000
Reply-to: Bug 1474198 <1474198@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

1. Exact version of Nova:
python-novaclient-2.23.0
openstack-nova-common-2015.1.0
python-nova-2015.1.0
openstack-nova-api-2015.1.0
openstack-nova-scheduler-2015.1.0
openstack-nova-conductor-2015.1.0
openstack-nova-compute-2015.1.0
openstack-nova-2015.1.0

2. Relevant log files:
2015-07-14 11:15:07.559 19984 ERROR nova.compute.manager [req-8b567c49-850a-4f00-a73b-c2879528ef39 - - - - -] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Instance failed to spawn
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Traceback (most recent call last):
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2565, in _build_resources
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     yield resources
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2437, in _build_and_run_instance
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     block_device_info=block_device_info)
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2385, in spawn
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     write_to_disk=True)
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4232, in _get_guest_xml
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     context)
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4103, in _get_guest_config
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     flavor, virt_type)
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     _("Unexpected vif_type=%s") % vif_type)
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] NovaException: Unexpected vif_type=binding_failed
2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] 
2015-07-14 11:15:07.565 19984 INFO nova.compute.manager [req-a32fae7b-2a26-4d44-ab89-e16db804a9f0 58e88aff70dd4959ba5293dab8f6ceac c45dae15962c4797b70f6c278a232f3c - - -] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Terminating instance
2015-07-14 11:15:07.572 19984 INFO nova.virt.libvirt.driver [-] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] During wait destroy, instance disappeared.

3. Reproduce steps:
* Stop neutron-openvswitch-agent on compute node;
* Boot one instance

Expected result:
Task state of instance should be None

Actual result:
Task state of instance was always spawning
# nova list
+--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+
| ID                                   | Name                           | Status | Task State | Power State | Networks             |
+--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+
| f0a16736-078a-4476-a56a-abee46fdc5f5 | instance_test_vif_binding_fail | ERROR  | spawning   | NOSTATE     |                      |
+--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: in-stable-kilo

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1474198

Title:
  task_state not NONE after instance boot failed

Status in OpenStack Compute (nova):
  New

Bug description:
  1. Exact version of Nova:
  python-novaclient-2.23.0
  openstack-nova-common-2015.1.0
  python-nova-2015.1.0
  openstack-nova-api-2015.1.0
  openstack-nova-scheduler-2015.1.0
  openstack-nova-conductor-2015.1.0
  openstack-nova-compute-2015.1.0
  openstack-nova-2015.1.0

  2. Relevant log files:
  2015-07-14 11:15:07.559 19984 ERROR nova.compute.manager [req-8b567c49-850a-4f00-a73b-c2879528ef39 - - - - -] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Instance failed to spawn
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Traceback (most recent call last):
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2565, in _build_resources
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     yield resources
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2437, in _build_and_run_instance
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     block_device_info=block_device_info)
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2385, in spawn
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     write_to_disk=True)
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4232, in _get_guest_xml
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     context)
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4103, in _get_guest_config
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     flavor, virt_type)
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 374, in get_config
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5]     _("Unexpected vif_type=%s") % vif_type)
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] NovaException: Unexpected vif_type=binding_failed
  2015-07-14 11:15:07.559 19984 TRACE nova.compute.manager [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] 
  2015-07-14 11:15:07.565 19984 INFO nova.compute.manager [req-a32fae7b-2a26-4d44-ab89-e16db804a9f0 58e88aff70dd4959ba5293dab8f6ceac c45dae15962c4797b70f6c278a232f3c - - -] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] Terminating instance
  2015-07-14 11:15:07.572 19984 INFO nova.virt.libvirt.driver [-] [instance: f0a16736-078a-4476-a56a-abee46fdc5f5] During wait destroy, instance disappeared.

  3. Reproduce steps:
  * Stop neutron-openvswitch-agent on compute node;
  * Boot one instance

  Expected result:
  Task state of instance should be None

  Actual result:
  Task state of instance was always spawning
  # nova list
  +--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+
  | ID                                   | Name                           | Status | Task State | Power State | Networks             |
  +--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+
  | f0a16736-078a-4476-a56a-abee46fdc5f5 | instance_test_vif_binding_fail | ERROR  | spawning   | NOSTATE     |                      |
  +--------------------------------------+--------------------------------+--------+------------+-------------+----------------------+

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1474198/+subscriptions
Follow ups

[Bug 1474198] Re: task_state not NONE after instance boot failed
From: Launchpad Bug Tracker, 2015-09-20