← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1544058] [NEW] Nova event callback ON - Nova deletes an instance before it gets notification from Neutron that the port of the instance was deleted.

 

Public bug reported:

Tested on Liberty
Step to reproduce:
Enabling of nova-neutron notifications:
On nova.conf:
vif_plugging_is_fatal = True
vif_plugging_timeout = 300
On neutron.conf:
notify_nova_on_port_data_changes = True
notify_nova_on_port_status_changes = True

1)Delete an instance 
2)Deletion succeeded 
Until the notification is sent, nova has already deleted the instance.

Please see attached errors:
032:2016-01-12 23:47:14.526 8331 INFO nova.api.openstack.wsgi
[req-dac514a0-a869-42bb-bbf7-52a5e2986831fe71c506bd124db5a5b2081fa1e97785
733a421ebd494cc88cf502ad635a48e5 - - -] HTTP exception thrown: Noinstances
found for any event 1033:2016-01-12 23:47:14.527 8331 DEBUG
nova.api.openstack.wsgi [req-dac514a0-a869-42bb-bbf7-52a5e2986831
fe71c506bd124db5a5b2081fa1e97785 733a421ebd494cc88cf502ad635a48e5 - --]
 Returning 404 to user: No instances found for any event __call__
/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:1175
1034:2016-01-12 23:47:14.528 8331 INFO nova.osapi_compute.wsgi.server
[req-dac514a0-a869-42bb-bbf7-52a5e2986831
fe71c506bd124db5a5b2081fa1e97785
733a421ebd494cc88cf502ad635a48e5 - - -] 192.0.2.9 "POST
/v2/733a421ebd494cc88cf502ad635a48e5/os-server-external-events
HTTP/1.1"status: 404 len: 296 time: 0.1210408 1036
:==> /var/log/neutron/server.log <== 1038:RESP BODY: {"itemNotFound":
{"message": "No instances found for any event", "code": 404}}
1040:2016-01-12 23:47:14.530 5129 WARNING neutron.notifiers.nova [-]
Nova returned NotFound for event: [{'tag':u'fedc0c28-9435-4812-ae04-f9f60a269d41', 
'name':'network-vif-deleted','server_uuid': u'1f9959c2-62db-425a-bc14-7449dc9231e6'}]

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1544058

Title:
  Nova event callback ON - Nova deletes an instance before it gets
  notification from Neutron that the port of the instance was deleted.

Status in OpenStack Compute (nova):
  New

Bug description:
  Tested on Liberty
  Step to reproduce:
  Enabling of nova-neutron notifications:
  On nova.conf:
  vif_plugging_is_fatal = True
  vif_plugging_timeout = 300
  On neutron.conf:
  notify_nova_on_port_data_changes = True
  notify_nova_on_port_status_changes = True

  1)Delete an instance 
  2)Deletion succeeded 
  Until the notification is sent, nova has already deleted the instance.

  Please see attached errors:
  032:2016-01-12 23:47:14.526 8331 INFO nova.api.openstack.wsgi
  [req-dac514a0-a869-42bb-bbf7-52a5e2986831fe71c506bd124db5a5b2081fa1e97785
  733a421ebd494cc88cf502ad635a48e5 - - -] HTTP exception thrown: Noinstances
  found for any event 1033:2016-01-12 23:47:14.527 8331 DEBUG
  nova.api.openstack.wsgi [req-dac514a0-a869-42bb-bbf7-52a5e2986831
  fe71c506bd124db5a5b2081fa1e97785 733a421ebd494cc88cf502ad635a48e5 - --]
   Returning 404 to user: No instances found for any event __call__
  /usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py:1175
  1034:2016-01-12 23:47:14.528 8331 INFO nova.osapi_compute.wsgi.server
  [req-dac514a0-a869-42bb-bbf7-52a5e2986831
  fe71c506bd124db5a5b2081fa1e97785
  733a421ebd494cc88cf502ad635a48e5 - - -] 192.0.2.9 "POST
  /v2/733a421ebd494cc88cf502ad635a48e5/os-server-external-events
  HTTP/1.1"status: 404 len: 296 time: 0.1210408 1036
  :==> /var/log/neutron/server.log <== 1038:RESP BODY: {"itemNotFound":
  {"message": "No instances found for any event", "code": 404}}
  1040:2016-01-12 23:47:14.530 5129 WARNING neutron.notifiers.nova [-]
  Nova returned NotFound for event: [{'tag':u'fedc0c28-9435-4812-ae04-f9f60a269d41', 
  'name':'network-vif-deleted','server_uuid': u'1f9959c2-62db-425a-bc14-7449dc9231e6'}]

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1544058/+subscriptions


Follow ups