yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1478702] [NEW] Unable to clear device ID for port 'None'

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem@xxxxxxxxxx>
Date: Mon, 27 Jul 2015 21:17:58 -0000
Reply-to: Bug 1478702 <1478702@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I'm seeing this trace in an ironic job but it shows up in other jobs as
well:

http://logs.openstack.org/75/190675/2/check/gate-tempest-dsvm-ironic-
pxe_ssh-full-
nv/2c65f3f/logs/screen-n-cpu.txt.gz#_2015-07-26_00_36_47_257

2015-07-26 00:36:47.257 ERROR nova.network.neutronv2.api [req-57d4e9e6-adf1-4774-a27a-63d096fe48e6 tempest-ServersTestJSON-1332826451 tempest-ServersTestJSON-2014105270] Unable to clear device ID for port 'None'
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api Traceback (most recent call last):
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 365, in _unbind_ports
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     port_client.update_port(port_id, port_req_body)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 102, in with_params
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     ret = self.function(instance, *args, **kwargs)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 549, in update_port
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     return self.put(self.port_path % (port), body=body)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 302, in put
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     headers=headers, params=params)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 270, in retry_request
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     headers=headers, params=params)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 211, in do_request
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     self._handle_fault_response(status_code, replybody)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 185, in _handle_fault_response
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     exception_handler_v20(status_code, des_error_body)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 83, in exception_handler_v20
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     message=message)
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api NeutronClientException: 404 Not Found
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api The resource could not be found.
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api    
2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiVW5hYmxlIHRvIGNsZWFyIGRldmljZSBJRCBmb3IgcG9ydCAnTm9uZSdcIiBBTkQgdGFnczpcInNjcmVlbi1uLWNwdS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzODAzMTMwMzgzNX0=

master and stable/kilo when we added the preserve pre-existing ports
stuff in the neutron v2 API in nova.

My guess is this happens in the deallocate_for_instance call and the
port_id in the requested_networks dict is None, but we don't filter
those out properly.

** Affects: nova
     Importance: Medium
     Assignee: Matt Riedemann (mriedem)
         Status: Confirmed


** Tags: kilo-backport-potential network neutron

** Tags added: network neutron

** Tags added: kilo-backport-potential

** Changed in: nova
       Status: New => Confirmed

** Changed in: nova
   Importance: Undecided => Medium

** Changed in: nova
     Assignee: (unassigned) => Matt Riedemann (mriedem)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1478702

Title:
  Unable to clear device ID for port 'None'

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  I'm seeing this trace in an ironic job but it shows up in other jobs
  as well:

  http://logs.openstack.org/75/190675/2/check/gate-tempest-dsvm-ironic-
  pxe_ssh-full-
  nv/2c65f3f/logs/screen-n-cpu.txt.gz#_2015-07-26_00_36_47_257

  2015-07-26 00:36:47.257 ERROR nova.network.neutronv2.api [req-57d4e9e6-adf1-4774-a27a-63d096fe48e6 tempest-ServersTestJSON-1332826451 tempest-ServersTestJSON-2014105270] Unable to clear device ID for port 'None'
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api Traceback (most recent call last):
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 365, in _unbind_ports
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     port_client.update_port(port_id, port_req_body)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 102, in with_params
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     ret = self.function(instance, *args, **kwargs)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 549, in update_port
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     return self.put(self.port_path % (port), body=body)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 302, in put
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     headers=headers, params=params)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 270, in retry_request
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     headers=headers, params=params)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 211, in do_request
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     self._handle_fault_response(status_code, replybody)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 185, in _handle_fault_response
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     exception_handler_v20(status_code, des_error_body)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 83, in exception_handler_v20
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api     message=message)
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api NeutronClientException: 404 Not Found
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api The resource could not be found.
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api    
  2015-07-26 00:36:47.257 20871 ERROR nova.network.neutronv2.api 

  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiVW5hYmxlIHRvIGNsZWFyIGRldmljZSBJRCBmb3IgcG9ydCAnTm9uZSdcIiBBTkQgdGFnczpcInNjcmVlbi1uLWNwdS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzODAzMTMwMzgzNX0=

  master and stable/kilo when we added the preserve pre-existing ports
  stuff in the neutron v2 API in nova.

  My guess is this happens in the deallocate_for_instance call and the
  port_id in the requested_networks dict is None, but we don't filter
  those out properly.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1478702/+subscriptions
Follow ups

[Bug 1478702] Re: Unable to clear device ID for port 'None'
From: Thierry Carrez, 2015-09-03