yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1621883] [NEW] PortNotFoundClient stacktrace in n-cpu when unbinding ports

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem@xxxxxxxxxx>
Date: Fri, 09 Sep 2016 14:08:23 -0000
Reply-to: Bug 1621883 <1621883@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Saw this in a CI run today:

http://logs.openstack.org/07/367307/1/check/gate-tempest-dsvm-neutron-
full-ubuntu-
xenial/cf54759/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-09-08_12_05_26_139

We shouldn't stacktrace on a 404 port not found when unbinding ports
from an instance (that is probably be deleted).

2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api [req-aef4186a-7fdb-4e62-a4b1-ec7482db7e5b tempest-AttachInterfacesTestJSON-554004321 tempest-AttachInterfacesTestJSON-554004321] Unable to clear device ID for port '6dff1db9-e6e1-490b-9246-ea479281b3ff'
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api Traceback (most recent call last):
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 434, in _unbind_ports
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     port_client.update_port(port_id, port_req_body)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 754, in update_port
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     return self.put(self.port_path % (port), body=body)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 369, in put
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     headers=headers, params=params)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 337, in retry_request
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     headers=headers, params=params)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 300, in do_request
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     self._handle_fault_response(status_code, replybody, resp)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 275, in _handle_fault_response
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     exception_handler_v20(status_code, error_body)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     request_ids=request_ids)
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api PortNotFoundClient: Port 6dff1db9-e6e1-490b-9246-ea479281b3ff could not be found.
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api Neutron server returns request_ids: ['req-8350bbd5-d45b-4e59-a8a5-5d232faa45c1']
2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: compute low-hanging-fruit neutron

** Tags added: low-hanging-fruit

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1621883

Title:
  PortNotFoundClient stacktrace in n-cpu when unbinding ports

Status in OpenStack Compute (nova):
  New

Bug description:
  Saw this in a CI run today:

  http://logs.openstack.org/07/367307/1/check/gate-tempest-dsvm-neutron-
  full-ubuntu-
  xenial/cf54759/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-09-08_12_05_26_139

  We shouldn't stacktrace on a 404 port not found when unbinding ports
  from an instance (that is probably be deleted).

  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api [req-aef4186a-7fdb-4e62-a4b1-ec7482db7e5b tempest-AttachInterfacesTestJSON-554004321 tempest-AttachInterfacesTestJSON-554004321] Unable to clear device ID for port '6dff1db9-e6e1-490b-9246-ea479281b3ff'
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api Traceback (most recent call last):
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 434, in _unbind_ports
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     port_client.update_port(port_id, port_req_body)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 754, in update_port
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     return self.put(self.port_path % (port), body=body)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 369, in put
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     headers=headers, params=params)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 337, in retry_request
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     headers=headers, params=params)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 300, in do_request
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     self._handle_fault_response(status_code, replybody, resp)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 94, in wrapper
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     ret = obj(*args, **kwargs)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 275, in _handle_fault_response
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     exception_handler_v20(status_code, error_body)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api   File "/usr/local/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api     request_ids=request_ids)
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api PortNotFoundClient: Port 6dff1db9-e6e1-490b-9246-ea479281b3ff could not be found.
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api Neutron server returns request_ids: ['req-8350bbd5-d45b-4e59-a8a5-5d232faa45c1']
  2016-09-08 12:05:26.139 17305 ERROR nova.network.neutronv2.api

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1621883/+subscriptions
Follow ups

[Bug 1621883] Re: PortNotFoundClient stacktrace in n-cpu when unbinding ports
From: OpenStack Infra, 2016-09-12