yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1600500] [NEW] neutronclient.common.exceptions.NeutronClientException

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: ASVINCHANDAR7 <ASVINCHANDAR7@xxxxxxxxx>
Date: Sat, 09 Jul 2016 18:00:08 -0000
Reply-to: Bug 1600500 <1600500@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Hello


Description
===========
Getting neutronclient exception error when trying to connect Cloudforms4.1 with Openstack liberty
Openstack environment is not getting populated in Cloudforms because of this error


Environment
===========
1. [root@rhlospctl01 nova]# rpm -qa | grep nova
openstack-nova-cert-12.0.3-1.el7ost.noarch
openstack-nova-novncproxy-12.0.3-1.el7ost.noarch
python-nova-12.0.3-1.el7ost.noarch
openstack-nova-scheduler-12.0.3-1.el7ost.noarch
openstack-nova-console-12.0.3-1.el7ost.noarch
python-novaclient-3.1.0-2.el7ost.noarch
openstack-nova-common-12.0.3-1.el7ost.noarch
openstack-nova-conductor-12.0.3-1.el7ost.noarch
openstack-nova-api-12.0.3-1.el7ost.noarch

[root@rhlospctl01 nova]# rpm -qa | grep neutron
python-neutronclient-3.1.0-1.el7ost.noarch
openstack-neutron-ml2-7.0.4-2.el7ost.noarch
openstack-neutron-7.0.4-2.el7ost.noarch
openstack-neutron-openvswitch-7.0.4-2.el7ost.noarch
openstack-neutron-common-7.0.4-2.el7ost.noarch
python-neutron-7.0.4-2.el7ost.noarch


2. Which hypervisor did you use?
   Libvirt + KVM
   What's the version of that?


[root@rhlospctl01 nova]# rpm -qa | grep libvirt
libvirt-client-1.2.17-13.el7_2.4.x86_64
libvirt-python-1.2.17-2.el7.x86_64


2. Which storage type did you use?
   CEPH

3. Which networking type did you use?
   Neutron with OpenVSwitch VLAN provider network.(no L3)



I am getting the following error

4347b744780670409b50/os-keypairs.json?limit=1000&marker=cloud-ctrl1-key HTTP/1.1" status: 200 len: 1803 time: 0.0075929
2016-07-09 17:52:07.143 35655 INFO nova.osapi_compute.wsgi.server [req-cee3f742-ccd5-4b5a-8c74-5cc684b09d5a 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-keypairs.json?limit=1000 HTTP/1.1" status: 200 len: 1803 time: 0.0080750
2016-07-09 17:52:07.159 35631 INFO nova.osapi_compute.wsgi.server [req-1c172786-3c20-473e-b167-9fa84db542b0 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-keypairs.json?limit=1000&marker=cloud-ctrl1-key HTTP/1.1" status: 200 len: 1803 time: 0.0106990
2016-07-09 17:52:08.567 35615 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0012670
2016-07-09 17:52:11.469 35700 INFO nova.api.ec2 [-] 0.126s 10.81.61.239 GET / None:None 200 [None] text/plain text/plain
2016-07-09 17:52:11.470 35700 INFO nova.metadata.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 234 time: 0.0009701
2016-07-09 17:52:12.164 35615 INFO nova.osapi_compute.wsgi.server [req-28bb8960-d265-402e-894e-1465dbf36b51 9ec40e8aaf3641e695c4c57040832aba 100da705306c4347b744780670409b50 - - -] 10.81.61.211 "GET /v2/100da705306c4347b744780670409b50/servers/detail.json?limit=1000 HTTP/1.1" status: 200 len: 187 time: 0.0434470
2016-07-09 17:52:12.431 35617 INFO nova.osapi_compute.wsgi.server [req-7862ed42-31d1-4d24-9c97-7f40ddbad713 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/servers/detail.json?limit=1000 HTTP/1.1" status: 200 len: 39905 time: 0.2637389
2016-07-09 17:52:12.591 35617 INFO nova.osapi_compute.wsgi.server [req-7be49304-9f1d-4554-93d1-915dbd76bc0e 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/servers/detail.json?limit=1000&marker=f68af8ce-8873-470e-837a-7e4de6b1f945 HTTP/1.1" status: 200 len: 187 time: 0.0676081
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] Unexpected exception in API method
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/floating_ips.py", line 117, in index
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     floating_ips = self.network_api.get_floating_ips_by_project(context)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1435, in get_floating_ips_by_project
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     fips = client.list_floatingips(tenant_id=project_id)['floatingips']
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 102, in with_params
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     ret = self.function(instance, *args, **kwargs)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 731, in list_floatingips
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     **_params)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 307, in list
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     for r in self._pagination(collection, path, **params):
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 320, in _pagination
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     res = self.get(path, params=params)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 293, in get
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     headers=headers, params=params)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 270, in retry_request
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     headers=headers, params=params)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 211, in do_request
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     self._handle_fault_response(status_code, replybody)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 185, in _handle_fault_response
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     exception_handler_v20(status_code, des_error_body)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 83, in exception_handler_v20
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     message=message)
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions NeutronClientException: 404 Not Found
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions The resource could not be found.
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions    
2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
2016-07-09 17:52:12.604 35617 INFO nova.api.openstack.wsgi [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'neutronclient.common.exceptions.NeutronClientException'>
2016-07-09 17:52:12.605 35617 INFO nova.osapi_compute.wsgi.server [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-floating-ips.json HTTP/1.1" status: 500 len: 435 time: 0.0105100
2016-07-09 17:52:13.571 35633 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0011261
2016-07-09 17:52:16.472 35694 INFO nova.api.ec2 [-] 0.145s 10.81.61.239 GET / None:None 200 [None] text/plain text/plain
2016-07-09 17:52:16.472 35694 INFO nova.metadata.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 234 time: 0.0007479
2016-07-09 17:52:18.576 35620 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0005670

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1600500

Title:
  neutronclient.common.exceptions.NeutronClientException

Status in OpenStack Compute (nova):
  New

Bug description:
  Hello


  
  Description
  ===========
  Getting neutronclient exception error when trying to connect Cloudforms4.1 with Openstack liberty
  Openstack environment is not getting populated in Cloudforms because of this error


  Environment
  ===========
  1. [root@rhlospctl01 nova]# rpm -qa | grep nova
  openstack-nova-cert-12.0.3-1.el7ost.noarch
  openstack-nova-novncproxy-12.0.3-1.el7ost.noarch
  python-nova-12.0.3-1.el7ost.noarch
  openstack-nova-scheduler-12.0.3-1.el7ost.noarch
  openstack-nova-console-12.0.3-1.el7ost.noarch
  python-novaclient-3.1.0-2.el7ost.noarch
  openstack-nova-common-12.0.3-1.el7ost.noarch
  openstack-nova-conductor-12.0.3-1.el7ost.noarch
  openstack-nova-api-12.0.3-1.el7ost.noarch

  [root@rhlospctl01 nova]# rpm -qa | grep neutron
  python-neutronclient-3.1.0-1.el7ost.noarch
  openstack-neutron-ml2-7.0.4-2.el7ost.noarch
  openstack-neutron-7.0.4-2.el7ost.noarch
  openstack-neutron-openvswitch-7.0.4-2.el7ost.noarch
  openstack-neutron-common-7.0.4-2.el7ost.noarch
  python-neutron-7.0.4-2.el7ost.noarch

  
  2. Which hypervisor did you use?
     Libvirt + KVM
     What's the version of that?

  
  [root@rhlospctl01 nova]# rpm -qa | grep libvirt
  libvirt-client-1.2.17-13.el7_2.4.x86_64
  libvirt-python-1.2.17-2.el7.x86_64

  
  2. Which storage type did you use?
     CEPH

  3. Which networking type did you use?
     Neutron with OpenVSwitch VLAN provider network.(no L3)



  
  I am getting the following error

  4347b744780670409b50/os-keypairs.json?limit=1000&marker=cloud-ctrl1-key HTTP/1.1" status: 200 len: 1803 time: 0.0075929
  2016-07-09 17:52:07.143 35655 INFO nova.osapi_compute.wsgi.server [req-cee3f742-ccd5-4b5a-8c74-5cc684b09d5a 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-keypairs.json?limit=1000 HTTP/1.1" status: 200 len: 1803 time: 0.0080750
  2016-07-09 17:52:07.159 35631 INFO nova.osapi_compute.wsgi.server [req-1c172786-3c20-473e-b167-9fa84db542b0 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-keypairs.json?limit=1000&marker=cloud-ctrl1-key HTTP/1.1" status: 200 len: 1803 time: 0.0106990
  2016-07-09 17:52:08.567 35615 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0012670
  2016-07-09 17:52:11.469 35700 INFO nova.api.ec2 [-] 0.126s 10.81.61.239 GET / None:None 200 [None] text/plain text/plain
  2016-07-09 17:52:11.470 35700 INFO nova.metadata.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 234 time: 0.0009701
  2016-07-09 17:52:12.164 35615 INFO nova.osapi_compute.wsgi.server [req-28bb8960-d265-402e-894e-1465dbf36b51 9ec40e8aaf3641e695c4c57040832aba 100da705306c4347b744780670409b50 - - -] 10.81.61.211 "GET /v2/100da705306c4347b744780670409b50/servers/detail.json?limit=1000 HTTP/1.1" status: 200 len: 187 time: 0.0434470
  2016-07-09 17:52:12.431 35617 INFO nova.osapi_compute.wsgi.server [req-7862ed42-31d1-4d24-9c97-7f40ddbad713 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/servers/detail.json?limit=1000 HTTP/1.1" status: 200 len: 39905 time: 0.2637389
  2016-07-09 17:52:12.591 35617 INFO nova.osapi_compute.wsgi.server [req-7be49304-9f1d-4554-93d1-915dbd76bc0e 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/servers/detail.json?limit=1000&marker=f68af8ce-8873-470e-837a-7e4de6b1f945 HTTP/1.1" status: 200 len: 187 time: 0.0676081
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] Unexpected exception in API method
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/floating_ips.py", line 117, in index
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     floating_ips = self.network_api.get_floating_ips_by_project(context)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1435, in get_floating_ips_by_project
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     fips = client.list_floatingips(tenant_id=project_id)['floatingips']
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 102, in with_params
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     ret = self.function(instance, *args, **kwargs)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 731, in list_floatingips
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     **_params)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 307, in list
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     for r in self._pagination(collection, path, **params):
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 320, in _pagination
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     res = self.get(path, params=params)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 293, in get
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     headers=headers, params=params)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 270, in retry_request
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     headers=headers, params=params)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 211, in do_request
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     self._handle_fault_response(status_code, replybody)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 185, in _handle_fault_response
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     exception_handler_v20(status_code, des_error_body)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 83, in exception_handler_v20
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions     message=message)
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions NeutronClientException: 404 Not Found
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions The resource could not be found.
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions    
  2016-07-09 17:52:12.603 35617 ERROR nova.api.openstack.extensions 
  2016-07-09 17:52:12.604 35617 INFO nova.api.openstack.wsgi [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'neutronclient.common.exceptions.NeutronClientException'>
  2016-07-09 17:52:12.605 35617 INFO nova.osapi_compute.wsgi.server [req-9bec83aa-572b-4237-8171-e32f8a398d86 9ec40e8aaf3641e695c4c57040832aba 54a4f3dc50904dff9d5ec7703e27ce0b - - -] 10.81.61.211 "GET /v2/54a4f3dc50904dff9d5ec7703e27ce0b/os-floating-ips.json HTTP/1.1" status: 500 len: 435 time: 0.0105100
  2016-07-09 17:52:13.571 35633 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0011261
  2016-07-09 17:52:16.472 35694 INFO nova.api.ec2 [-] 0.145s 10.81.61.239 GET / None:None 200 [None] text/plain text/plain
  2016-07-09 17:52:16.472 35694 INFO nova.metadata.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 234 time: 0.0007479
  2016-07-09 17:52:18.576 35620 INFO nova.osapi_compute.wsgi.server [-] 10.81.61.239 "GET /" status: 200 len: 501 time: 0.0005670

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1600500/+subscriptions
Follow ups

[Bug 1600500] Re: NeutronClientException 404 listing floating IPs for a server (liberty)
From: Launchpad Bug Tracker, 2016-09-13