yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1915611] Re: 500 error on openstack server create

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Launchpad Bug Tracker <1915611@xxxxxxxxxxxxxxxxxx>
Date: Mon, 03 May 2021 04:17:29 -0000
Reply-to: Bug 1915611 <1915611@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
[Expired for OpenStack Compute (nova) because there has been no activity
for 60 days.]

** Changed in: nova
       Status: Incomplete => Expired

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1915611

Title:
  500 error on openstack server create

Status in OpenStack Compute (nova):
  Expired

Bug description:
  Description
  ===========

  I used the "openstack server create" command on a two-node test
  cluster.

  I tested neutron and nova user and mysql passwords, net connectivity,
  disabled apparmor, loaded the geneve kernel module.

  
  Steps to reproduce
  ==================
  run the command:

  root@controller:~# openstack server create --flavor m1.tiny --image
  cirros   --nic net-id=provider --security-group default   --key-name
  mykey test01

  
  Expected result
  ===============
  New server instance created. 

  
  Actual result
  =============
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'keystoneauth1.exceptions.http.Unauthorized'> (HTTP 500) (Request-ID: req-4655d135-6509-46e4-b918-27c31ff705a3)

  
  Environment
  ===========
  Debian 10.7
  repo: buster-ussuri-backports
  nova-common 2:21.1.1-1~bpo10+1
  QEMU hypervisor
  Neutron option 2 w/OpenVSwitch
  Disk storage

  
  Logs & Configs
  ==============
  nova-api.log

  2021-02-13 09:05:28.744 1426 INFO nova.api.openstack.wsgi [req-a78ac65e-a3ff-4a7d-b9dd-b2082e319be0 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] HTTP exception thrown: Flavor m1.tiny could not be found.
  2021-02-13 09:05:28.746 1426 INFO nova.api.openstack.requestlog [req-a78ac65e-a3ff-4a7d-b9dd-b2082e319be0 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors/m1.tiny" status: 404 len: 80 microversion: 2.1 time: 0.817156
  [pid: 1426|app: 0|req: 10/37] 172.29.236.13 () {32 vars in 626 bytes} [Sat Feb 13 09:05:27 2021] GET /v2.1/flavors/m1.tiny => generated 80 bytes in 853 msecs (HTTP/1.1 404) 7 headers in 339 bytes (1 switches on core 0)
  2021-02-13 09:05:28.812 1427 INFO nova.api.openstack.requestlog [req-b06b3fda-52fe-4ebf-bb91-9583eea28eec 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors" status: 200 len: 187 microversion: 2.1 time: 0.056631
  [pid: 1427|app: 0|req: 10/38] 172.29.236.13 () {32 vars in 610 bytes} [Sat Feb 13 09:05:28 2021] GET /v2.1/flavors => generated 187 bytes in 65 msecs (HTTP/1.1 200) 7 headers in 317 bytes (1 switches on core 0)
  2021-02-13 09:05:28.870 1425 INFO nova.api.openstack.requestlog [req-e9b74b79-3c78-4393-b363-5ac72ecaa096 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "GET /v2.1/flavors/0" status: 200 len: 354 microversion: 2.1 time: 0.046618
  [pid: 1425|app: 0|req: 10/39] 172.29.236.13 () {32 vars in 614 bytes} [Sat Feb 13 09:05:28 2021] GET /v2.1/flavors/0 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 7 headers in 317 bytes (1 switches on core 0)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] Unexpected exception in API method: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-cf6d651d-9e14-45f7-a87c-4fd8f970046c)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/wsgi.py", line 671, in wrapped
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return f(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   [Previous line repeated 9 more times]
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 697, in create
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     **create_kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/hooks.py", line 154, in inner
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     rv = f(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 1997, in create
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     requested_hypervisor_hostname=requested_hypervisor_hostname)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 1452, in _create_instance
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     reservation_id, max_count, supports_port_resource_request)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/compute/api.py", line 974, in _validate_and_build_base_options
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     affinity_policy=pci_numa_affinity_policy)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 2143, in create_resource_requests
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     context, neutron, network_id)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 2011, in _get_physnet_tunneled_info
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     if self._has_multi_provider_extension(context, neutron=neutron):
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1259, in _has_multi_provider_extension
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     self._refresh_neutron_extensions_cache(context, neutron=neutron)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1253, in _refresh_neutron_extensions_cache
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     extensions_list = neutron.list_extensions()['extensions']
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     ret = obj(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 788, in list_extensions
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return self.get(self.extensions_path, params=_params)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     ret = obj(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 354, in get
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     headers=headers, params=params)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     ret = obj(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 331, in retry_request
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     headers=headers, params=params)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 184, in wrapper
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     ret = obj(*args, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 282, in do_request
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     headers=headers)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 339, in do_request
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     self._check_uri_length(url)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 332, in _check_uri_length
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     uri_len = len(self.endpoint_url) + len(url)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 346, in endpoint_url
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return self.get_endpoint()
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 282, in get_endpoint
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return self.session.get_endpoint(auth or self.auth, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1225, in get_endpoint
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return auth.get_endpoint(self, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 380, in get_endpoint
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     allow_version_hack=allow_version_hack, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     service_catalog = self.get_access(session).service_catalog
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     self.auth_ref = self.get_auth_ref(session)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return self._plugin.get_auth_ref(session, **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     authenticated=False, log=False, **rkwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1131, in post
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     return self.request(url, 'POST', **kwargs)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 968, in request
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi     raise exceptions.from_response(resp, method, url)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-cf6d651d-9e14-45f7-a87c-4fd8f970046c)
  2021-02-13 09:05:33.879 1428 ERROR nova.api.openstack.wsgi
  2021-02-13 09:05:33.882 1428 INFO nova.api.openstack.wsgi [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'keystoneauth1.exceptions.http.Unauthorized'>
  2021-02-13 09:05:33.883 1428 INFO nova.api.openstack.requestlog [req-42b91a28-eaff-47aa-a7af-0d07b2ba768d 24f68ea810674751a3f3f81641402153 677c973f08a74a4d85368d3bfae359a7 - default default] 172.29.236.13 "POST /v2.1/servers" status: 500 len: 216 microversion: 2.1 time: 4.314794
  [pid: 1428|app: 0|req: 10/40] 172.29.236.13 () {36 vars in 664 bytes} [Sat Feb 13 09:05:29 2021] POST /v2.1/servers => generated 216 bytes in 4320 msecs (HTTP/1.1 500) 7 headers in 351 bytes (1 switches on core 0)

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1915611/+subscriptions
References

[Bug 1915611] [NEW] 500 error on openstack server create
From: Michael Potter, 2021-02-13