← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 2100244] [NEW] "openstack server list" throws HttpException: 500: Server Error for url: Unexpected API Error.

 

Public bug reported:

"openstack server list" throws  HttpException: 500: Server Error for url:  Unexpected API Error.
Other commands (like image, volume, network list commmands are fine)
I can also do "openstack server show"
I am running Dalmatian release in ubuntu 24.04

# openstack server list
HttpException: 500: Server Error for url: http://cnsdenlabos01:8774/v2.1/servers/detail?deleted=False, Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.


Following is nova-api.log

--------------------------------------------------
==> /var/log/nova/nova-api.log <==
2025-02-26 05:09:36.309 4075 INFO nova.osapi_compute.wsgi.server [-] 172.16.0.31 "GET /v2.1 HTTP/1.1" status: 200 len: 786 time: 0.0052352
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] Unexpected exception in API method: KeyError: '0e33ffe3-06db-4a37-a8c0-1c1dffd4cac5'
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/wsgi.py", line 678, in wrapped
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return f(*args, **kwargs)
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   [Previous line repeated 2 more times]
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 143, in detail
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     servers = self._get_servers(req, is_detail=True)
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 343, in _get_servers
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     response = self._view_builder.detail(
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/views/servers.py", line 475, in detail
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     servers_dict = self._list_view(self.show, request, instances,
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/views/servers.py", line 535, in _list_view
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     provided_az=req_specs_dict[server.uuid])["server"]
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                 ~~~~~~~~~~~~~~^^^^^^^^^^^^^
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi KeyError: '0e33ffe3-06db-4a37-a8c0-1c1dffd4cac5'
2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi
2025-02-26 05:09:37.616 4075 INFO nova.api.openstack.wsgi [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'KeyError'>
2025-02-26 05:09:37.619 4075 INFO nova.osapi_compute.wsgi.server [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] 172.16.0.31 "GET /v2.1/servers/detail?deleted=False HTTP/1.1" status: 500 len: 617 time: 1.3069117


--------------------------------------------------


# dpkg -l | grep nova
ii  nova-api                             3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - API frontend
ii  nova-common                          3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - common files
ii  nova-compute                         3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node base
ii  nova-compute-kvm                     3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node (KVM)
ii  nova-compute-libvirt                 3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node libvirt support
ii  nova-conductor                       3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - conductor service
ii  nova-novncproxy                      3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - NoVNC proxy
ii  nova-scheduler                       3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - virtual machine scheduler
ii  python3-nova                         3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute Python 3 libraries
ii  python3-novaclient                   2:18.7.0-0ubuntu1~cloud0                all          client library for OpenStack Compute API - 3.x

---------
Using QEMU hypervisor
Storage type is lvm
Using openVswitch for networking
It had been working fine for some time. I have around 10+ guest vms still running and I can access them fine.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2100244

Title:
  "openstack server list" throws  HttpException: 500: Server Error for
  url:  Unexpected API Error.

Status in OpenStack Compute (nova):
  New

Bug description:
  "openstack server list" throws  HttpException: 500: Server Error for url:  Unexpected API Error.
  Other commands (like image, volume, network list commmands are fine)
  I can also do "openstack server show"
  I am running Dalmatian release in ubuntu 24.04

  # openstack server list
  HttpException: 500: Server Error for url: http://cnsdenlabos01:8774/v2.1/servers/detail?deleted=False, Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.

  
  Following is nova-api.log

  --------------------------------------------------
  ==> /var/log/nova/nova-api.log <==
  2025-02-26 05:09:36.309 4075 INFO nova.osapi_compute.wsgi.server [-] 172.16.0.31 "GET /v2.1 HTTP/1.1" status: 200 len: 786 time: 0.0052352
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] Unexpected exception in API method: KeyError: '0e33ffe3-06db-4a37-a8c0-1c1dffd4cac5'
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/wsgi.py", line 678, in wrapped
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return f(*args, **kwargs)
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/validation/__init__.py", line 286, in wrapper
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi            ^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   [Previous line repeated 2 more times]
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 143, in detail
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     servers = self._get_servers(req, is_detail=True)
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/servers.py", line 343, in _get_servers
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     response = self._view_builder.detail(
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                ^^^^^^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/views/servers.py", line 475, in detail
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     servers_dict = self._list_view(self.show, request, instances,
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi   File "/usr/lib/python3/dist-packages/nova/api/openstack/compute/views/servers.py", line 535, in _list_view
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi     provided_az=req_specs_dict[server.uuid])["server"]
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi                 ~~~~~~~~~~~~~~^^^^^^^^^^^^^
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi KeyError: '0e33ffe3-06db-4a37-a8c0-1c1dffd4cac5'
  2025-02-26 05:09:37.613 4075 ERROR nova.api.openstack.wsgi
  2025-02-26 05:09:37.616 4075 INFO nova.api.openstack.wsgi [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'KeyError'>
  2025-02-26 05:09:37.619 4075 INFO nova.osapi_compute.wsgi.server [None req-cfde50d8-df81-4717-8156-f9d2e7a0bb4a 91df74a173864580bc23dc8e5d95c602 8608366cdbc7478c98796c3c416a976b - - default default] 172.16.0.31 "GET /v2.1/servers/detail?deleted=False HTTP/1.1" status: 500 len: 617 time: 1.3069117

  
  --------------------------------------------------

  
  # dpkg -l | grep nova
  ii  nova-api                             3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - API frontend
  ii  nova-common                          3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - common files
  ii  nova-compute                         3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node base
  ii  nova-compute-kvm                     3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node (KVM)
  ii  nova-compute-libvirt                 3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - compute node libvirt support
  ii  nova-conductor                       3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - conductor service
  ii  nova-novncproxy                      3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - NoVNC proxy
  ii  nova-scheduler                       3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute - virtual machine scheduler
  ii  python3-nova                         3:30.0.0-0ubuntu1~cloud0                all          OpenStack Compute Python 3 libraries
  ii  python3-novaclient                   2:18.7.0-0ubuntu1~cloud0                all          client library for OpenStack Compute API - 3.x

  ---------
  Using QEMU hypervisor
  Storage type is lvm
  Using openVswitch for networking
  It had been working fine for some time. I have around 10+ guest vms still running and I can access them fine.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/2100244/+subscriptions