yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2024871] [NEW] the nova errors (vresion queens) errors

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: sam <2024871@xxxxxxxxxxxxxxxxxx>
Date: Fri, 23 Jun 2023 03:03:09 -0000
Reply-to: Bug 2024871 <2024871@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:


I reported an error on the compute node after building nova。


2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager [req-a85e1436-e5a4-4395-ba5c-899d3b21b7bc - - - - -] Error updating resources for node compute.: KeyError: 'allocations'
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager Traceback (most recent call last):
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7578, in update_available_resource_for_node
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     rt.update_available_resource(context, nodename)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 720, in update_available_resource
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     self._update_available_resource(context, resources)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return f(*args, **kwargs)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 771, in _update_available_resource
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     context, self.compute_nodes[nodename], migrations)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 1277, in _remove_deleted_instances_allocations
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     context, cn.uuid) or {}
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return getattr(self.instance, __name)(*args, **kwargs)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 64, in wrapper
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return f(self, *a, **k)
2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 1785, in get_allocations_for_resource_provider

After this error occurs, after building the neutron and creating the
virtual machine, it will be unable to create the virtual machine, which
will be reported in the controller

NoValidHost: No valid host was found.
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager Traceback (most recent call last):
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 1165, in schedule_and_build_instances
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_alternates=True)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 760, in _schedule_instances
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return_alternates=return_alternates)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/utils.py", line 793, in wrapped
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return func(*args, **kwargs)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/init.py", line 53, in select_destinations
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_objects, return_alternates)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/init.py", line 37, in __run_method
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return getattr(self.instance, __name)(*args, **kwargs)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_objects, return_alternates)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/rpcapi.py", line 158, in select_destinations
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return cctxt.call(ctxt, 'select_destinations', **msg_args)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 174, in call
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     retry=self.retry)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 131, in _send
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     timeout=timeout, retry=retry)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 625, in send
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     retry=retry)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 616, in _send
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     raise result
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager NoValidHost_Remote: No valid host was found.
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager Traceback (most recent call last):
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 229, in inner
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return func(*args, **kwargs)
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/manager.py", line 139, in select_destinations
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     raise exception.NoValidHost(reason="")
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager NoValidHost: No valid host was found.
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager

Note: As the logs were obtained at different times, please ignore the
timing issue.

The following will list my nova configuration files. Please review them.
Thank you


This bug tracker is for errors with the documentation, use the following
as a template and remove or add fields as you see fit. Convert [ ] into
[x] to check boxes:

- [x] This doc is inaccurate in this way: ___i need report the errors___
- [ ] This is a doc addition request.
- [ ] I have a fix to the document that I can paste below including example: input and output. 

If you have a troubleshooting or support issue, use the following
resources:

 - Ask OpenStack: http://ask.openstack.org
 - The mailing list: http://lists.openstack.org
 - IRC: 'openstack' channel on Freenode

-----------------------------------
Release: 16.1.9.dev92 on 2021-04-10 07:30
SHA: 2ed1664b12cf67cecb1d858b10d901b674a8149f
Source: https://git.openstack.org/cgit/openstack/nova/tree/doc/source/install/controller-install-rdo.rst
URL: https://docs.openstack.org/nova/pike/install/controller-install-rdo.html

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2024871

Title:
  the nova errors (vresion queens) errors

Status in OpenStack Compute (nova):
  New

Bug description:
  
  I reported an error on the compute node after building nova。

  
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager [req-a85e1436-e5a4-4395-ba5c-899d3b21b7bc - - - - -] Error updating resources for node compute.: KeyError: 'allocations'
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager Traceback (most recent call last):
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7578, in update_available_resource_for_node
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     rt.update_available_resource(context, nodename)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 720, in update_available_resource
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     self._update_available_resource(context, resources)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return f(*args, **kwargs)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 771, in _update_available_resource
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     context, self.compute_nodes[nodename], migrations)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 1277, in _remove_deleted_instances_allocations
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     context, cn.uuid) or {}
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return getattr(self.instance, __name)(*args, **kwargs)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 64, in wrapper
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager     return f(self, *a, **k)
  2023-06-23 10:04:25.334 15207 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 1785, in get_allocations_for_resource_provider

  After this error occurs, after building the neutron and creating the
  virtual machine, it will be unable to create the virtual machine,
  which will be reported in the controller

  NoValidHost: No valid host was found.
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager Traceback (most recent call last):
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 1165, in schedule_and_build_instances
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_alternates=True)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 760, in _schedule_instances
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return_alternates=return_alternates)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/utils.py", line 793, in wrapped
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return func(*args, **kwargs)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/init.py", line 53, in select_destinations
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_objects, return_alternates)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/init.py", line 37, in __run_method
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return getattr(self.instance, __name)(*args, **kwargs)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     instance_uuids, return_objects, return_alternates)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/rpcapi.py", line 158, in select_destinations
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return cctxt.call(ctxt, 'select_destinations', **msg_args)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 174, in call
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     retry=self.retry)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 131, in _send
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     timeout=timeout, retry=retry)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 625, in send
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     retry=retry)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 616, in _send
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     raise result
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager NoValidHost_Remote: No valid host was found.
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager Traceback (most recent call last):
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 229, in inner
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     return func(*args, **kwargs)
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/manager.py", line 139, in select_destinations
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager     raise exception.NoValidHost(reason="")
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager NoValidHost: No valid host was found.
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager
  2023-06-22 10:57:15.649 3732 ERROR nova.conductor.manager

  Note: As the logs were obtained at different times, please ignore the
  timing issue.

  The following will list my nova configuration files. Please review
  them. Thank you


  This bug tracker is for errors with the documentation, use the
  following as a template and remove or add fields as you see fit.
  Convert [ ] into [x] to check boxes:

  - [x] This doc is inaccurate in this way: ___i need report the errors___
  - [ ] This is a doc addition request.
  - [ ] I have a fix to the document that I can paste below including example: input and output. 

  If you have a troubleshooting or support issue, use the following
  resources:

   - Ask OpenStack: http://ask.openstack.org
   - The mailing list: http://lists.openstack.org
   - IRC: 'openstack' channel on Freenode

  -----------------------------------
  Release: 16.1.9.dev92 on 2021-04-10 07:30
  SHA: 2ed1664b12cf67cecb1d858b10d901b674a8149f
  Source: https://git.openstack.org/cgit/openstack/nova/tree/doc/source/install/controller-install-rdo.rst
  URL: https://docs.openstack.org/nova/pike/install/controller-install-rdo.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/2024871/+subscriptions
Follow ups

[Bug 2024871] Re: the nova errors (vresion queens) errors
From: sam, 2023-10-16