yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2045726] [NEW] instance creation error

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Anoop Unni <2045726@xxxxxxxxxxxxxxxxxx>
Date: Wed, 06 Dec 2023 05:40:33 -0000
Reply-to: Bug 2045726 <2045726@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

2023-12-04 18:33:44.623 943 INFO nova.compute.claims [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Claim successful on node node1
2023-12-04 18:33:44.860 943 INFO nova.virt.libvirt.driver [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
2023-12-04 18:33:44.955 943 INFO nova.virt.libvirt.driver [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Creating image(s)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Instance failed network setup after 1 attempt(s): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager Traceback (most recent call last):
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1965, in _allocate_network_async
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     nwinfo = self.network_api.allocate_for_instance(
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1216, in allocate_for_instance
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     created_port_ids = self._update_ports_for_instance(
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1352, in _update_ports_for_instance
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     with excutils.save_and_reraise_exception():
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self.force_reraise()
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     raise self.value
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1327, in _update_ports_for_instance
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     updated_port = self._update_port(
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 583, in _update_port
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     port_response = port_client.update_port(port_id, port_req_body)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 828, in update_port
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self._update_resource(self.port_path % (port), body=body,
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.put(path, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 365, in put
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.retry_request("PUT", action, body=body,
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.do_request(method, action, body=body,
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     resp, replybody = self.httpclient.do_request(action, method, body=body,
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 341, in do_request
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self._check_uri_length(url)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 334, in _check_uri_length
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     uri_len = len(self.endpoint_url) + len(url)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 348, in endpoint_url
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.get_endpoint()
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.session.get_endpoint(auth or self.auth, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return auth.get_endpoint(self, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     endpoint_data = self.get_endpoint_data(
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     service_catalog = self.get_access(session).service_catalog
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self.auth_ref = self.get_auth_ref(session)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self._plugin.get_auth_ref(session, **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     resp = session.post(token_url, json=body, headers=headers,
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1149, in post
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.request(url, 'POST', **kwargs)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 986, in request
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     raise exceptions.from_response(resp, method, url)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
2023-12-04 18:33:45.392 943 ERROR nova.compute.manager 
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Instance failed to spawn: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Traceback (most recent call last):
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2849, in _build_resources
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     yield resources
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2607, in _build_and_run_instance
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.driver.spawn(context, instance, image_meta,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 4385, in spawn
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     xml = self._get_guest_xml(context, instance, network_info,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7518, in _get_guest_xml
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     network_info_str = str(network_info)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 620, in __str__
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._sync_wrapper(fn, *args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 603, in _sync_wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.wait()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 635, in wait
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self[:] = self._gt.wait()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 181, in wait
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._exit_event.wait()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     result = hub.switch()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 313, in switch
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.greenlet.switch()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 221, in main
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     result = function(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/utils.py", line 654, in context_wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return func(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1987, in _allocate_network_async
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise e
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1965, in _allocate_network_async
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     nwinfo = self.network_api.allocate_for_instance(
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1216, in allocate_for_instance
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     created_port_ids = self._update_ports_for_instance(
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1352, in _update_ports_for_instance
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     with excutils.save_and_reraise_exception():
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.force_reraise()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise self.value
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1327, in _update_ports_for_instance
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     updated_port = self._update_port(
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 583, in _update_port
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     port_response = port_client.update_port(port_id, port_req_body)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 828, in update_port
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._update_resource(self.port_path % (port), body=body,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.put(path, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 365, in put
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.retry_request("PUT", action, body=body,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.do_request(method, action, body=body,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     resp, replybody = self.httpclient.do_request(action, method, body=body,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 341, in do_request
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self._check_uri_length(url)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 334, in _check_uri_length
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     uri_len = len(self.endpoint_url) + len(url)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 348, in endpoint_url
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.get_endpoint()
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.session.get_endpoint(auth or self.auth, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return auth.get_endpoint(self, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     endpoint_data = self.get_endpoint_data(
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     service_catalog = self.get_access(session).service_catalog
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.auth_ref = self.get_auth_ref(session)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._plugin.get_auth_ref(session, **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     resp = session.post(token_url, json=body, headers=headers,
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1149, in post
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.request(url, 'POST', **kwargs)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 986, in request
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise exceptions.from_response(resp, method, url)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] 
2023-12-04 18:33:45.397 943 INFO nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Terminating instance
2023-12-04 18:33:45.633 943 WARNING nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Could not clean up failed build, not rescheduling. Error: The request you have made requires authentication. (HTTP 401) (Request-ID: req-f800ce22-8dad-4047-bd57-ba3d437f52eb): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-f800ce22-8dad-4047-bd57-ba3d437f52eb)
2023-12-04 18:33:45.779 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Build of instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503 aborted: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7): nova.exception.BuildAbortException: Build of instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503 aborted: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
2023-12-04 18:33:46.074 943 WARNING nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Failed to update network info cache when cleaning up allocated networks. Stale VIFs may be left on this host.Error: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ded4ff28-4e6f-4c74-b006-c19a738799f7): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ded4ff28-4e6f-4c74-b006-c19a738799f7)
2023-12-04 18:33:46.133 943 INFO nova.scheduler.client.report [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Deleted allocations for instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503

** Affects: ubuntu
     Importance: Undecided
     Assignee: Anoop Unni (anoopdesom)
         Status: Incomplete

** Attachment added: "nova instance creation.jpg"
   https://bugs.launchpad.net/bugs/2045726/+attachment/5726626/+files/nova%20instance%20creation.jpg

** Project changed: nova => ubuntu

** Changed in: ubuntu
       Status: New => Opinion

** Changed in: ubuntu
     Assignee: (unassigned) => Anoop Unni (anoopdesom)

** Changed in: ubuntu
       Status: Opinion => Incomplete

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2045726

Title:
  instance creation error

Status in Ubuntu:
  Incomplete

Bug description:
  2023-12-04 18:33:44.623 943 INFO nova.compute.claims [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Claim successful on node node1
  2023-12-04 18:33:44.860 943 INFO nova.virt.libvirt.driver [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
  2023-12-04 18:33:44.955 943 INFO nova.virt.libvirt.driver [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Creating image(s)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Instance failed network setup after 1 attempt(s): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager Traceback (most recent call last):
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1965, in _allocate_network_async
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     nwinfo = self.network_api.allocate_for_instance(
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1216, in allocate_for_instance
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     created_port_ids = self._update_ports_for_instance(
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1352, in _update_ports_for_instance
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     with excutils.save_and_reraise_exception():
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self.force_reraise()
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     raise self.value
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1327, in _update_ports_for_instance
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     updated_port = self._update_port(
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 583, in _update_port
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     port_response = port_client.update_port(port_id, port_req_body)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 828, in update_port
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self._update_resource(self.port_path % (port), body=body,
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.put(path, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 365, in put
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.retry_request("PUT", action, body=body,
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.do_request(method, action, body=body,
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     resp, replybody = self.httpclient.do_request(action, method, body=body,
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 341, in do_request
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self._check_uri_length(url)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 334, in _check_uri_length
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     uri_len = len(self.endpoint_url) + len(url)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 348, in endpoint_url
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.get_endpoint()
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.session.get_endpoint(auth or self.auth, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return auth.get_endpoint(self, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     endpoint_data = self.get_endpoint_data(
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     service_catalog = self.get_access(session).service_catalog
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     self.auth_ref = self.get_auth_ref(session)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self._plugin.get_auth_ref(session, **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     resp = session.post(token_url, json=body, headers=headers,
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1149, in post
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     return self.request(url, 'POST', **kwargs)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 986, in request
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager     raise exceptions.from_response(resp, method, url)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
  2023-12-04 18:33:45.392 943 ERROR nova.compute.manager 
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Instance failed to spawn: keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Traceback (most recent call last):
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2849, in _build_resources
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     yield resources
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2607, in _build_and_run_instance
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.driver.spawn(context, instance, image_meta,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 4385, in spawn
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     xml = self._get_guest_xml(context, instance, network_info,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7518, in _get_guest_xml
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     network_info_str = str(network_info)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 620, in __str__
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._sync_wrapper(fn, *args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 603, in _sync_wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.wait()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/model.py", line 635, in wait
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self[:] = self._gt.wait()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 181, in wait
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._exit_event.wait()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/event.py", line 125, in wait
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     result = hub.switch()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 313, in switch
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.greenlet.switch()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 221, in main
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     result = function(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/utils.py", line 654, in context_wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return func(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1987, in _allocate_network_async
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise e
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 1965, in _allocate_network_async
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     nwinfo = self.network_api.allocate_for_instance(
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1216, in allocate_for_instance
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     created_port_ids = self._update_ports_for_instance(
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1352, in _update_ports_for_instance
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     with excutils.save_and_reraise_exception():
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.force_reraise()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise self.value
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 1327, in _update_ports_for_instance
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     updated_port = self._update_port(
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 583, in _update_port
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     port_response = port_client.update_port(port_id, port_req_body)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 828, in update_port
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._update_resource(self.port_path % (port), body=body,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.put(path, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 365, in put
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.retry_request("PUT", action, body=body,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.do_request(method, action, body=body,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/nova/network/neutron.py", line 196, in wrapper
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     ret = obj(*args, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     resp, replybody = self.httpclient.do_request(action, method, body=body,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 341, in do_request
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self._check_uri_length(url)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 334, in _check_uri_length
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     uri_len = len(self.endpoint_url) + len(url)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/neutronclient/client.py", line 348, in endpoint_url
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.get_endpoint()
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.session.get_endpoint(auth or self.auth, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return auth.get_endpoint(self, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     endpoint_data = self.get_endpoint_data(
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     service_catalog = self.get_access(session).service_catalog
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     self.auth_ref = self.get_auth_ref(session)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self._plugin.get_auth_ref(session, **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     resp = session.post(token_url, json=body, headers=headers,
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 1149, in post
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     return self.request(url, 'POST', **kwargs)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]   File "/usr/lib/python3/dist-packages/keystoneauth1/session.py", line 986, in request
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503]     raise exceptions.from_response(resp, method, url)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
  2023-12-04 18:33:45.396 943 ERROR nova.compute.manager [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] 
  2023-12-04 18:33:45.397 943 INFO nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Terminating instance
  2023-12-04 18:33:45.633 943 WARNING nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Could not clean up failed build, not rescheduling. Error: The request you have made requires authentication. (HTTP 401) (Request-ID: req-f800ce22-8dad-4047-bd57-ba3d437f52eb): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-f800ce22-8dad-4047-bd57-ba3d437f52eb)
  2023-12-04 18:33:45.779 943 ERROR nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] [instance: c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503] Build of instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503 aborted: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7): nova.exception.BuildAbortException: Build of instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503 aborted: The request you have made requires authentication. (HTTP 401) (Request-ID: req-93bea61f-5ba4-4142-9e9c-a0a69c2309f7)
  2023-12-04 18:33:46.074 943 WARNING nova.compute.manager [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Failed to update network info cache when cleaning up allocated networks. Stale VIFs may be left on this host.Error: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ded4ff28-4e6f-4c74-b006-c19a738799f7): keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ded4ff28-4e6f-4c74-b006-c19a738799f7)
  2023-12-04 18:33:46.133 943 INFO nova.scheduler.client.report [None req-0a881206-301f-4afa-8327-215c0f622acb 90d604a6f0b44afb85d4805b88e4d01c 7213168c18a64ef79ac2bbade35cd663 - - default default] Deleted allocations for instance c7fbc1d5-25cf-4ce1-bf5d-6249dc99c503

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+bug/2045726/+subscriptions