yahoo-eng-team team mailing list archive

[OpenStack Infra <1938021@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.opendev.org/c/openstack/nova/+/803714
Committed: https://opendev.org/openstack/nova/commit/d4dbcd5fa05ac2f988b65d611f71805f90411581
Submitter: "Zuul (22348)"
Branch:    master

commit d4dbcd5fa05ac2f988b65d611f71805f90411581
Author: Lee Yarwood <lyarwood@xxxxxxxxxx>
Date:   Fri Aug 6 10:02:15 2021 +0100

    func: Increase rpc_response_timeout in TestMultiCellMigrate tests
    
    This was previously set really low to 1 second that was leading to more
    involved flows such as test_delete_while_in_verify_resize_status timing
    out when the target calls the conductor to confirm the resize on the
    source.
    
    This change simply increases the timeout in the test but we might want
    to think about moving this call over to rpc_long_timeout this could be
    an issue in real world deployments.
    
    Closes-Bug: #1938021
    Change-Id: Ibba2d1506a0b026d35d7bf35384ec6439f438b01


** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1938021

Title:
  nova.tests.functional.test_cross_cell_migrate.TestMultiCellMigrate.test_delete_while_in_verify_resize_status
  hits oslo.messaging._drivers.impl_fake.send failure

Status in OpenStack Compute (nova):
  Fix Released
Status in oslo.messaging:
  New

Bug description:
  https://a8ba7f0ac14669316775-62d3a5548ea094caef4a9963ba6c55d1.ssl.cf1.rackcdn.com/798145/4/gate/nova-
  tox-functional-centos8-py36/1ee0272/testr_results.html

  2021-07-25 02:45:22,896 ERROR [nova.api.openstack.wsgi] Unexpected exception in API method
  Traceback (most recent call last):
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/oslo_messaging/_drivers/impl_fake.py", line 207, in _send
      reply, failure = reply_q.get(timeout=timeout)
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/eventlet/queue.py", line 322, in get
      return waiter.wait()
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/eventlet/queue.py", line 141, in wait
      return get_hub().switch()
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 313, in switch
      return self.greenlet.switch()
  queue.Empty

  During handling of the above exception, another exception occurred:

  Traceback (most recent call last):
    File "/home/zuul/src/opendev.org/openstack/nova/nova/api/openstack/wsgi.py", line 658, in wrapped
      return f(*args, **kwargs)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/api/openstack/compute/servers.py", line 1070, in delete
      self._delete(req.environ['nova.context'], req, id)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/api/openstack/compute/servers.py", line 883, in _delete
      self.compute_api.delete(context, instance)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 226, in inner
      return function(self, context, instance, *args, **kwargs)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 153, in inner
      return f(self, context, instance, *args, **kw)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 2541, in delete
      self._delete_instance(context, instance)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 2533, in _delete_instance
      task_state=task_states.DELETING)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 2311, in _delete
      self._confirm_resize_on_deleting(context, instance)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/compute/api.py", line 2405, in _confirm_resize_on_deleting
      context, instance, migration, do_cast=False)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/conductor/api.py", line 182, in confirm_snapshot_based_resize
      ctxt, instance, migration, do_cast=do_cast)
    File "/home/zuul/src/opendev.org/openstack/nova/nova/conductor/rpcapi.py", line 468, in confirm_snapshot_based_resize
      return cctxt.call(ctxt, 'confirm_snapshot_based_resize', **kw)
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 179, in call
      transport_options=self.transport_options)
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send
      transport_options=transport_options)
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/oslo_messaging/_drivers/impl_fake.py", line 223, in send
      transport_options)
    File "/home/zuul/src/opendev.org/openstack/nova/.tox/functional-py36/lib/python3.6/site-packages/oslo_messaging/_drivers/impl_fake.py", line 214, in _send
      'No reply on topic %s' % target.topic)
  oslo_messaging.exceptions.MessagingTimeout: No reply on topic conductor
  2021-07-25 02:45:22,898 INFO [nova.api.openstack.wsgi] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'>

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1938021/+subscriptions