← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #77072

[Bug 1816538] [NEW] test_volume_swap_server_with_error produce a suspicious stack trace

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

Sometimes test_volume_swap_server_with_error functional test fails [1].
It feels like a timing issue in the test itself. But regardless if it
fails or passes there is a suspicious stack trace in the log showing
that something is wrong with the swap volume codepath:


2019-02-18 22:40:07,103 ERROR [nova.compute.manager] Failed to connect to volume 9c6d9c2d-7a8f-4c80-938d-3bf062b8d489 with volume at /dev/sdb
Traceback (most recent call last):
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5701, in _swap_volume
    bdm, new_attachment_id, mountpoint)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5688, in _init_volume_connection
    new_cinfo['serial'] = new_volume_id
TypeError: 'tuple' object does not support item assignment
2019-02-18 22:40:07,521 ERROR [oslo_messaging.rpc.server] Exception during message handling
Traceback (most recent call last):
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
    res = self.dispatcher.dispatch(message)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
    result = func(ctxt, **new_args)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/exception_wrapper.py", line 79, in wrapped
    function_name, call_dict, binary, tb)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
    self.force_reraise()
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
    raise value
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/exception_wrapper.py", line 69, in wrapped
    return f(self, context, *args, **kw)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/utils.py", line 1301, in decorated_function
    return function(self, context, *args, **kwargs)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 213, in decorated_function
    kwargs['instance'], e, sys.exc_info())
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
    self.force_reraise()
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
    raise value
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 201, in decorated_function
    return function(self, context, *args, **kwargs)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5859, in swap_volume
    is_cinder_migration)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5757, in _swap_volume
    context, new_attachment_id)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
    self.force_reraise()
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)
  File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
    raise value
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5701, in _swap_volume
    bdm, new_attachment_id, mountpoint)
  File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5688, in _init_volume_connection
    new_cinfo['serial'] = new_volume_id
TypeError: 'tuple' object does not support item assignment


[1] http://logs.openstack.org/78/637578/1/check/nova-tox-functional-py35/14da3dc/testr_results.html.gz

** Affects: nova
     Importance: Low
         Status: New


** Tags: needs-functional-test notifications testing volumes

** Tags added: needs-functional-test notifications testing volumes

** Changed in: nova
   Importance: Undecided => Low

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1816538

Title:
  test_volume_swap_server_with_error produce a suspicious stack trace

Status in OpenStack Compute (nova):
  New

Bug description:
  Sometimes test_volume_swap_server_with_error functional test fails
  [1]. It feels like a timing issue in the test itself. But regardless
  if it fails or passes there is a suspicious stack trace in the log
  showing that something is wrong with the swap volume codepath:

  
  2019-02-18 22:40:07,103 ERROR [nova.compute.manager] Failed to connect to volume 9c6d9c2d-7a8f-4c80-938d-3bf062b8d489 with volume at /dev/sdb
  Traceback (most recent call last):
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5701, in _swap_volume
      bdm, new_attachment_id, mountpoint)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5688, in _init_volume_connection
      new_cinfo['serial'] = new_volume_id
  TypeError: 'tuple' object does not support item assignment
  2019-02-18 22:40:07,521 ERROR [oslo_messaging.rpc.server] Exception during message handling
  Traceback (most recent call last):
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
      res = self.dispatcher.dispatch(message)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
      return self._do_dispatch(endpoint, method, ctxt, args)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
      result = func(ctxt, **new_args)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/exception_wrapper.py", line 79, in wrapped
      function_name, call_dict, binary, tb)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
      self.force_reraise()
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
      six.reraise(self.type_, self.value, self.tb)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
      raise value
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/exception_wrapper.py", line 69, in wrapped
      return f(self, context, *args, **kw)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/utils.py", line 1301, in decorated_function
      return function(self, context, *args, **kwargs)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 213, in decorated_function
      kwargs['instance'], e, sys.exc_info())
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
      self.force_reraise()
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
      six.reraise(self.type_, self.value, self.tb)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
      raise value
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 201, in decorated_function
      return function(self, context, *args, **kwargs)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5859, in swap_volume
      is_cinder_migration)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5757, in _swap_volume
      context, new_attachment_id)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 220, in __exit__
      self.force_reraise()
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
      six.reraise(self.type_, self.value, self.tb)
    File "/home/zuul/src/git.openstack.org/openstack/nova/.tox/functional-py35/lib/python3.5/site-packages/six.py", line 693, in reraise
      raise value
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5701, in _swap_volume
      bdm, new_attachment_id, mountpoint)
    File "/home/zuul/src/git.openstack.org/openstack/nova/nova/compute/manager.py", line 5688, in _init_volume_connection
      new_cinfo['serial'] = new_volume_id
  TypeError: 'tuple' object does not support item assignment

  
  [1] http://logs.openstack.org/78/637578/1/check/nova-tox-functional-py35/14da3dc/testr_results.html.gz

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1816538/+subscriptions

Follow ups

  Thread Previous • Date Previous • • Thread Next