← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1776085] [NEW] nova show me the unexpected API Error when the resize is not finished

 

Public bug reported:

2018-06-04T15:24:39.732+08:00 pgRjxrxGHOxjIkq nova-api ERROR [pid:48758] [MainThread] [tid:182685520] [extensions.py:504 wrapped] [req-c237f91f-e684-463e-8499-ba312ab2d3fd] Unexpected exception in API method
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 1128, in delete
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._delete(req.environ['nova.context'], req, id)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 973, in _delete
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self.compute_api.delete(context, instance)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/osprofiler/profiler.py", line 155, in wrapper
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/osprofiler/profiler.py", line 155, in wrapper
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 198, in wrapped
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return func(self, context, target, *args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 187, in inner
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 215, in _wrapped
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return fn(self, context, instance, *args, **kwargs)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 155, in inner
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(self, context, instance, *args, **kw)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 1983, in delete
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._delete_instance(context, instance)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1553, in _delete_instance
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     task_state=task_states.DELETING)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1451, in _delete***
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     quotas.rollback()
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self.force_reraise()
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1404, in _delete
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._confirm_resize_on_deleting(context, instance)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1495, in _confirm_resize_on_deleting
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     deltas = compute_utils.downsize_quota_delta(context, instance)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 472, in downsize_quota_delta
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return resize_quota_delta(context, new_flavor, old_flavor, 1, -1)
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 445, in resize_quota_delta
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     if compare * _quota_delta('vcpus') > 0:
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 442, in _quota_delta
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return sense * (new_flavor[resource] - old_flavor[resource])
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions TypeError: 'NoneType' object has no attribute '__getitem__'
2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions

It looks like the resize action is not finished and we want to delete
the server, so the service show me the unexpected api

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1776085

Title:
  nova show me the unexpected API Error when the resize is not finished

Status in OpenStack Compute (nova):
  New

Bug description:
  2018-06-04T15:24:39.732+08:00 pgRjxrxGHOxjIkq nova-api ERROR [pid:48758] [MainThread] [tid:182685520] [extensions.py:504 wrapped] [req-c237f91f-e684-463e-8499-ba312ab2d3fd] Unexpected exception in API method
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 1128, in delete
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._delete(req.environ['nova.context'], req, id)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 973, in _delete
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self.compute_api.delete(context, instance)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/osprofiler/profiler.py", line 155, in wrapper
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/osprofiler/profiler.py", line 155, in wrapper
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 198, in wrapped
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return func(self, context, target, *args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 187, in inner
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 215, in _wrapped
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return fn(self, context, instance, *args, **kwargs)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 155, in inner
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return f(self, context, instance, *args, **kw)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/api.py", line 1983, in delete
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._delete_instance(context, instance)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1553, in _delete_instance
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     task_state=task_states.DELETING)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1451, in _delete***
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     quotas.rollback()
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self.force_reraise()
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1404, in _delete
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     self._confirm_resize_on_deleting(context, instance)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/huawei/compute/api.py", line 1495, in _confirm_resize_on_deleting
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     deltas = compute_utils.downsize_quota_delta(context, instance)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 472, in downsize_quota_delta
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return resize_quota_delta(context, new_flavor, old_flavor, 1, -1)
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 445, in resize_quota_delta
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     if compare * _quota_delta('vcpus') > 0:
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions   File "/opt/cloud/services/cascading-nova/venv/lib/python2.7/site-packages/nova/compute/utils.py", line 442, in _quota_delta
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions     return sense * (new_flavor[resource] - old_flavor[resource])
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions TypeError: 'NoneType' object has no attribute '__getitem__'
  2018-06-04 15:24:39.720 48758 ERROR nova.api.openstack.extensions

  It looks like the resize action is not finished and we want to delete
  the server, so the service show me the unexpected api

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1776085/+subscriptions


Follow ups