← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #59372

[Bug 1646841] [NEW] UnexpectedTaskStateError: Conflict updating instance xxxx Expected: {'task_state': [u'resize_prep']}. Actual: {'task_state': None}

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

it's newton release version code, not 100% percent reproducable, but
very likely

step1) boot instance
step2) restart compute service
step3) right after compute service start, resize the instance booted at step 1


2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 87, in _object_dispatch
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return getattr(target, method)(*args, **kwargs)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return fn(self, *args, **kwargs)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 748, in save
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     columns_to_join=_expected_cols(expected_attrs))
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 838, in instance_update_and_get_original
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     expected=expected)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 169, in wrapper
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     ectxt.value = e.inner_exc
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     self.force_reraise()
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 240, in wrapped
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(context, *args, **kwargs)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2635, in instance_update_and_get_original
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     context, instance_uuid, values, expected, original=instance_ref))
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2771, in _instance_update
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     raise exc(**exc_props)
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server UnexpectedTaskStateError: Conflict updating instance f8c68d7b-1234-4c99-a5c7-c5f18f203513. Expected: {'task_state': [u'resize_prep']}. Actual: {'task_state': None}

** Affects: nova
     Importance: Undecided
     Assignee: jichenjc (jichenjc)
         Status: New

** Changed in: nova
     Assignee: (unassigned) => jichenjc (jichenjc)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1646841

Title:
   UnexpectedTaskStateError: Conflict updating instance xxxx Expected:
  {'task_state': [u'resize_prep']}. Actual: {'task_state': None}

Status in OpenStack Compute (nova):
  New

Bug description:
  it's newton release version code, not 100% percent reproducable, but
  very likely

  step1) boot instance
  step2) restart compute service
  step3) right after compute service start, resize the instance booted at step 1

  
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/conductor/manager.py", line 87, in _object_dispatch
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return getattr(target, method)(*args, **kwargs)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return fn(self, *args, **kwargs)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/objects/instance.py", line 748, in save
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     columns_to_join=_expected_cols(expected_attrs))
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 838, in instance_update_and_get_original
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     expected=expected)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 169, in wrapper
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     ectxt.value = e.inner_exc
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     self.force_reraise()
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 240, in wrapped
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     return f(context, *args, **kwargs)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2635, in instance_update_and_get_original
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     context, instance_uuid, values, expected, original=instance_ref))
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 2771, in _instance_update
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server     raise exc(**exc_props)
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server
  2016-12-02 13:41:22.265 36087 ERROR oslo_messaging.rpc.server UnexpectedTaskStateError: Conflict updating instance f8c68d7b-1234-4c99-a5c7-c5f18f203513. Expected: {'task_state': [u'resize_prep']}. Actual: {'task_state': None}

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1646841/+subscriptions
  Thread Previous • Date Previous • • Thread Next