yahoo-eng-team team mailing list archive

[Mark McClain <1230407@xxxxxxxxxxxxxxxxxx>]

Closing this bug as it is non-specific.  Instead we should open bugs for
specific instances of this error.

** Changed in: neutron
    Milestone: icehouse-rc1 => None

** Changed in: neutron
       Status: Confirmed => Invalid

** Changed in: neutron
     Assignee: Mark McClain (markmcclain) => (unassigned)

** Changed in: neutron
   Importance: Critical => Undecided

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1230407

Title:
  VMs can't progress through state changes because Neutron is
  deadlocking on it's database queries, and thus leaving networks in
  inconsistent states

Status in OpenStack Neutron (virtual network service):
  Invalid

Bug description:
  This is most often seen with the "State change timeout exceeded" in
  the tempest logs.

  2013-09-25 16:03:28.319 | FAIL: tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_stop_terminate_instance_with_tags[gate,smoke]
  2013-09-25 16:03:28.319 | tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_stop_terminate_instance_with_tags[gate,smoke]
  2013-09-25 16:03:28.319 | ----------------------------------------------------------------------
  2013-09-25 16:03:28.319 | _StringException: Empty attachments:
  2013-09-25 16:03:28.319 |   stderr
  2013-09-25 16:03:28.320 |   stdout
  2013-09-25 16:03:28.320 |
  2013-09-25 16:03:28.320 | pythonlogging:'': {{{2013-09-25 15:49:34,792 state: pending}}}
  2013-09-25 16:03:28.320 |
  2013-09-25 16:03:28.320 | Traceback (most recent call last):
  2013-09-25 16:03:28.320 |   File "tempest/thirdparty/boto/test_ec2_instance_run.py", line 175, in test_run_stop_terminate_instance_with_tags
  2013-09-25 16:03:28.320 |     self.assertInstanceStateWait(instance, "running")
  2013-09-25 16:03:28.321 |   File "tempest/thirdparty/boto/test.py", line 356, in assertInstanceStateWait
  2013-09-25 16:03:28.321 |     state = self.waitInstanceState(lfunction, wait_for)
  2013-09-25 16:03:28.321 |   File "tempest/thirdparty/boto/test.py", line 341, in waitInstanceState
  2013-09-25 16:03:28.321 |     self.valid_instance_state)
  2013-09-25 16:03:28.321 |   File "tempest/thirdparty/boto/test.py", line 331, in state_wait_gone
  2013-09-25 16:03:28.321 |     state = state_wait(lfunction, final_set, valid_set)
  2013-09-25 16:03:28.322 |   File "tempest/thirdparty/boto/utils/wait.py", line 57, in state_wait
  2013-09-25 16:03:28.322 |     (dtime, final_set, status))
  2013-09-25 16:03:28.322 | AssertionError: State change timeout exceeded!(400s) While waitingfor set(['running', '_GONE']) at "pending"

  full log: http://logs.openstack.org/38/47438/1/gate/gate-tempest-
  devstack-vm-neutron/93db162/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1230407/+subscriptions