yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem.os@xxxxxxxxx>]

Public bug reported:

Seen here:

http://logs.openstack.org/87/472287/1/gate/gate-nova-tox-functional-py35
-ubuntu-xenial/79cb96d/console.html#_2017-06-08_17_42_12_495403

2017-06-08 17:42:12.494766 |     b'2017-06-08 17:38:24,561 ERROR [nova.compute.manager] Error updating resources for node fake-mini.'
2017-06-08 17:42:12.494781 |     b'Traceback (most recent call last):'
2017-06-08 17:42:12.494821 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/manager.py", line 6594, in update_available_resource_for_node'
2017-06-08 17:42:12.494840 |     b'    rt.update_available_resource(context, nodename)'
2017-06-08 17:42:12.494881 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 626, in update_available_resource'
2017-06-08 17:42:12.494900 |     b'    self._update_available_resource(context, resources)'
2017-06-08 17:42:12.494946 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/oslo_concurrency/lockutils.py", line 271, in inner'
2017-06-08 17:42:12.494960 |     b'    return f(*args, **kwargs)'
2017-06-08 17:42:12.495012 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 667, in _update_available_resource'
2017-06-08 17:42:12.495062 |     b'    self._update_usage_from_instances(context, instances, nodename)'
2017-06-08 17:42:12.495111 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 1047, in _update_usage_from_instances'
2017-06-08 17:42:12.495133 |     b'    self._remove_deleted_instances_allocations(context, cn)'
2017-06-08 17:42:12.495182 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 1055, in _remove_deleted_instances_allocations'
2017-06-08 17:42:12.495194 |     b'    cn.uuid) or {}'
2017-06-08 17:42:12.495234 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/__init__.py", line 37, in __run_method'
2017-06-08 17:42:12.495256 |     b'    return getattr(self.instance, __name)(*args, **kwargs)'
2017-06-08 17:42:12.495294 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/report.py", line 55, in wrapper'
2017-06-08 17:42:12.495318 |     b'    return f(self, *a, **k)'
2017-06-08 17:42:12.495362 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/report.py", line 914, in get_allocations_for_resource_provider'
2017-06-08 17:42:12.495390 |     b"    return resp.json()['allocations']"
2017-06-08 17:42:12.495403 |     b"KeyError: 'allocations'"

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22KeyError%5C%22%20AND%20message%3A%5C%22allocations%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20project%3A%5C%22openstack%2Fnova%5C%22&from=7d

** Affects: nova
     Importance: Medium
         Status: Confirmed


** Tags: functional testing

** Changed in: nova
       Status: New => Confirmed

** Changed in: nova
   Importance: Undecided => Medium

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1696834

Title:
  Intermittent "KeyError: 'allocations'" in functional tests

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  Seen here:

  http://logs.openstack.org/87/472287/1/gate/gate-nova-tox-functional-
  py35-ubuntu-xenial/79cb96d/console.html#_2017-06-08_17_42_12_495403

  2017-06-08 17:42:12.494766 |     b'2017-06-08 17:38:24,561 ERROR [nova.compute.manager] Error updating resources for node fake-mini.'
  2017-06-08 17:42:12.494781 |     b'Traceback (most recent call last):'
  2017-06-08 17:42:12.494821 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/manager.py", line 6594, in update_available_resource_for_node'
  2017-06-08 17:42:12.494840 |     b'    rt.update_available_resource(context, nodename)'
  2017-06-08 17:42:12.494881 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 626, in update_available_resource'
  2017-06-08 17:42:12.494900 |     b'    self._update_available_resource(context, resources)'
  2017-06-08 17:42:12.494946 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/.tox/functional-py35/lib/python3.5/site-packages/oslo_concurrency/lockutils.py", line 271, in inner'
  2017-06-08 17:42:12.494960 |     b'    return f(*args, **kwargs)'
  2017-06-08 17:42:12.495012 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 667, in _update_available_resource'
  2017-06-08 17:42:12.495062 |     b'    self._update_usage_from_instances(context, instances, nodename)'
  2017-06-08 17:42:12.495111 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 1047, in _update_usage_from_instances'
  2017-06-08 17:42:12.495133 |     b'    self._remove_deleted_instances_allocations(context, cn)'
  2017-06-08 17:42:12.495182 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/compute/resource_tracker.py", line 1055, in _remove_deleted_instances_allocations'
  2017-06-08 17:42:12.495194 |     b'    cn.uuid) or {}'
  2017-06-08 17:42:12.495234 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/__init__.py", line 37, in __run_method'
  2017-06-08 17:42:12.495256 |     b'    return getattr(self.instance, __name)(*args, **kwargs)'
  2017-06-08 17:42:12.495294 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/report.py", line 55, in wrapper'
  2017-06-08 17:42:12.495318 |     b'    return f(self, *a, **k)'
  2017-06-08 17:42:12.495362 |     b'  File "/home/jenkins/workspace/gate-nova-tox-functional-py35-ubuntu-xenial/nova/scheduler/client/report.py", line 914, in get_allocations_for_resource_provider'
  2017-06-08 17:42:12.495390 |     b"    return resp.json()['allocations']"
  2017-06-08 17:42:12.495403 |     b"KeyError: 'allocations'"

  http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22KeyError%5C%22%20AND%20message%3A%5C%22allocations%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20project%3A%5C%22openstack%2Fnova%5C%22&from=7d

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1696834/+subscriptions