← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1600031] Re: libvirt: KeyError in _get_disk_over_committed_size_total

 

Reviewed:  https://review.openstack.org/340479
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=c1a83a3fb8b7a2ad6bd0d0bafb4a38719cf487ae
Submitter: Jenkins
Branch:    master

commit c1a83a3fb8b7a2ad6bd0d0bafb4a38719cf487ae
Author: Matt Riedemann <mriedem@xxxxxxxxxx>
Date:   Mon Jul 11 17:14:16 2016 +0000

    Revert "Detach volume after deleting instance with no host"
    
    This reverts commit 5ce74fa06c0e7a70fdc927b2c1f364af83f7de1d.
    
    We think this is causing a race and the postgres job to fail
    since it's erroneously doing local deletes and not cleaning
    up from the computes. We're not totally sure why it would
    only impact the postgres job though, but the original change
    failed the job and was rechecked, and the time it was merged
    coincides with when the postgres job started spiking with
    failures.
    
    Related-Bug: #1600005
    Closes-Bug: #1600031
    
    Change-Id: I0ed184b579b8a8d861e4d2a7c317bf0bc0623d50


** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1600031

Title:
  libvirt: KeyError in _get_disk_over_committed_size_total

Status in OpenStack Compute (nova):
  Fix Released

Bug description:
  Seen here:

  http://logs.openstack.org/21/299621/7/gate/gate-tempest-dsvm-postgres-
  full/c182c88/logs/screen-n-cpu.txt.gz#_2016-07-07_21_08_11_773

  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager [req-1bfb9ba6-a2de-417e-9ad7-f72053ff9d96 - -] Error updating resources for node ubuntu-trusty-osic-cloud1-2340260.
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager Traceback (most recent call last):
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager   File "/opt/stack/new/nova/nova/compute/manager.py", line 6338, in update_available_resource_for_node
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager     rt.update_available_resource(context)
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager   File "/opt/stack/new/nova/nova/compute/resource_tracker.py", line 502, in update_available_resource
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager     resources = self.driver.get_available_resource(self.nodename)
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 5349, in get_available_resource
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager     disk_over_committed = self._get_disk_over_committed_size_total()
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 6898, in _get_disk_over_committed_size_total
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager     local_instances[guest.uuid], bdms[guest.uuid])
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager KeyError: '6b454071-c139-490d-96af-df701521330f'
  2016-07-07 21:08:11.773 14821 ERROR nova.compute.manager 

  It's coming from a DeleteServersAdminTestJSON test. There are two
  tests, I'm not sure which it is.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1600031/+subscriptions


References