yahoo-eng-team team mailing list archive

[Favyen Bastani <fbastani@xxxxxxxxxxxxx>]

Public bug reported:

Version: 1:2015.1.0-0ubuntu1~cloud0 (Kilo)

I am having issues with backing images of disk.swap being deleted from
the image cache.

Here is part of the nova-compute log, although multiple instances have
disk.swap with swap_256 as the base image, the image cache repeatedly
tries to delete it:

2015-05-14 08:08:15.080 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
2015-05-14 08:48:46.209 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
2015-05-14 09:29:00.814 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
2015-05-14 10:09:14.351 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Removing base or swap file: /var/lib/nova/instances/_base/swap_256
2015-05-14 16:14:21.340 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
2015-05-14 16:55:21.195 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
2015-05-14 17:36:12.260 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256

I am NOT using shared storage for the instances directory, it is sitting
on the local filesystem, and instances on the same host node are using
the swap base file that the image cache is deleting.

As far as I can tell, it is attempting to delete it immediately after
the swap image is created. Swap backing images of the form swap_512_512
are not deleted though (as opposed to just swap_512; I couldn't figure
out what the difference is).

Reproduce: Create volume with swap disk
Temporary solution: image_cache_manager_interval = -1

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1457527

Title:
  Image-cache deleting active swap backing images

Status in OpenStack Compute (Nova):
  New

Bug description:
  Version: 1:2015.1.0-0ubuntu1~cloud0 (Kilo)

  I am having issues with backing images of disk.swap being deleted from
  the image cache.

  Here is part of the nova-compute log, although multiple instances have
  disk.swap with swap_256 as the base image, the image cache repeatedly
  tries to delete it:

  2015-05-14 08:08:15.080 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
  2015-05-14 08:48:46.209 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
  2015-05-14 09:29:00.814 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
  2015-05-14 10:09:14.351 4319 INFO nova.virt.libvirt.imagecache [req-967c82af-329e-42ff-aade-f4af2b4ba732 - - - - -] Removing base or swap file: /var/lib/nova/instances/_base/swap_256
  2015-05-14 16:14:21.340 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
  2015-05-14 16:55:21.195 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256
  2015-05-14 17:36:12.260 6479 INFO nova.virt.libvirt.imagecache [req-1d61428f-0b8b-4bae-9293-42ac99dc3f58 - - - - -] Base or swap file too young to remove: /var/lib/nova/instances/_base/swap_256

  I am NOT using shared storage for the instances directory, it is
  sitting on the local filesystem, and instances on the same host node
  are using the swap base file that the image cache is deleting.

  As far as I can tell, it is attempting to delete it immediately after
  the swap image is created. Swap backing images of the form
  swap_512_512 are not deleted though (as opposed to just swap_512; I
  couldn't figure out what the difference is).

  Reproduce: Create volume with swap disk
  Temporary solution: image_cache_manager_interval = -1

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1457527/+subscriptions