← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 2117122] Re: nova_libvirt start failed because deleting inused nvram: Device or resource busy /etc/libvirt/secrets

 

Thank you for submitting this bug report.

Based on the traceback provided, the `OSError: [Errno 16] Device or
resource busy: '/etc/libvirt/secrets'` originating from
`kolla_set_configs` indicates that **this issue appears to be specific
to the kolla-ansible deployer and its interaction with libvirt and
container management during restarts, rather than a bug within Nova
itself.** The problem occurs when Kolla attempts to manage a file path
(`/etc/libvirt/secrets`) that is held busy by another process, which is
characteristic of a deployment or orchestration issue.

For these reasons, we are marking this bug as **'Invalid'**. If you
still believe this is a Nova bug and you can reproduce it on a supported
OpenStack version, please feel free to update this report with the
necessary details (referencing our bug reporting template:
https://wiki.openstack.org/wiki/Nova/BugsTeam/BugReportTemplate) and set
its status back to 'New'.


** Changed in: nova
       Status: New => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2117122

Title:
  nova_libvirt start failed because deleting inused nvram: Device or
  resource busy /etc/libvirt/secrets

Status in OpenStack Compute (nova):
  Invalid

Bug description:
  I deployed openstack in aarch64 machine, and `/usr/bin/unattended-
  upgrade` trigered containerd restarting then nova_libvirt container
  restarted. but it failed in "Deleting /etc/libvirt/secrets" :

  ```
  + sudo -E kolla_set_configs
  INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
  INFO:__main__:Validating config file
  INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
  INFO:__main__:Deleting /etc/libvirt/libvirtd.conf
  INFO:__main__:Copying /etc/kolla/defaults/etc/libvirt/libvirtd.conf to /etc/libvirt/libvirtd.conf
  INFO:__main__:Copying permissions from /etc/kolla/defaults/etc/libvirt/libvirtd.conf onto /etc/libvirt/libvirtd.conf
  INFO:__main__:Deleting /etc/libvirt/qemu.conf
  INFO:__main__:Copying /etc/kolla/defaults/etc/libvirt/qemu.conf to /etc/libvirt/qemu.conf
  INFO:__main__:Copying permissions from /etc/kolla/defaults/etc/libvirt/qemu.conf onto /etc/libvirt/qemu.conf
  INFO:__main__:Deleting /etc/libvirt/secrets
  ERROR:__main__:Unexpected error:
  Traceback (most recent call last):
    File "/usr/local/bin/kolla_set_configs", line 575, in main
      execute_config_strategy(config)
    File "/usr/local/bin/kolla_set_configs", line 539, in execute_config_strategy
      handle_defaults(config)
    File "/usr/local/bin/kolla_set_configs", line 530, in handle_defaults
      remove_or_restore_configs(state)
    File "/usr/local/bin/kolla_set_configs", line 474, in remove_or_restore_configs
      config_file.copy()
    File "/usr/local/bin/kolla_set_configs", line 153, in copy
      self._delete_path(dest)
    File "/usr/local/bin/kolla_set_configs", line 110, in _delete_path
      shutil.rmtree(path)
    File "/usr/lib/python3.11/shutil.py", line 738, in rmtree
      onerror(os.rmdir, path, sys.exc_info())
    File "/usr/lib/python3.11/shutil.py", line 736, in rmtree
      os.rmdir(path, dir_fd=dir_fd)
  OSError: [Errno 16] Device or resource busy: '/etc/libvirt/secrets'
  ```

  '/etc/libvirt/secrets' in host is
  '/var/lib/docker/volumes/libvirtd/_data', here is lsof result:

  
  ```
  COMMAND       PID     USER   FD   TYPE DEVICE SIZE/OFF    NODE NAME
  qemu-syst 3775877    42436   43u   REG    8,2 67108864 4849771 /var/lib/docker/volumes/libvirtd/_data/qemu/nvram/instance-00003722_VARS.fd
  ```

  my temporary method is trigger `kolla-ansible reconfigure`, everything
  is ok.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/2117122/+subscriptions



References