← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #10083

[Bug 1282858] [NEW] InstanceInfoCacheNotFound while cleanup running deleted instances

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

reproduce steps:
1. create an instance
2. stop nova-compute and wait for it becomes to XXX in `nova-manage service list `
3. delete the instance
and you should change these two config in nova.conf:
running_deleted_instance_poll_interval=60
running_deleted_instance_action = reap

2014-02-21 10:57:14.915 DEBUG nova.network.api [req-60f769f1-0a53-4f0b-817f-a04dee2ab1af None None] Updating cache with info: [] from (pid=13440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/api.py:70
2014-02-21 10:57:14.920 ERROR nova.network.api [req-60f769f1-0a53-4f0b-817f-a04dee2ab1af None None] [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Failed storing info cache
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Traceback (most recent call last):
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/network/api.py", line 81, in update_instance_cache_with_nw_info
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     ic.save(update_cells=update_cells)
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/objects/base.py", line 151, in wrapper
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return fn(self, ctxt, *args, **kwargs)
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/objects/instance_info_cache.py", line 91, in save
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     {'network_info': nw_info_json})
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/api.py", line 864, in instance_info_cache_update
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return IMPL.instance_info_cache_update(context, instance_uuid, values)
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 128, in wrapper
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return f(*args, **kwargs)
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 2308, in instance_info_cache_update
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     instance_uuid=instance_uuid)
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] InstanceInfoCacheNotFound: Info cache for instance d150ab27-3a6a-4003-ac42-51a7c56ece66 could not be found.
2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] 
2014-02-21 10:57:16.724 INFO nova.virt.libvirt.driver [-] [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Instance destroyed successfully.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1282858

Title:
  InstanceInfoCacheNotFound while cleanup running deleted instances

Status in OpenStack Compute (Nova):
  New

Bug description:
  reproduce steps:
  1. create an instance
  2. stop nova-compute and wait for it becomes to XXX in `nova-manage service list `
  3. delete the instance
  and you should change these two config in nova.conf:
  running_deleted_instance_poll_interval=60
  running_deleted_instance_action = reap

  2014-02-21 10:57:14.915 DEBUG nova.network.api [req-60f769f1-0a53-4f0b-817f-a04dee2ab1af None None] Updating cache with info: [] from (pid=13440) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/api.py:70
  2014-02-21 10:57:14.920 ERROR nova.network.api [req-60f769f1-0a53-4f0b-817f-a04dee2ab1af None None] [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Failed storing info cache
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Traceback (most recent call last):
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/network/api.py", line 81, in update_instance_cache_with_nw_info
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     ic.save(update_cells=update_cells)
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/objects/base.py", line 151, in wrapper
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return fn(self, ctxt, *args, **kwargs)
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/objects/instance_info_cache.py", line 91, in save
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     {'network_info': nw_info_json})
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/api.py", line 864, in instance_info_cache_update
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return IMPL.instance_info_cache_update(context, instance_uuid, values)
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 128, in wrapper
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     return f(*args, **kwargs)
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]   File "/opt/stack/nova/nova/db/sqlalchemy/api.py", line 2308, in instance_info_cache_update
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66]     instance_uuid=instance_uuid)
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] InstanceInfoCacheNotFound: Info cache for instance d150ab27-3a6a-4003-ac42-51a7c56ece66 could not be found.
  2014-02-21 10:57:14.920 TRACE nova.network.api [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] 
  2014-02-21 10:57:16.724 INFO nova.virt.libvirt.driver [-] [instance: d150ab27-3a6a-4003-ac42-51a7c56ece66] Instance destroyed successfully.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1282858/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next