yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1832380] [NEW] Unable to list instances in horizon if instance launched from image which has switched from public to private

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Sean Murphy <murp@xxxxxxx>
Date: Tue, 11 Jun 2019 16:38:50 -0000
Reply-to: Bug 1832380 <1832380@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

We have an operational cluster in which we provide a set of images to
users; we update these images every few months (security patches etc).

We upgraded from Rocky to Stein and we are now unable to list any
instances in horizon in the case that one instance in the project has
been launched from an image which was once public but has been
subsequently switched to private (older Operating Systems basically).

When we make the image public, we can again list the instances.

Horizon version: kolla/ubuntu-source-horizon:stein

See logs below - the key is the id of the image that has been switched
from public to private.


[Tue Jun 11 18:08:52.920855 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] Internal Server Error: /project/instances/
[Tue Jun 11 18:08:52.921010 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] Traceback (most recent call last):
[Tue Jun 11 18:08:52.921026 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner
[Tue Jun 11 18:08:52.921036 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = get_response(request)
[Tue Jun 11 18:08:52.921044 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response
[Tue Jun 11 18:08:52.921054 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = self.process_exception_by_middleware(e, request)
[Tue Jun 11 18:08:52.921062 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response
[Tue Jun 11 18:08:52.921090 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = wrapped_callback(request, *callback_args, **callback_kwargs)
[Tue Jun 11 18:08:52.921100 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec
[Tue Jun 11 18:08:52.921108 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921116 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec
[Tue Jun 11 18:08:52.921124 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921132 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec
[Tue Jun 11 18:08:52.921139 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921147 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec
[Tue Jun 11 18:08:52.921155 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921162 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec
[Tue Jun 11 18:08:52.921170 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921178 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view
[Tue Jun 11 18:08:52.921188 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return self.dispatch(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921197 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch
[Tue Jun 11 18:08:52.921205 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return handler(request, *args, **kwargs)
[Tue Jun 11 18:08:52.921213 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 223, in get
[Tue Jun 11 18:08:52.921220 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     handled = self.construct_tables()
[Tue Jun 11 18:08:52.921228 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 214, in construct_tables
[Tue Jun 11 18:08:52.921236 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     handled = self.handle_table(table)
[Tue Jun 11 18:08:52.921244 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 123, in handle_table
[Tue Jun 11 18:08:52.921253 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     data = self._get_data_dict()
[Tue Jun 11 18:08:52.921262 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 252, in _get_data_dict
[Tue Jun 11 18:08:52.921271 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     self._data = {self.table_class._meta.name: self.get_data()}
[Tue Jun 11 18:08:52.921290 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/openstack_dashboard/dashboards/project/instances/views.py", line 187, in get_data
[Tue Jun 11 18:08:52.921299 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     boot_volume.volume_image_metadata['image_id']
[Tue Jun 11 18:08:52.921306 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] KeyError: u'ec719569-f36f-4f51-a24f-59e1e9a8b4cc'

** Affects: horizon
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1832380

Title:
  Unable to list instances in horizon if instance launched from image
  which has switched from public to private

Status in OpenStack Dashboard (Horizon):
  New

Bug description:
  We have an operational cluster in which we provide a set of images to
  users; we update these images every few months (security patches etc).

  We upgraded from Rocky to Stein and we are now unable to list any
  instances in horizon in the case that one instance in the project has
  been launched from an image which was once public but has been
  subsequently switched to private (older Operating Systems basically).

  When we make the image public, we can again list the instances.

  Horizon version: kolla/ubuntu-source-horizon:stein

  See logs below - the key is the id of the image that has been switched
  from public to private.

  
  [Tue Jun 11 18:08:52.920855 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] Internal Server Error: /project/instances/
  [Tue Jun 11 18:08:52.921010 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] Traceback (most recent call last):
  [Tue Jun 11 18:08:52.921026 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner
  [Tue Jun 11 18:08:52.921036 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = get_response(request)
  [Tue Jun 11 18:08:52.921044 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response
  [Tue Jun 11 18:08:52.921054 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = self.process_exception_by_middleware(e, request)
  [Tue Jun 11 18:08:52.921062 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response
  [Tue Jun 11 18:08:52.921090 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     response = wrapped_callback(request, *callback_args, **callback_kwargs)
  [Tue Jun 11 18:08:52.921100 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec
  [Tue Jun 11 18:08:52.921108 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921116 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec
  [Tue Jun 11 18:08:52.921124 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921132 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec
  [Tue Jun 11 18:08:52.921139 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921147 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec
  [Tue Jun 11 18:08:52.921155 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921162 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec
  [Tue Jun 11 18:08:52.921170 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return view_func(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921178 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view
  [Tue Jun 11 18:08:52.921188 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return self.dispatch(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921197 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch
  [Tue Jun 11 18:08:52.921205 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     return handler(request, *args, **kwargs)
  [Tue Jun 11 18:08:52.921213 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 223, in get
  [Tue Jun 11 18:08:52.921220 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     handled = self.construct_tables()
  [Tue Jun 11 18:08:52.921228 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 214, in construct_tables
  [Tue Jun 11 18:08:52.921236 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     handled = self.handle_table(table)
  [Tue Jun 11 18:08:52.921244 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 123, in handle_table
  [Tue Jun 11 18:08:52.921253 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     data = self._get_data_dict()
  [Tue Jun 11 18:08:52.921262 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/horizon/tables/views.py", line 252, in _get_data_dict
  [Tue Jun 11 18:08:52.921271 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     self._data = {self.table_class._meta.name: self.get_data()}
  [Tue Jun 11 18:08:52.921290 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]   File "/var/lib/kolla/venv/lib/python2.7/site-packages/openstack_dashboard/dashboards/project/instances/views.py", line 187, in get_data
  [Tue Jun 11 18:08:52.921299 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822]     boot_volume.volume_image_metadata['image_id']
  [Tue Jun 11 18:08:52.921306 2019] [wsgi:error] [pid 34:tid 140549440083712] [remote 192.168.20.104:42822] KeyError: u'ec719569-f36f-4f51-a24f-59e1e9a8b4cc'

To manage notifications about this bug go to:
https://bugs.launchpad.net/horizon/+bug/1832380/+subscriptions
Follow ups

[Bug 1832380] Re: Unable to list instances in horizon if instance launched from image which has switched from public to private
From: Launchpad Bug Tracker, 2019-09-01