yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1584747] [NEW] Boot from volume cannot work when IsolatedHostsFilter is configured

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Zhenyu Zheng <zhengzhenyu@xxxxxxxxxx>
Date: Mon, 23 May 2016 12:11:08 -0000
Reply-to: Bug 1584747 <1584747@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

When we configured our environment to use IsolatedHostsFilter, our requests for
launching instances from volume will not able to perform:

2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher [req-b8cc5967-8cd8-4bdc-ab0e-ec7498f1daf2 b25e86ae65d2419fa6f0ce627aa04427 a33219daac154ec889eaeeb95104d517 - - -] Exception during message handling: Cannot load 'id' in the base class
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _dispatch
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 150, in inner
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return func(*args, **kwargs)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/manager.py", line 104, in select_destinations
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     dests = self.driver.select_destinations(ctxt, spec_obj)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 53, in select_destinations
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     selected_hosts = self._schedule(context, spec_obj)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 113, in _schedule
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     spec_obj, index=num)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/host_manager.py", line 534, in get_filtered_hosts
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     hosts, spec_obj, index)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 89, in get_filtered_objects
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     list_objs = list(objs)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 44, in filter_all
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     if self._filter_one(obj, spec_obj):
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/__init__.py", line 26, in _filter_one
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self.host_passes(obj, filter_properties)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/isolated_hosts_filter.py", line 51, in host_passes
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     isolated_hosts = CONF.isolated_hosts
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 67, in getter
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     self.obj_load_attr(name)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 580, in obj_load_attr
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     _("Cannot load '%s' in the base class") % attrname)
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher NotImplementedError: Cannot load 'id' in the base class
2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher 

This is due to the image_id property didn't copied from cinder volume's
image properties to nova.

** Affects: nova
     Importance: Undecided
     Assignee: Zhenyu Zheng (zhengzhenyu)
         Status: New

** Description changed:

- When
+ When we configured our environment to use IsolatedHostsFilter, our requests for
+ launching instances from volume will not able to perform:
+ 
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher [req-b8cc5967-8cd8-4bdc-ab0e-ec7498f1daf2 b25e86ae65d2419fa6f0ce627aa04427 a33219daac154ec889eaeeb95104d517 - - -] Exception during message handling: Cannot load 'id' in the base class
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _dispatch
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 150, in inner
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return func(*args, **kwargs)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/manager.py", line 104, in select_destinations
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     dests = self.driver.select_destinations(ctxt, spec_obj)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 53, in select_destinations
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     selected_hosts = self._schedule(context, spec_obj)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 113, in _schedule
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     spec_obj, index=num)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/host_manager.py", line 534, in get_filtered_hosts
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     hosts, spec_obj, index)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 89, in get_filtered_objects
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     list_objs = list(objs)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 44, in filter_all
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     if self._filter_one(obj, spec_obj):
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/__init__.py", line 26, in _filter_one
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self.host_passes(obj, filter_properties)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/isolated_hosts_filter.py", line 51, in host_passes
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     isolated_hosts = CONF.isolated_hosts
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 67, in getter
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     self.obj_load_attr(name)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 580, in obj_load_attr
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     _("Cannot load '%s' in the base class") % attrname)
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher NotImplementedError: Cannot load 'id' in the base class
+ 2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher 
+ 
+ This is due to the image_id property didn't copied from cinder volume's
+ image properties to nova.

** Changed in: nova
     Assignee: (unassigned) => Zhenyu Zheng (zhengzhenyu)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1584747

Title:
  Boot from volume cannot work when IsolatedHostsFilter is configured

Status in OpenStack Compute (nova):
  New

Bug description:
  When we configured our environment to use IsolatedHostsFilter, our requests for
  launching instances from volume will not able to perform:

  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher [req-b8cc5967-8cd8-4bdc-ab0e-ec7498f1daf2 b25e86ae65d2419fa6f0ce627aa04427 a33219daac154ec889eaeeb95104d517 - - -] Exception during message handling: Cannot load 'id' in the base class
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _dispatch
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 150, in inner
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return func(*args, **kwargs)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/manager.py", line 104, in select_destinations
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     dests = self.driver.select_destinations(ctxt, spec_obj)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 53, in select_destinations
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     selected_hosts = self._schedule(context, spec_obj)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 113, in _schedule
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     spec_obj, index=num)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/host_manager.py", line 534, in get_filtered_hosts
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     hosts, spec_obj, index)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 89, in get_filtered_objects
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     list_objs = list(objs)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/filters.py", line 44, in filter_all
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     if self._filter_one(obj, spec_obj):
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/__init__.py", line 26, in _filter_one
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     return self.host_passes(obj, filter_properties)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/opt/stack/nova/nova/scheduler/filters/isolated_hosts_filter.py", line 51, in host_passes
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     isolated_hosts = CONF.isolated_hosts
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 67, in getter
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     self.obj_load_attr(name)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 580, in obj_load_attr
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher     _("Cannot load '%s' in the base class") % attrname)
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher NotImplementedError: Cannot load 'id' in the base class
  2016-05-23 20:12:17.975 61434 ERROR oslo_messaging.rpc.dispatcher 

  This is due to the image_id property didn't copied from cinder
  volume's image properties to nova.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1584747/+subscriptions
Follow ups

[Bug 1584747] Re: Boot from volume cannot work when IsolatedHostsFilter is configured
From: Matt Riedemann, 2018-04-14