yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1544888] [NEW] cinder quota not available in a non-default domain

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Renee Undrits <renee.undrits@xxxxxxxxx>
Date: Fri, 12 Feb 2016 09:38:52 -0000
Reply-to: Bug 1544888 <1544888@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I am running a multi-domain environment and am unable to access cinder quota information in Horizon from a non-default domain.
My default domain is with the SQL back end and the other one with an LDAP back end.

The effects include not being able to launch instances and not being
able to modify quota information.

The error I get performing related actions is this:
https://github.com/openstack/horizon/blob/master/openstack_dashboard/usage/quotas.py#L152

And for example the code failing when launching an instance is this:
https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/project/instances/workflows/create_instance.py#L225

I tried to remove unnecessary information from logs (Time, request id-s,
sensitive information).

>From horizon logs(apache2 error log):
 [:error]  Internal Server Error: /horizon/project/instances/launch
 [:error]  Traceback (most recent call last):
 [:error]    File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 111, in get_response
 [:error]      response = wrapped_callback(request, *callback_args, **callback_kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 36, in dec
 [:error]      return view_func(request, *args, **kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 52, in dec
 [:error]      return view_func(request, *args, **kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 36, in dec
 [:error]      return view_func(request, *args, **kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 84, in dec
 [:error]      return view_func(request, *args, **kwargs)
 [:error]    File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 69, in view
 [:error]      return self.dispatch(request, *args, **kwargs)
 [:error]    File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 87, in dispatch
 [:error]      return handler(request, *args, **kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 167, in post
 [:error]      context = self.get_context_data(**kwargs)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 91, in get_context_data
 [:error]      workflow = self.get_workflow()
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 81, in get_workflow
 [:error]      entry_point=entry_point)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/base.py", line 651, in __init__
 [:error]      valid = step.action.is_valid()0
 [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 162, in is_valid
 [:error]      return self.is_bound and not bool(self.errors)
 [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 154, in errors
 [:error]      self.full_clean()
 [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 354, in full_clean
 [:error]      self._clean_form()
 [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 378, in _clean_form
 [:error]      cleaned_data = self.clean()
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/dashboards/project/instances/workflows/create_instance.py", line 367, in clean
 [:error]      self._check_quotas(cleaned_data)
 [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/dashboards/project/instances/workflows/create_instance.py", line 224, in _check_quotas
 [:error]      available_volume = usages['volumes']['available']
 [:error]  KeyError: 'available'


And a related bug seems to be a call to cinder api:

INFO cinder.api.openstack.wsgi     GET http://openstack:8776/v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False
ERROR cinder.api.middleware.fault  Caught error: Non-default domain is not supported (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-4d088b3f-abb6-4475-b72c-f915f6c6413b) (HTTP 401)
INFO cinder.api.middleware.fault   http://openstack:8776/v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False returned with HTTP 500
INFO eventlet.wsgi.server          10.10.10.93 - - [10/Feb/2016 17:47:15] "GET /v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False HTTP/1.1" 500 425 0.102689

Where the project id is febe06c4fb8e4b4ea5cbd86f3827ced1. 
But since the Service project id is 7442f0f3f5bd452a8d6a59a2eb277577 the call should be to http://openstack:8776/v2/7442f0f3f5bd452a8d6a59a2eb277577/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False

The service project is in the default domain and the user project is in
the LDAP backed domain.

Also from keystone log this line can be found:
WARNING keystone.common.wsgi  Authorization failed. Non-default domain is not supported (Disable debug mode to suppress these details.) (Disable debug mode to suppress these details.) from 10.10.10.93

For now I have made a bypass when launching an instance, asking for quota information with the code found in the volume tab:
Instead of 
            available_volume = usages['volumes']['available']

I'm using
            usages = quotas.tenant_limit_usages(self.request)
            available_volume = usages['maxTotalVolumes'] - usages['volumesUsed']
            usages = quotas.tenant_quota_usages(self.request)
Which seems to work fine.

** Affects: cinder
     Importance: Undecided
         Status: New

** Affects: horizon
     Importance: Undecided
         Status: New


** Tags: cinder horizon multi-domain

** Also affects: cinder
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1544888

Title:
  cinder quota not available in a non-default domain

Status in Cinder:
  New
Status in OpenStack Dashboard (Horizon):
  New

Bug description:
  I am running a multi-domain environment and am unable to access cinder quota information in Horizon from a non-default domain.
  My default domain is with the SQL back end and the other one with an LDAP back end.

  The effects include not being able to launch instances and not being
  able to modify quota information.

  The error I get performing related actions is this:
  https://github.com/openstack/horizon/blob/master/openstack_dashboard/usage/quotas.py#L152

  And for example the code failing when launching an instance is this:
  https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/project/instances/workflows/create_instance.py#L225

  I tried to remove unnecessary information from logs (Time, request
  id-s, sensitive information).

  From horizon logs(apache2 error log):
   [:error]  Internal Server Error: /horizon/project/instances/launch
   [:error]  Traceback (most recent call last):
   [:error]    File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 111, in get_response
   [:error]      response = wrapped_callback(request, *callback_args, **callback_kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 36, in dec
   [:error]      return view_func(request, *args, **kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 52, in dec
   [:error]      return view_func(request, *args, **kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 36, in dec
   [:error]      return view_func(request, *args, **kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/decorators.py", line 84, in dec
   [:error]      return view_func(request, *args, **kwargs)
   [:error]    File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 69, in view
   [:error]      return self.dispatch(request, *args, **kwargs)
   [:error]    File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 87, in dispatch
   [:error]      return handler(request, *args, **kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 167, in post
   [:error]      context = self.get_context_data(**kwargs)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 91, in get_context_data
   [:error]      workflow = self.get_workflow()
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/views.py", line 81, in get_workflow
   [:error]      entry_point=entry_point)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../horizon/workflows/base.py", line 651, in __init__
   [:error]      valid = step.action.is_valid()0
   [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 162, in is_valid
   [:error]      return self.is_bound and not bool(self.errors)
   [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 154, in errors
   [:error]      self.full_clean()
   [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 354, in full_clean
   [:error]      self._clean_form()
   [:error]    File "/usr/lib/python2.7/dist-packages/django/forms/forms.py", line 378, in _clean_form
   [:error]      cleaned_data = self.clean()
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/dashboards/project/instances/workflows/create_instance.py", line 367, in clean
   [:error]      self._check_quotas(cleaned_data)
   [:error]    File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/dashboards/project/instances/workflows/create_instance.py", line 224, in _check_quotas
   [:error]      available_volume = usages['volumes']['available']
   [:error]  KeyError: 'available'

  
  And a related bug seems to be a call to cinder api:

  INFO cinder.api.openstack.wsgi     GET http://openstack:8776/v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False
  ERROR cinder.api.middleware.fault  Caught error: Non-default domain is not supported (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-4d088b3f-abb6-4475-b72c-f915f6c6413b) (HTTP 401)
  INFO cinder.api.middleware.fault   http://openstack:8776/v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False returned with HTTP 500
  INFO eventlet.wsgi.server          10.10.10.93 - - [10/Feb/2016 17:47:15] "GET /v2/febe06c4fb8e4b4ea5cbd86f3827ced1/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False HTTP/1.1" 500 425 0.102689

  Where the project id is febe06c4fb8e4b4ea5cbd86f3827ced1. 
  But since the Service project id is 7442f0f3f5bd452a8d6a59a2eb277577 the call should be to http://openstack:8776/v2/7442f0f3f5bd452a8d6a59a2eb277577/os-quota-sets/febe06c4fb8e4b4ea5cbd86f3827ced1?usage=False

  The service project is in the default domain and the user project is
  in the LDAP backed domain.

  Also from keystone log this line can be found:
  WARNING keystone.common.wsgi  Authorization failed. Non-default domain is not supported (Disable debug mode to suppress these details.) (Disable debug mode to suppress these details.) from 10.10.10.93

  For now I have made a bypass when launching an instance, asking for quota information with the code found in the volume tab:
  Instead of 
              available_volume = usages['volumes']['available']

  I'm using
              usages = quotas.tenant_limit_usages(self.request)
              available_volume = usages['maxTotalVolumes'] - usages['volumesUsed']
              usages = quotas.tenant_quota_usages(self.request)
  Which seems to work fine.

To manage notifications about this bug go to:
https://bugs.launchpad.net/cinder/+bug/1544888/+subscriptions
Follow ups

[Bug 1544888] Re: cinder quota not available in a non-default domain
From: Gary W. Smith, 2017-10-19