yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem.os@xxxxxxxxx>]

** Changed in: python-novaclient
       Status: In Progress => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1700364

Title:
  Functional tests are failing with over-quota errors on number of
  instances

Status in devstack:
  Fix Released
Status in heat:
  Invalid
Status in OpenStack Compute (nova):
  Invalid
Status in python-novaclient:
  Invalid

Bug description:
  Seen here:

  http://logs.openstack.org/41/435141/19/gate/gate-novaclient-dsvm-
  functional-neutron-ubuntu-
  xenial/894e11f/console.html#_2017-06-24_07_43_15_452547

  This isn't specific to that test:

  2017-06-24 07:43:15.452547 | 2017-06-24 07:43:15.452 |     novaclient.exceptions.Forbidden: Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) (Request-ID: req-462a3601-792a-4184-941b-efcf6dc08cf4)
  2017-06-24 07:43:15.453606 | 2017-06-24 07:43:15.453 |     
  2017-06-24 07:43:17.028370 | 2017-06-24 07:43:17.028 | {0} novaclient.tests.functional.v2.legacy.test_usage.TestUsageCLI.test_usage [1.605477s] ... FAILED
  2017-06-24 07:43:17.030172 | 2017-06-24 07:43:17.029 | 
  2017-06-24 07:43:17.031396 | 2017-06-24 07:43:17.031 | Captured traceback:
  2017-06-24 07:43:17.034342 | 2017-06-24 07:43:17.033 | ~~~~~~~~~~~~~~~~~~~
  2017-06-24 07:43:17.035573 | 2017-06-24 07:43:17.035 |     Traceback (most recent call last):
  2017-06-24 07:43:17.037772 | 2017-06-24 07:43:17.036 |       File "novaclient/tests/functional/v2/legacy/test_usage.py", line 37, in test_usage
  2017-06-24 07:43:17.039170 | 2017-06-24 07:43:17.038 |         self._create_server('some-server')
  2017-06-24 07:43:17.040454 | 2017-06-24 07:43:17.040 |       File "novaclient/tests/functional/base.py", line 479, in _create_server
  2017-06-24 07:43:17.042225 | 2017-06-24 07:43:17.041 |         nics=nics, **kwargs)
  2017-06-24 07:43:17.043590 | 2017-06-24 07:43:17.043 |       File "novaclient/v2/servers.py", line 1437, in create
  2017-06-24 07:43:17.045230 | 2017-06-24 07:43:17.044 |         **boot_kwargs)
  2017-06-24 07:43:17.046705 | 2017-06-24 07:43:17.046 |       File "novaclient/v2/servers.py", line 790, in _boot
  2017-06-24 07:43:17.047980 | 2017-06-24 07:43:17.047 |         return_raw=return_raw, **kwargs)
  2017-06-24 07:43:17.049216 | 2017-06-24 07:43:17.048 |       File "novaclient/base.py", line 361, in _create
  2017-06-24 07:43:17.050501 | 2017-06-24 07:43:17.050 |         resp, body = self.api.client.post(url, body=body)
  2017-06-24 07:43:17.051751 | 2017-06-24 07:43:17.051 |       File "/opt/stack/new/python-novaclient/.tox/functional/local/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 240, in post
  2017-06-24 07:43:17.054131 | 2017-06-24 07:43:17.052 |         return self.request(url, 'POST', **kwargs)
  2017-06-24 07:43:17.055475 | 2017-06-24 07:43:17.055 |       File "novaclient/client.py", line 83, in request
  2017-06-24 07:43:17.056805 | 2017-06-24 07:43:17.056 |         raise exceptions.from_response(resp, body, url, method)
  2017-06-24 07:43:17.058478 | 2017-06-24 07:43:17.058 |     novaclient.exceptions.Forbidden: Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) (Request-ID: req-058b10ff-96ab-4204-965b-2fcf8b2759ca)

  Something isn't cleaning up properly which is making the tests go over
  quota since they are single-tenant.

  http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22novaclient.exceptions.Forbidden%3A%20Quota%20exceeded%20for%20instances%3A%20Requested%201%2C%20but%20already%20used%2010%20of%2010%20instances%20(HTTP%20403)%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d

  It looks like something merged around 6/24 that tipped this over.

To manage notifications about this bug go to:
https://bugs.launchpad.net/devstack/+bug/1700364/+subscriptions