yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #77610
[Bug 1808063] Re: glanceclient.exc.HTTPBadGateway: 502 Proxy Error during server snapshot - infinite loop in File "/opt/stack/new/glance/glance/quota/__init__.py", line 168 in __getattr__
** Changed in: glance
Status: Confirmed => Fix Released
** No longer affects: openstack-gate
** Changed in: glance
Assignee: (unassigned) => Chris Dent (cdent)
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1808063
Title:
glanceclient.exc.HTTPBadGateway: 502 Proxy Error during server
snapshot - infinite loop in File
"/opt/stack/new/glance/glance/quota/__init__.py", line 168 in
__getattr__
Status in Glance:
Fix Released
Bug description:
Seen here:
http://logs.openstack.org/56/621856/10/check/tempest-full-
py3/85b3f05/controller/logs/screen-n-api.txt.gz#_Dec_11_19_57_35_024101
Dec 11 19:57:35.024101 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi [None req-76b7b44d-b425-46f0-84c9-307f3fcf9795 tempest-ImagesOneServerNegativeTestJSON-1724249280 tempest-ImagesOneServerNegativeTestJSON-1724249280] Unexpected exception in API method: glanceclient.exc.HTTPBadGateway: 502 Proxy Error: Proxy Error: The proxy server received an invalid: response from an upstream server.: The proxy server could not handle the request POST /image/v2/images.: Reason: Error reading from remote server: Apache/2.4.18 (Ubuntu) Server at 10.209.33.36 Port 80 (HTTP 502)
Dec 11 19:57:35.024709 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last):
Dec 11 19:57:35.024947 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 655, in wrapped
Dec 11 19:57:35.025231 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
Dec 11 19:57:35.025994 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper
Dec 11 19:57:35.026254 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
Dec 11 19:57:35.026499 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper
Dec 11 19:57:35.026754 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
Dec 11 19:57:35.027784 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1059, in _action_create_image
Dec 11 19:57:35.028062 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi extra_properties=metadata)
Dec 11 19:57:35.028299 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 213, in _wrapped
Dec 11 19:57:35.028530 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return fn(self, context, instance, *args, **kwargs)
Dec 11 19:57:35.028855 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 153, in inner
Dec 11 19:57:35.029094 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw)
Dec 11 19:57:35.029366 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2959, in snapshot
Dec 11 19:57:35.029754 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi extra_properties=extra_properties)
Dec 11 19:57:35.029995 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3032, in _create_image
Dec 11 19:57:35.030244 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return self.image_api.create(context, image_meta)
Dec 11 19:57:35.030485 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/api.py", line 118, in create
Dec 11 19:57:35.030716 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return session.create(context, image_info, data=data)
Dec 11 19:57:35.030966 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 477, in create
Dec 11 19:57:35.031200 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi _reraise_translated_exception()
Dec 11 19:57:35.031546 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 915, in _reraise_translated_exception
Dec 11 19:57:35.031899 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi six.reraise(type(new_exc), new_exc, exc_trace)
Dec 11 19:57:35.032269 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/six.py", line 693, in reraise
Dec 11 19:57:35.032612 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi raise value
Dec 11 19:57:35.032977 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 475, in create
Dec 11 19:57:35.033337 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi data, force_activate)
Dec 11 19:57:35.033727 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 552, in _create_v2
Dec 11 19:57:35.034080 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi context, 2, 'create', kwargs=sent_service_image_meta)
Dec 11 19:57:35.034424 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 193, in call
Dec 11 19:57:35.034876 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs)
Dec 11 19:57:35.035320 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/glanceclient/common/utils.py", line 598, in inner
Dec 11 19:57:35.035693 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs))
Dec 11 19:57:35.039116 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/glanceclient/v2/images.py", line 361, in create
Dec 11 19:57:35.039411 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.post(url, headers=headers, data=image)
Dec 11 19:57:35.039662 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/keystoneauth1/adapter.py", line 357, in post
Dec 11 19:57:35.039899 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs)
Dec 11 19:57:35.040164 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/glanceclient/common/http.py", line 377, in request
Dec 11 19:57:35.040400 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi return self._handle_response(resp)
Dec 11 19:57:35.040632 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.5/dist-packages/glanceclient/common/http.py", line 126, in _handle_response
Dec 11 19:57:35.040876 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content)
Dec 11 19:57:35.041177 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPBadGateway: 502 Proxy Error: Proxy Error: The proxy server received an invalid: response from an upstream server.: The proxy server could not handle the request POST /image/v2/images.: Reason: Error reading from remote server: Apache/2.4.18 (Ubuntu) Server at 10.209.33.36 Port 80 (HTTP 502)
Dec 11 19:57:35.041412 ubuntu-xenial-rax-dfw-0001132076 devstack@n-api.service[13547]: ERROR nova.api.openstack.wsgi
This bug is for e-r tracking.
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Unexpected%20exception%20in%20API%20method%3A%20glanceclient.exc.HTTPBadGateway%3A%20502%20Proxy%20Error%3A%20Proxy%20Error%3A%20The%20proxy%20server%20received%20an%20invalid%3A%20response%20from%20an%20upstream%20server.%3A%20The%20proxy%20server%20could%20not%20handle%20the%20request%20POST%26nbsp%3B%2Fimage%2Fv2%2Fimages.%3A%20Reason%3A%20Error%20reading%20from%20remote%20server%3A%5C%22%20AND%20tags%3A%5C%22screen-n-api.txt%5C%22&from=7d
To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1808063/+subscriptions