yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1670464] [NEW] Downloading image with --progress fails with "RequestIdProxy object is not an iterator"

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Ben Nemec <openstack@xxxxxxxxxxxx>
Date: Mon, 06 Mar 2017 18:39:54 -0000
Reply-to: Bug 1670464 <1670464@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I'm seeing this on a recent devstack.  Without --progress it seems to
work fine.

[bnemec@Arisu ~]$ glance -d image-download 2974158b-383d-4fe6-9671-5248b9a5d07d --file bmc-base.qcow2 --progress
DEBUG:keystoneauth.session:REQ: curl -g -i -X GET http://11.1.1.78:5000/v3 -H "Accept: application/json" -H "User-Agent: glance keystoneauth1/2.18.0 python-requests/2.12.5 CPython/2.7.13"
DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:5000 "GET /v3 HTTP/1.1" 200 252
DEBUG:keystoneauth.session:RESP: [200] Date: Mon, 06 Mar 2017 18:37:02 GMT Server: Apache/2.4.25 (Fedora) OpenSSL/1.0.2k-fips mod_wsgi/4.4.23 Python/2.7.13 Content-Length: 252 Vary: X-Auth-Token x-openstack-request-id: req-1fdae4f6-857c-4032-a4fb-1ecd08d1e90d Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: application/json 
RESP BODY: {"version": {"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://11.1.1.78/identity/v3/";, "rel": "self"}]}}

DEBUG:keystoneauth.session:GET call to None for http://11.1.1.78:5000/v3 used request id req-1fdae4f6-857c-4032-a4fb-1ecd08d1e90d
DEBUG:keystoneauth.identity.v3.base:Making authentication request to http://11.1.1.78/identity/v3/auth/tokens
DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:80 "POST /identity/v3/auth/tokens HTTP/1.1" 201 3438
DEBUG:keystoneauth.identity.v3.base:{"token": {"is_domain": false, "methods": ["password"], "roles": [{"id": "fcd99b843dfb4deca4f0fd5096360c22", "name": "admin"}], "expires_at": "2017-06-30T12:23:41.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "45c03ec02978498db7a12de812cc4b18", "name": "admin"}, "catalog": [{"endpoints": [{"url": "http://11.1.1.78:8774/v2/45c03ec02978498db7a12de812cc4b18";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "5c473dd798dd4206b529cfce030bfef2"}], "type": "compute_legacy", "id": "18a8bab02dd74eebb1b6308b15bf461a", "name": "nova_legacy"}, {"endpoints": [{"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "631a5450741443d4a94128aaa159b5e9"}, {"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "a83e3e461d0e442fa8e2464f06dd535f"}, {"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "d3a005ac8848461896d85ea0ed8323a6"}], "type": "orchestration", "id": "207ce855fbe7474db0a2b7d5fc0e9c9f", "name": "heat"}, {"endpoints": [{"url": "http://11.1.1.78:8000/v1";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "0c2a56c5c6c648ada5698536e1d6b850"}, {"url": "http://11.1.1.78:8000/v1";, "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "12e59772754e41149f3be25805ea11c9"}, {"url": "http://11.1.1.78:8000/v1";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "939d5746405c4571ace5cfc5d1fe5bdc"}], "type": "cloudformation", "id": "34ccb229f8e14a05bfe668094c927126", "name": "heat-cfn"}, {"endpoints": [{"url": "http://11.1.1.78/identity_admin";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "d924181ce443443aa425bb740249f09a"}, {"url": "http://11.1.1.78/identity";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "e38adbef3cb14649b775646d5f383942"}], "type": "identity", "id": "54ab5a716ae0465286a6da5ff78c5b0b", "name": "keystone"}, {"endpoints": [{"url": "http://11.1.1.78:8774/v2.1";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "5b12864e38ec4d8b88955e50e9ff9839"}], "type": "compute", "id": "78e758f7be8d44529a56e05a53a1355c", "name": "nova"}, {"endpoints": [{"url": "http://11.1.1.78/placement";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "eeea1c9001bd40a88042017221e81c1a"}], "type": "placement", "id": "b68c8f2103124c44988fb683a634ec94", "name": "placement"}, {"endpoints": [{"url": "http://11.1.1.78:9696/";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "554bfbe2bcde4410a14af8dd56261d81"}], "type": "network", "id": "c020483856ac4c5e9987200801ed1d65", "name": "neutron"}, {"endpoints": [{"url": "http://11.1.1.78:9292";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "3340c37648b44d8dab69adbfd4e13175"}], "type": "image", "id": "f6029bbf9c9148629406c5937e97532e", "name": "glance"}], "user": {"domain": {"id": "default", "name": "Default"}, "password_expires_at": null, "name": "admin", "id": "b974ee3cbb4445d0b31cbd98f68b421e"}, "audit_ids": ["-EQdN3aLTQGxw4Je9mhuVg"], "issued_at": "2017-03-06T18:37:02.000000Z"}}
DEBUG:keystoneauth.session:REQ: curl -g -i -X GET http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file -H "User-Agent: python-glanceclient" -H "Content-Type: application/octet-stream" -H "X-Auth-Token: {SHA1}4d61ebf97f393f48895ff7fd353adf9f45cf36da"
DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:9292 "GET /v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file HTTP/1.1" 200 1437204480
DEBUG:keystoneauth.session:RESP: [200] Content-Type: application/octet-stream Content-Md5: d712d9babb497b8c1644e51053f088d1 Content-Length: 1437204480 X-Openstack-Request-Id: req-e4f34ec6-e735-4573-bb96-13bce4214ede Date: Mon, 06 Mar 2017 18:37:03 GMT Connection: keep-alive 
RESP BODY: Omitted, Content-Type is set to application/octet-stream. Only application/json responses have their bodies logged.

DEBUG:keystoneauth.session:GET call to image for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
GET call to glance-api for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
DEBUG:glanceclient.common.http:GET call to glance-api for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/glanceclient/shell.py", line 706, in main
    OpenStackImagesShell().main(argv)
  File "/usr/lib/python2.7/site-packages/glanceclient/shell.py", line 610, in main
    args.func(client, args)
  File "/usr/lib/python2.7/site-packages/glanceclient/v2/shell.py", line 294, in do_image_download
    utils.save_image(body, args.file)
  File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 286, in save_image
    for chunk in data:
  File "/usr/lib/python2.7/site-packages/glanceclient/common/progressbar.py", line 86, in next
    data = six.next(self._wrapped)
TypeError: RequestIdProxy object is not an iterator
RequestIdProxy object is not an iterator

** Affects: glance
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1670464

Title:
  Downloading image with --progress fails with "RequestIdProxy object is
  not an iterator"

Status in Glance:
  New

Bug description:
  I'm seeing this on a recent devstack.  Without --progress it seems to
  work fine.

  [bnemec@Arisu ~]$ glance -d image-download 2974158b-383d-4fe6-9671-5248b9a5d07d --file bmc-base.qcow2 --progress
  DEBUG:keystoneauth.session:REQ: curl -g -i -X GET http://11.1.1.78:5000/v3 -H "Accept: application/json" -H "User-Agent: glance keystoneauth1/2.18.0 python-requests/2.12.5 CPython/2.7.13"
  DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
  DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:5000 "GET /v3 HTTP/1.1" 200 252
  DEBUG:keystoneauth.session:RESP: [200] Date: Mon, 06 Mar 2017 18:37:02 GMT Server: Apache/2.4.25 (Fedora) OpenSSL/1.0.2k-fips mod_wsgi/4.4.23 Python/2.7.13 Content-Length: 252 Vary: X-Auth-Token x-openstack-request-id: req-1fdae4f6-857c-4032-a4fb-1ecd08d1e90d Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: application/json 
  RESP BODY: {"version": {"status": "stable", "updated": "2017-02-22T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.8", "links": [{"href": "http://11.1.1.78/identity/v3/";, "rel": "self"}]}}

  DEBUG:keystoneauth.session:GET call to None for http://11.1.1.78:5000/v3 used request id req-1fdae4f6-857c-4032-a4fb-1ecd08d1e90d
  DEBUG:keystoneauth.identity.v3.base:Making authentication request to http://11.1.1.78/identity/v3/auth/tokens
  DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
  DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:80 "POST /identity/v3/auth/tokens HTTP/1.1" 201 3438
  DEBUG:keystoneauth.identity.v3.base:{"token": {"is_domain": false, "methods": ["password"], "roles": [{"id": "fcd99b843dfb4deca4f0fd5096360c22", "name": "admin"}], "expires_at": "2017-06-30T12:23:41.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "45c03ec02978498db7a12de812cc4b18", "name": "admin"}, "catalog": [{"endpoints": [{"url": "http://11.1.1.78:8774/v2/45c03ec02978498db7a12de812cc4b18";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "5c473dd798dd4206b529cfce030bfef2"}], "type": "compute_legacy", "id": "18a8bab02dd74eebb1b6308b15bf461a", "name": "nova_legacy"}, {"endpoints": [{"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "631a5450741443d4a94128aaa159b5e9"}, {"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "a83e3e461d0e442fa8e2464f06dd535f"}, {"url": "http://11.1.1.78:8004/v1/45c03ec02978498db7a12de812cc4b18";, "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "d3a005ac8848461896d85ea0ed8323a6"}], "type": "orchestration", "id": "207ce855fbe7474db0a2b7d5fc0e9c9f", "name": "heat"}, {"endpoints": [{"url": "http://11.1.1.78:8000/v1";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "0c2a56c5c6c648ada5698536e1d6b850"}, {"url": "http://11.1.1.78:8000/v1";, "interface": "internal", "region": "RegionOne", "region_id": "RegionOne", "id": "12e59772754e41149f3be25805ea11c9"}, {"url": "http://11.1.1.78:8000/v1";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "939d5746405c4571ace5cfc5d1fe5bdc"}], "type": "cloudformation", "id": "34ccb229f8e14a05bfe668094c927126", "name": "heat-cfn"}, {"endpoints": [{"url": "http://11.1.1.78/identity_admin";, "interface": "admin", "region": "RegionOne", "region_id": "RegionOne", "id": "d924181ce443443aa425bb740249f09a"}, {"url": "http://11.1.1.78/identity";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "e38adbef3cb14649b775646d5f383942"}], "type": "identity", "id": "54ab5a716ae0465286a6da5ff78c5b0b", "name": "keystone"}, {"endpoints": [{"url": "http://11.1.1.78:8774/v2.1";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "5b12864e38ec4d8b88955e50e9ff9839"}], "type": "compute", "id": "78e758f7be8d44529a56e05a53a1355c", "name": "nova"}, {"endpoints": [{"url": "http://11.1.1.78/placement";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "eeea1c9001bd40a88042017221e81c1a"}], "type": "placement", "id": "b68c8f2103124c44988fb683a634ec94", "name": "placement"}, {"endpoints": [{"url": "http://11.1.1.78:9696/";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "554bfbe2bcde4410a14af8dd56261d81"}], "type": "network", "id": "c020483856ac4c5e9987200801ed1d65", "name": "neutron"}, {"endpoints": [{"url": "http://11.1.1.78:9292";, "interface": "public", "region": "RegionOne", "region_id": "RegionOne", "id": "3340c37648b44d8dab69adbfd4e13175"}], "type": "image", "id": "f6029bbf9c9148629406c5937e97532e", "name": "glance"}], "user": {"domain": {"id": "default", "name": "Default"}, "password_expires_at": null, "name": "admin", "id": "b974ee3cbb4445d0b31cbd98f68b421e"}, "audit_ids": ["-EQdN3aLTQGxw4Je9mhuVg"], "issued_at": "2017-03-06T18:37:02.000000Z"}}
  DEBUG:keystoneauth.session:REQ: curl -g -i -X GET http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file -H "User-Agent: python-glanceclient" -H "Content-Type: application/octet-stream" -H "X-Auth-Token: {SHA1}4d61ebf97f393f48895ff7fd353adf9f45cf36da"
  DEBUG:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 11.1.1.78
  DEBUG:requests.packages.urllib3.connectionpool:http://11.1.1.78:9292 "GET /v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file HTTP/1.1" 200 1437204480
  DEBUG:keystoneauth.session:RESP: [200] Content-Type: application/octet-stream Content-Md5: d712d9babb497b8c1644e51053f088d1 Content-Length: 1437204480 X-Openstack-Request-Id: req-e4f34ec6-e735-4573-bb96-13bce4214ede Date: Mon, 06 Mar 2017 18:37:03 GMT Connection: keep-alive 
  RESP BODY: Omitted, Content-Type is set to application/octet-stream. Only application/json responses have their bodies logged.

  DEBUG:keystoneauth.session:GET call to image for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
  GET call to glance-api for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
  DEBUG:glanceclient.common.http:GET call to glance-api for http://11.1.1.78:9292/v2/images/2974158b-383d-4fe6-9671-5248b9a5d07d/file used request id req-e4f34ec6-e735-4573-bb96-13bce4214ede
  Traceback (most recent call last):
    File "/usr/lib/python2.7/site-packages/glanceclient/shell.py", line 706, in main
      OpenStackImagesShell().main(argv)
    File "/usr/lib/python2.7/site-packages/glanceclient/shell.py", line 610, in main
      args.func(client, args)
    File "/usr/lib/python2.7/site-packages/glanceclient/v2/shell.py", line 294, in do_image_download
      utils.save_image(body, args.file)
    File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 286, in save_image
      for chunk in data:
    File "/usr/lib/python2.7/site-packages/glanceclient/common/progressbar.py", line 86, in next
      data = six.next(self._wrapped)
  TypeError: RequestIdProxy object is not an iterator
  RequestIdProxy object is not an iterator

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1670464/+subscriptions
Follow ups

[Bug 1670464] Re: Downloading image with --progress fails with "RequestIdProxy object is not an iterator"
From: Abhishek Kekane, 2018-02-20