yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1747511] [NEW] legacy-tempest-dsvm-neutron-nova-next-full fails with "Can not find requested image" since 1/31

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem.os@xxxxxxxxx>
Date: Mon, 05 Feb 2018 20:47:32 -0000
Reply-to: Bug 1747511 <1747511@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-neutron-
nova-next-full/a03511c/job-output.txt.gz#_2018-02-02_12_25_52_609521

2018-02-02 12:25:52.607290 | primary | Captured traceback:
2018-02-02 12:25:52.607333 | primary | ~~~~~~~~~~~~~~~~~~~
2018-02-02 12:25:52.607396 | primary |     Traceback (most recent call last):
2018-02-02 12:25:52.607554 | primary |       File "tempest/api/compute/admin/test_auto_allocate_network.py", line 152, in test_server_create_no_allocate
2018-02-02 12:25:52.607674 | primary |         self.os_primary, networks='none', wait_until='ACTIVE')
2018-02-02 12:25:52.607798 | primary |       File "tempest/common/compute.py", line 191, in create_test_server
2018-02-02 12:25:52.608202 | primary |         **kwargs)
2018-02-02 12:25:52.608351 | primary |       File "tempest/lib/services/compute/servers_client.py", line 89, in create_server
2018-02-02 12:25:52.608465 | primary |         resp, body = self.post('servers', post_body)
2018-02-02 12:25:52.608560 | primary |       File "tempest/lib/common/rest_client.py", line 279, in post
2018-02-02 12:25:52.608671 | primary |         return self.request('POST', url, extra_headers, headers, body, chunked)
2018-02-02 12:25:52.608792 | primary |       File "tempest/lib/services/compute/base_compute_client.py", line 48, in request
2018-02-02 12:25:52.608892 | primary |         method, url, extra_headers, headers, body, chunked)
2018-02-02 12:25:52.609032 | primary |       File "tempest/lib/common/rest_client.py", line 668, in request
2018-02-02 12:25:52.609111 | primary |         self._error_checker(resp, resp_body)
2018-02-02 12:25:52.609225 | primary |       File "tempest/lib/common/rest_client.py", line 779, in _error_checker
2018-02-02 12:25:52.609328 | primary |         raise exceptions.BadRequest(resp_body, resp=resp)
2018-02-02 12:25:52.609420 | primary |     tempest.lib.exceptions.BadRequest: Bad request
2018-02-02 12:25:52.609521 | primary |     Details: {u'code': 400, u'message': u'Can not find requested image'}
2018-02-02 12:25:52.609546 | primary |
2018-02-02 12:25:52.609579 | primary |
2018-02-02 12:25:52.609626 | primary | Captured pythonlogging:
2018-02-02 12:25:52.609674 | primary | ~~~~~~~~~~~~~~~~~~~~~~~
2018-02-02 12:25:52.609952 | primary |     2018-02-02 12:05:26,211 2001 INFO     [tempest.lib.common.rest_client] Request (AutoAllocateNetworkTest:test_server_create_no_allocate): 400 POST http://198.72.124.140/compute/v2.1/servers 0.381s
2018-02-02 12:25:52.610298 | primary |     2018-02-02 12:05:26,212 2001 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json', 'X-OpenStack-Nova-API-Version': '2.37'}
2018-02-02 12:25:52.610880 | primary |             Body: {"server": {"imageRef": "b14816be-0047-4749-964f-be5f5eaef245", "networks": "none", "flavorRef": "42", "name": "tempest-tempest.common.compute-instance-166758257"}}
2018-02-02 12:25:52.611673 | primary |         Response - Headers: {u'connection': 'close', u'content-type': 'application/json; charset=UTF-8', u'server': 'Apache/2.4.18 (Ubuntu)', u'x-compute-request-id': 'req-98f8b35e-a065-4c10-b37f-073d7bde3822', u'openstack-api-version': 'compute 2.37', 'status': '400', 'content-location': 'http://198.72.124.140/compute/v2.1/servers', u'content-length': '72', u'x-openstack-nova-api-version': '2.37', u'x-openstack-request-id': 'req-98f8b35e-a065-4c10-b37f-073d7bde3822', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'date': 'Fri, 02 Feb 2018 12:05:25 GMT'}
2018-02-02 12:25:52.611797 | primary |             Body: {"badRequest": {"message": "Can not find requested image", "code": 400}}

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Can%20not%20find%20requested%20image%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=10d

So it's using b14816be-0047-4749-964f-be5f5eaef245 which is created
here:

http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-neutron-
nova-next-full/a03511c/logs/devstacklog.txt.gz#_2018-02-02_12_01_36_458

2018-02-02 12:01:36.458 | + functions:upload_image:380               :   openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.3.5-x86_64-disk --public --container-format=bare --disk-format qcow2
2018-02-02 12:01:40.203 | +------------------+------------------------------------------------------+
2018-02-02 12:01:40.203 | | Field            | Value                                                |
2018-02-02 12:01:40.203 | +------------------+------------------------------------------------------+
2018-02-02 12:01:40.204 | | checksum         | f8ab98ff5e73ebab884d80c9dc9c7290                     |
2018-02-02 12:01:40.204 | | container_format | bare                                                 |
2018-02-02 12:01:40.204 | | created_at       | 2018-02-02T12:01:39Z                                 |
2018-02-02 12:01:40.204 | | disk_format      | qcow2                                                |
2018-02-02 12:01:40.204 | | file             | /v2/images/b14816be-0047-4749-964f-be5f5eaef245/file |
2018-02-02 12:01:40.204 | | id               | b14816be-0047-4749-964f-be5f5eaef245                 |
2018-02-02 12:01:40.204 | | min_disk         | 0                                                    |
2018-02-02 12:01:40.204 | | min_ram          | 0                                                    |
2018-02-02 12:01:40.204 | | name             | cirros-0.3.5-x86_64-disk                             |
2018-02-02 12:01:40.204 | | owner            | b5e61d54c73a4ec388e770d352f75d13                     |
2018-02-02 12:01:40.204 | | protected        | False                                                |
2018-02-02 12:01:40.204 | | schema           | /v2/schemas/image                                    |
2018-02-02 12:01:40.204 | | size             | 13267968                                             |
2018-02-02 12:01:40.204 | | status           | active                                               |
2018-02-02 12:01:40.204 | | tags             |                                                      |
2018-02-02 12:01:40.204 | | updated_at       | 2018-02-02T12:01:40Z                                 |
2018-02-02 12:01:40.204 | | virtual_size     | None                                                 |
2018-02-02 12:01:40.204 | | visibility       | public                                               |
2018-02-02 12:01:40.204 | +------------------+------------------------------------------------------+

And set in tempest.conf:

http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-neutron-
nova-next-full/a03511c/logs/tempest_conf.txt.gz

[compute]
max_microversion = latest
flavor_ref_alt = 84
flavor_ref = 42
image_ref_alt = b14816be-0047-4749-964f-be5f5eaef245
image_ref = b14816be-0047-4749-964f-be5f5eaef245
build_timeout = 196

I'm not sure what changed around 1/31 but this is failing on multiple
changes, only on master, and only for the nova-next job.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1747511

Title:
  legacy-tempest-dsvm-neutron-nova-next-full fails with "Can not find
  requested image" since 1/31

Status in OpenStack Compute (nova):
  New

Bug description:
  http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-
  neutron-nova-next-full/a03511c/job-
  output.txt.gz#_2018-02-02_12_25_52_609521

  2018-02-02 12:25:52.607290 | primary | Captured traceback:
  2018-02-02 12:25:52.607333 | primary | ~~~~~~~~~~~~~~~~~~~
  2018-02-02 12:25:52.607396 | primary |     Traceback (most recent call last):
  2018-02-02 12:25:52.607554 | primary |       File "tempest/api/compute/admin/test_auto_allocate_network.py", line 152, in test_server_create_no_allocate
  2018-02-02 12:25:52.607674 | primary |         self.os_primary, networks='none', wait_until='ACTIVE')
  2018-02-02 12:25:52.607798 | primary |       File "tempest/common/compute.py", line 191, in create_test_server
  2018-02-02 12:25:52.608202 | primary |         **kwargs)
  2018-02-02 12:25:52.608351 | primary |       File "tempest/lib/services/compute/servers_client.py", line 89, in create_server
  2018-02-02 12:25:52.608465 | primary |         resp, body = self.post('servers', post_body)
  2018-02-02 12:25:52.608560 | primary |       File "tempest/lib/common/rest_client.py", line 279, in post
  2018-02-02 12:25:52.608671 | primary |         return self.request('POST', url, extra_headers, headers, body, chunked)
  2018-02-02 12:25:52.608792 | primary |       File "tempest/lib/services/compute/base_compute_client.py", line 48, in request
  2018-02-02 12:25:52.608892 | primary |         method, url, extra_headers, headers, body, chunked)
  2018-02-02 12:25:52.609032 | primary |       File "tempest/lib/common/rest_client.py", line 668, in request
  2018-02-02 12:25:52.609111 | primary |         self._error_checker(resp, resp_body)
  2018-02-02 12:25:52.609225 | primary |       File "tempest/lib/common/rest_client.py", line 779, in _error_checker
  2018-02-02 12:25:52.609328 | primary |         raise exceptions.BadRequest(resp_body, resp=resp)
  2018-02-02 12:25:52.609420 | primary |     tempest.lib.exceptions.BadRequest: Bad request
  2018-02-02 12:25:52.609521 | primary |     Details: {u'code': 400, u'message': u'Can not find requested image'}
  2018-02-02 12:25:52.609546 | primary |
  2018-02-02 12:25:52.609579 | primary |
  2018-02-02 12:25:52.609626 | primary | Captured pythonlogging:
  2018-02-02 12:25:52.609674 | primary | ~~~~~~~~~~~~~~~~~~~~~~~
  2018-02-02 12:25:52.609952 | primary |     2018-02-02 12:05:26,211 2001 INFO     [tempest.lib.common.rest_client] Request (AutoAllocateNetworkTest:test_server_create_no_allocate): 400 POST http://198.72.124.140/compute/v2.1/servers 0.381s
  2018-02-02 12:25:52.610298 | primary |     2018-02-02 12:05:26,212 2001 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json', 'X-OpenStack-Nova-API-Version': '2.37'}
  2018-02-02 12:25:52.610880 | primary |             Body: {"server": {"imageRef": "b14816be-0047-4749-964f-be5f5eaef245", "networks": "none", "flavorRef": "42", "name": "tempest-tempest.common.compute-instance-166758257"}}
  2018-02-02 12:25:52.611673 | primary |         Response - Headers: {u'connection': 'close', u'content-type': 'application/json; charset=UTF-8', u'server': 'Apache/2.4.18 (Ubuntu)', u'x-compute-request-id': 'req-98f8b35e-a065-4c10-b37f-073d7bde3822', u'openstack-api-version': 'compute 2.37', 'status': '400', 'content-location': 'http://198.72.124.140/compute/v2.1/servers', u'content-length': '72', u'x-openstack-nova-api-version': '2.37', u'x-openstack-request-id': 'req-98f8b35e-a065-4c10-b37f-073d7bde3822', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'date': 'Fri, 02 Feb 2018 12:05:25 GMT'}
  2018-02-02 12:25:52.611797 | primary |             Body: {"badRequest": {"message": "Can not find requested image", "code": 400}}

  http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Can%20not%20find%20requested%20image%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=10d

  So it's using b14816be-0047-4749-964f-be5f5eaef245 which is created
  here:

  http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-
  neutron-nova-next-
  full/a03511c/logs/devstacklog.txt.gz#_2018-02-02_12_01_36_458

  2018-02-02 12:01:36.458 | + functions:upload_image:380               :   openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.3.5-x86_64-disk --public --container-format=bare --disk-format qcow2
  2018-02-02 12:01:40.203 | +------------------+------------------------------------------------------+
  2018-02-02 12:01:40.203 | | Field            | Value                                                |
  2018-02-02 12:01:40.203 | +------------------+------------------------------------------------------+
  2018-02-02 12:01:40.204 | | checksum         | f8ab98ff5e73ebab884d80c9dc9c7290                     |
  2018-02-02 12:01:40.204 | | container_format | bare                                                 |
  2018-02-02 12:01:40.204 | | created_at       | 2018-02-02T12:01:39Z                                 |
  2018-02-02 12:01:40.204 | | disk_format      | qcow2                                                |
  2018-02-02 12:01:40.204 | | file             | /v2/images/b14816be-0047-4749-964f-be5f5eaef245/file |
  2018-02-02 12:01:40.204 | | id               | b14816be-0047-4749-964f-be5f5eaef245                 |
  2018-02-02 12:01:40.204 | | min_disk         | 0                                                    |
  2018-02-02 12:01:40.204 | | min_ram          | 0                                                    |
  2018-02-02 12:01:40.204 | | name             | cirros-0.3.5-x86_64-disk                             |
  2018-02-02 12:01:40.204 | | owner            | b5e61d54c73a4ec388e770d352f75d13                     |
  2018-02-02 12:01:40.204 | | protected        | False                                                |
  2018-02-02 12:01:40.204 | | schema           | /v2/schemas/image                                    |
  2018-02-02 12:01:40.204 | | size             | 13267968                                             |
  2018-02-02 12:01:40.204 | | status           | active                                               |
  2018-02-02 12:01:40.204 | | tags             |                                                      |
  2018-02-02 12:01:40.204 | | updated_at       | 2018-02-02T12:01:40Z                                 |
  2018-02-02 12:01:40.204 | | virtual_size     | None                                                 |
  2018-02-02 12:01:40.204 | | visibility       | public                                               |
  2018-02-02 12:01:40.204 | +------------------+------------------------------------------------------+

  And set in tempest.conf:

  http://logs.openstack.org/10/538510/5/check/legacy-tempest-dsvm-
  neutron-nova-next-full/a03511c/logs/tempest_conf.txt.gz

  [compute]
  max_microversion = latest
  flavor_ref_alt = 84
  flavor_ref = 42
  image_ref_alt = b14816be-0047-4749-964f-be5f5eaef245
  image_ref = b14816be-0047-4749-964f-be5f5eaef245
  build_timeout = 196

  I'm not sure what changed around 1/31 but this is failing on multiple
  changes, only on master, and only for the nova-next job.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1747511/+subscriptions
Follow ups

[Bug 1747511] Re: server create fails with "Can not find requested image" when CONF.glance.api_servers is not set and [service_user] is set
From: OpenStack Infra, 2018-02-08