yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1445629] [NEW] Cells: tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Andrew Laski <andrew.laski@xxxxxxxxxxxxx>
Date: Fri, 17 Apr 2015 19:11:51 -0000
Reply-to: Bug 1445629 <1445629@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Tempest failure has been seen due to various failures in the tests.
It's failed on 'MANUAL' != 'AUTO' in an assert, and occasionally the 500
error as seen below.

2015-04-17 15:52:46.992 | tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config[gate,id-bef56b09-2e8c-4883-a370-4950812f430e]
2015-04-17 15:52:46.992 | ---------------------------------------------------------------------------------------------------------------------------------------------------------------
2015-04-17 15:52:46.992 | 
2015-04-17 15:52:46.992 | Captured traceback:
2015-04-17 15:52:46.993 | ~~~~~~~~~~~~~~~~~~~
2015-04-17 15:52:46.993 |     Traceback (most recent call last):
2015-04-17 15:52:46.993 |       File "tempest/api/compute/servers/test_disk_config.py", line 62, in test_rebuild_server_with_manual_disk_config
2015-04-17 15:52:46.993 |         disk_config='MANUAL')
2015-04-17 15:52:46.993 |       File "tempest/services/compute/json/servers_client.py", line 286, in rebuild
2015-04-17 15:52:46.993 |         rebuild_schema, **kwargs)
2015-04-17 15:52:46.993 |       File "tempest/services/compute/json/servers_client.py", line 223, in action
2015-04-17 15:52:46.993 |         post_body)
2015-04-17 15:52:46.993 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 252, in post
2015-04-17 15:52:46.993 |         return self.request('POST', url, extra_headers, headers, body)
2015-04-17 15:52:46.993 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 629, in request
2015-04-17 15:52:46.994 |         resp, resp_body)
2015-04-17 15:52:46.994 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 734, in _error_checker
2015-04-17 15:52:46.994 |         raise exceptions.ServerFault(message)
2015-04-17 15:52:46.994 |     tempest_lib.exceptions.ServerFault: Got server fault
2015-04-17 15:52:46.994 |     Details: The server has either erred or is incapable of performing the requested operation.
2015-04-17 15:52:46.994 |     
2015-04-17 15:52:46.994 | 
2015-04-17 15:52:46.994 | Captured pythonlogging:
2015-04-17 15:52:46.994 | ~~~~~~~~~~~~~~~~~~~~~~~
2015-04-17 15:52:46.994 |     2015-04-17 15:41:20,649 22297 INFO     [tempest_lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_rebuild_server_with_manual_disk_config): 200 GET http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e 0.093s
2015-04-17 15:52:46.994 |     2015-04-17 15:41:20,649 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
2015-04-17 15:52:46.994 |             Body: None
2015-04-17 15:52:46.995 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:41:20 GMT', 'content-location': 'http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e', 'content-length': '1561', 'connection': 'close', 'content-type': 'application/json', 'x-compute-request-id': 'req-d4ffd48d-d352-43a0-93f2-69aaac4b15cc', 'status': '200'}
2015-04-17 15:52:46.995 |             Body: {"server": {"status": "ACTIVE", "updated": "2015-04-17T15:41:19Z", "hostId": "76f5dd41c013d68299b15e024f385c17e44224a89fec40092bc453a1", "addresses": {"private": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:fc:d9:ec", "version": 4, "addr": "10.1.0.3", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e";, "rel": "self"}, {"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e";, "rel": "bookmark"}], "key_name": null, "image": {"id": "c119e569-3af7-41c9-a5da-6bab97b7c508", "links": [{"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/images/c119e569-3af7-41c9-a5da-6bab97b7c508";, "rel": "bookmark"}]}, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2015-04-17T15:41:17.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/flavors/42";, "rel": "bookmark"}]}, "id": "64384837-aeed-4716-8b70-e352969dc70e", "security_groups": [{"name": "default"}], "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "nova", "user_id": "0cbc6e298f524a5d85f68992d71ffa33", "name": "ServerDiskConfigTestJSON-instance-905081337", "created": "2015-04-17T15:41:10Z", "tenant_id": "122b3703a169473b95c2df822ab3b445", "OS-DCF:diskConfig": "AUTO", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "True", "metadata": {}}}
2015-04-17 15:52:46.995 |     2015-04-17 15:41:21,776 22297 INFO     [tempest_lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_rebuild_server_with_manual_disk_config): 500 POST http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e/action 1.094s
2015-04-17 15:52:46.995 |     2015-04-17 15:41:21,776 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
2015-04-17 15:52:46.995 |             Body: {"rebuild": {"OS-DCF:diskConfig": "MANUAL", "imageRef": "c119e569-3af7-41c9-a5da-6bab97b7c508"}}
2015-04-17 15:52:46.995 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:41:21 GMT', 'content-length': '128', 'connection': 'close', 'content-type': 'application/json; charset=UTF-8', 'x-compute-request-id': 'req-6bdd300b-db96-4c0b-bd8a-13f3a648f80e', 'status': '500'}
2015-04-17 15:52:46.995 |             Body: {"computeFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500}}

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1445629

Title:
  Cells:
  tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config

Status in OpenStack Compute (Nova):
  New

Bug description:
  Tempest failure has been seen due to various failures in the tests.
  It's failed on 'MANUAL' != 'AUTO' in an assert, and occasionally the
  500 error as seen below.

  2015-04-17 15:52:46.992 | tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config[gate,id-bef56b09-2e8c-4883-a370-4950812f430e]
  2015-04-17 15:52:46.992 | ---------------------------------------------------------------------------------------------------------------------------------------------------------------
  2015-04-17 15:52:46.992 | 
  2015-04-17 15:52:46.992 | Captured traceback:
  2015-04-17 15:52:46.993 | ~~~~~~~~~~~~~~~~~~~
  2015-04-17 15:52:46.993 |     Traceback (most recent call last):
  2015-04-17 15:52:46.993 |       File "tempest/api/compute/servers/test_disk_config.py", line 62, in test_rebuild_server_with_manual_disk_config
  2015-04-17 15:52:46.993 |         disk_config='MANUAL')
  2015-04-17 15:52:46.993 |       File "tempest/services/compute/json/servers_client.py", line 286, in rebuild
  2015-04-17 15:52:46.993 |         rebuild_schema, **kwargs)
  2015-04-17 15:52:46.993 |       File "tempest/services/compute/json/servers_client.py", line 223, in action
  2015-04-17 15:52:46.993 |         post_body)
  2015-04-17 15:52:46.993 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 252, in post
  2015-04-17 15:52:46.993 |         return self.request('POST', url, extra_headers, headers, body)
  2015-04-17 15:52:46.993 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 629, in request
  2015-04-17 15:52:46.994 |         resp, resp_body)
  2015-04-17 15:52:46.994 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/tempest_lib/common/rest_client.py", line 734, in _error_checker
  2015-04-17 15:52:46.994 |         raise exceptions.ServerFault(message)
  2015-04-17 15:52:46.994 |     tempest_lib.exceptions.ServerFault: Got server fault
  2015-04-17 15:52:46.994 |     Details: The server has either erred or is incapable of performing the requested operation.
  2015-04-17 15:52:46.994 |     
  2015-04-17 15:52:46.994 | 
  2015-04-17 15:52:46.994 | Captured pythonlogging:
  2015-04-17 15:52:46.994 | ~~~~~~~~~~~~~~~~~~~~~~~
  2015-04-17 15:52:46.994 |     2015-04-17 15:41:20,649 22297 INFO     [tempest_lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_rebuild_server_with_manual_disk_config): 200 GET http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e 0.093s
  2015-04-17 15:52:46.994 |     2015-04-17 15:41:20,649 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
  2015-04-17 15:52:46.994 |             Body: None
  2015-04-17 15:52:46.995 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:41:20 GMT', 'content-location': 'http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e', 'content-length': '1561', 'connection': 'close', 'content-type': 'application/json', 'x-compute-request-id': 'req-d4ffd48d-d352-43a0-93f2-69aaac4b15cc', 'status': '200'}
  2015-04-17 15:52:46.995 |             Body: {"server": {"status": "ACTIVE", "updated": "2015-04-17T15:41:19Z", "hostId": "76f5dd41c013d68299b15e024f385c17e44224a89fec40092bc453a1", "addresses": {"private": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:fc:d9:ec", "version": 4, "addr": "10.1.0.3", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e";, "rel": "self"}, {"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e";, "rel": "bookmark"}], "key_name": null, "image": {"id": "c119e569-3af7-41c9-a5da-6bab97b7c508", "links": [{"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/images/c119e569-3af7-41c9-a5da-6bab97b7c508";, "rel": "bookmark"}]}, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2015-04-17T15:41:17.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/122b3703a169473b95c2df822ab3b445/flavors/42";, "rel": "bookmark"}]}, "id": "64384837-aeed-4716-8b70-e352969dc70e", "security_groups": [{"name": "default"}], "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "nova", "user_id": "0cbc6e298f524a5d85f68992d71ffa33", "name": "ServerDiskConfigTestJSON-instance-905081337", "created": "2015-04-17T15:41:10Z", "tenant_id": "122b3703a169473b95c2df822ab3b445", "OS-DCF:diskConfig": "AUTO", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "True", "metadata": {}}}
  2015-04-17 15:52:46.995 |     2015-04-17 15:41:21,776 22297 INFO     [tempest_lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_rebuild_server_with_manual_disk_config): 500 POST http://127.0.0.1:8774/v2/122b3703a169473b95c2df822ab3b445/servers/64384837-aeed-4716-8b70-e352969dc70e/action 1.094s
  2015-04-17 15:52:46.995 |     2015-04-17 15:41:21,776 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
  2015-04-17 15:52:46.995 |             Body: {"rebuild": {"OS-DCF:diskConfig": "MANUAL", "imageRef": "c119e569-3af7-41c9-a5da-6bab97b7c508"}}
  2015-04-17 15:52:46.995 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:41:21 GMT', 'content-length': '128', 'connection': 'close', 'content-type': 'application/json; charset=UTF-8', 'x-compute-request-id': 'req-6bdd300b-db96-4c0b-bd8a-13f3a648f80e', 'status': '500'}
  2015-04-17 15:52:46.995 |             Body: {"computeFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500}}

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1445629/+subscriptions
Follow ups

[Bug 1445629] Re: Cells: tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config
From: Launchpad Bug Tracker, 2015-11-14
[Bug 1445629] [NEW] Cells: tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config
From: Andrew Laski, 2015-04-17
References

[Bug 1445629] [NEW] Cells: tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_rebuild_server_with_manual_disk_config
From: Andrew Laski, 2015-04-17