yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1626260] Re: test_resize_server_from_auto_to_manual fails with deadlock

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem@xxxxxxxxxx>
Date: Wed, 07 Dec 2016 20:03:00 -0000
Reply-to: Bug 1626260 <1626260@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
*** This bug is a duplicate of bug 1480305 ***
    https://bugs.launchpad.net/bugs/1480305

My guess would be you hit bug 1480305 which we added a dbdeadlock retry
decorator for that in newton. That merged shortly before you reported
this, so it might be something different, but without the logs (which
are now gone) it's hard to tell, so I'm going to duplicate this bug.

** This bug has been marked a duplicate of bug 1480305
   DBDeadlock inserting into instance_extra

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1626260

Title:
  test_resize_server_from_auto_to_manual fails with deadlock

Status in OpenStack Compute (nova):
  New

Bug description:
  Seen here on master:

  http://logs.openstack.org/24/372424/3/gate/gate-tempest-dsvm-neutron-
  dvr-ubuntu-xenial/98059a4/logs/testr_results.html.gz

  6-09-21 18:58:39,851 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.156s
  2016-09-21 18:58:39,851 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:39 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-c2c8ec8e-d773-4a1f-823b-7ccccca7bf57', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:41,057 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.199s
  2016-09-21 18:58:41,058 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:41 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-d0065697-5a9f-4c46-816e-821ac1ef2fbd', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:42,297 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.226s
  2016-09-21 18:58:42,297 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:42 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-e6331751-1643-4f12-a323-fbd74ea6703e', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:43,462 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.156s
  2016-09-21 18:58:43,462 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:43 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-c70e4d0f-45f7-4927-bb39-9e3dc0ed467f', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:44,635 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.164s
  2016-09-21 18:58:44,636 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:44 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-5e5523d0-8395-4447-b403-029b802dca2d', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:45,883 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.233s
  2016-09-21 18:58:45,884 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:45 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-d0d26044-e93b-47c2-8a68-cd971cfae868', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:47,121 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.226s
  2016-09-21 18:58:47,122 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:47 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-295c073e-12b4-40b7-9db1-ddb3d8986564', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1285'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_migrating", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "42", "links": [{"href": "http://127.0.0.1:8774/flavors/42";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:32Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:48,346 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.217s
  2016-09-21 18:58:48,346 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:48 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-1e0ac666-1375-4412-a4eb-cdae696f7efc', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1282'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_finish", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "84", "links": [{"href": "http://127.0.0.1:8774/flavors/84";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:48Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:48,352 24095 INFO     [tempest.common.waiters] State transition "RESIZE/resize_migrating" ==> "RESIZE/resize_finish" after 17 second wait
  2016-09-21 18:58:49,521 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.167s
  2016-09-21 18:58:49,521 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:49 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-7ff4ad53-2d99-4d99-9906-213c4115de8a', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1282'}
          Body: {"server": {"OS-EXT-STS:task_state": "resize_finish", "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "84", "links": [{"href": "http://127.0.0.1:8774/flavors/84";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "RESIZE", "updated": "2016-09-21T18:58:48Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "config_drive": ""}}
  2016-09-21 18:58:50,695 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:test_resize_server_from_auto_to_manual): 200 GET http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.166s
  2016-09-21 18:58:50,695 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:50 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-3f328bba-ddc5-44ac-aa9a-aca6dbc8e124', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '200', 'content-length': '1583'}
          Body: {"server": {"OS-EXT-STS:task_state": null, "addresses": {}, "links": [{"href": "http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "self"}, {"href": "http://127.0.0.1:8774/servers/84748545-5305-4da4-be4b-66588159893c";, "rel": "bookmark"}], "image": {"id": "b1231eb5-0311-4746-8b4c-70cef551c83a", "links": [{"href": "http://127.0.0.1:8774/images/b1231eb5-0311-4746-8b4c-70cef551c83a";, "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "error", "OS-SRV-USG:launched_at": "2016-09-21T18:58:28.000000", "flavor": {"id": "84", "links": [{"href": "http://127.0.0.1:8774/flavors/84";, "rel": "bookmark"}]}, "id": "84748545-5305-4da4-be4b-66588159893c", "user_id": "c4da53c110164c84888c03559e2cccaa", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "metadata": {}, "status": "ERROR", "updated": "2016-09-21T18:58:50Z", "hostId": "93e4e7910e6df5dc31fd86061602c7c1cfe0cf8ba9ead635c3c10275", "OS-SRV-USG:terminated_at": null, "key_name": null, "name": "tempest-ServerDiskConfigTestJSON-server-1446478819", "created": "2016-09-21T18:58:24Z", "tenant_id": "9864078817a64e8984a0a4da65d27d5b", "os-extended-volumes:volumes_attached": [], "fault": {"message": "Remote error: DBDeadlock (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE migrations SET updated_at=%(updated_at)s, status=%(status)s WHERE migrations.id = %(migrations_id)s'] [parame", "code": 500, "created": "2016-09-21T18:58:50Z"}, "config_drive": ""}}
  2016-09-21 18:58:50,701 24095 INFO     [tempest.common.waiters] State transition "RESIZE/resize_finish" ==> "ERROR/None" after 19 second wait
  2016-09-21 18:58:51,121 24095 INFO     [tempest.lib.common.rest_client] Request (ServerDiskConfigTestJSON:_run_cleanups): 204 DELETE http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c 0.419s
  2016-09-21 18:58:51,121 24095 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
          Body: None
      Response - Headers: {'content-type': 'application/json', 'date': 'Wed, 21 Sep 2016 18:58:51 GMT', 'x-openstack-nova-api-version': '2.1', 'openstack-api-version': 'compute 2.1', 'connection': 'close', 'vary': 'X-OpenStack-Nova-API-Version', 'x-compute-request-id': 'req-8843470a-7d2d-41d0-bfb2-922b97d1705a', 'content-location': 'http://127.0.0.1:8774/v2.1/servers/84748545-5305-4da4-be4b-66588159893c', 'status': '204', 'content-length': '0'}
          Body:
  }}}

  Traceback (most recent call last):
    File "tempest/api/compute/servers/test_disk_config.py", line 120, in test_resize_server_from_auto_to_manual
      'VERIFY_RESIZE')
    File "tempest/common/waiters.py", line 75, in wait_for_server_status
      server_id=server_id)
  tempest.exceptions.BuildErrorException: Server 84748545-5305-4da4-be4b-66588159893c failed to build and is in ERROR status
  Details: {u'created': u'2016-09-21T18:58:50Z', u'message': u"Remote error: DBDeadlock (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE migrations SET updated_at=%(updated_at)s, status=%(status)s WHERE migrations.id = %(migrations_id)s'] [parame", u'code': 500}

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1626260/+subscriptions