yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1079687] Re: Flaky failures of instances to reach BUILD and ACTIVE states

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Sean Dague <sdague@xxxxxxxxxxxxxxxxxx>
Date: Tue, 19 Feb 2013 13:08:17 -0000
Reply-to: Bug 1079687 <1079687@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
This is solved in the general case in tempest.

** Changed in: nova
       Status: Triaged => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1079687

Title:
  Flaky failures of instances to reach BUILD and ACTIVE states

Status in OpenStack Compute (Nova):
  Invalid
Status in Tempest:
  Fix Released

Bug description:
  This has been happening in the hourly tempest runs. Here are some
  recent examples:

  https://jenkins.openstack.org/job/periodic-tempest-devstack-vm-check-hourly/77/console
  03:44:06 ERROR: Specify a keypair while creating a server
  03:44:06 ----------------------------------------------------------------------
  03:44:06 Traceback (most recent call last):
  03:44:06   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 86, in test_create_specify_keypair
  03:44:06     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  03:44:06   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  03:44:06     raise exceptions.BuildErrorException(server_id=server_id)
  03:44:06 BuildErrorException: Server 809a992b-9e34-4e14-9ead-3b536355ff71 failed to build and is in ERROR status
  03:44:06 


  https://jenkins.openstack.org/job/periodic-tempest-devstack-vm-check-hourly/78/console
  04:43:26 ERROR: Delete a server while it's VM state is Building
  04:43:26 ----------------------------------------------------------------------
  04:43:26 Traceback (most recent call last):
  04:43:26   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 148, in test_delete_server_while_in_building_state
  04:43:26     self.client.wait_for_server_status(server['id'], 'BUILD')
  04:43:26   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  04:43:26     raise exceptions.BuildErrorException(server_id=server_id)
  04:43:26 BuildErrorException: Server 8b152f72-4f69-406f-a45a-a40490013bae failed to build and is in ERROR status
  04:43:26 
  04:43:26 ======================================================================
  04:43:26 ERROR: The server's access addresses should reflect the provided values
  04:43:26 ----------------------------------------------------------------------
  04:43:26 Traceback (most recent call last):
  04:43:26   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 125, in test_update_access_server_address
  04:43:26     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  04:43:26   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  04:43:26     raise exceptions.BuildErrorException(server_id=server_id)
  04:43:26 BuildErrorException: Server b708f30f-69d3-463d-98df-099b68acc308 failed to build and is in ERROR status
  04:43:26 
  04:43:26 ======================================================================
  04:43:26 ERROR: The server name should be changed to the the provided value
  04:43:26 ----------------------------------------------------------------------
  04:43:26 Traceback (most recent call last):
  04:43:26   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 100, in test_update_server_name
  04:43:26     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  04:43:26   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  04:43:26     raise exceptions.BuildErrorException(server_id=server_id)
  04:43:26 BuildErrorException: Server 60d60b56-6d87-48ef-aed3-2a57c30b014f failed to build and is in ERROR status
  04:4


  
  https://jenkins.openstack.org/job/periodic-tempest-devstack-vm-check-hourly/85/console
  11:43:18 ERROR: Specify a keypair while creating a server
  11:43:18 ----------------------------------------------------------------------
  11:43:18 Traceback (most recent call last):
  11:43:18   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 86, in test_create_specify_keypair
  11:43:18     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  11:43:18   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  11:43:18     raise exceptions.BuildErrorException(server_id=server_id)
  11:43:18 BuildErrorException: Server 646858c1-109c-42bf-921f-d58281686ea7 failed to build and is in ERROR status
  11:43:18 
  11:43:18 ======================================================================
  11:43:18 ERROR: Creating a server with a name that already exists is allowed
  11:43:18 ----------------------------------------------------------------------
  11:43:18 Traceback (most recent call last):
  11:43:18   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 68, in test_create_with_existing_server_name
  11:43:18     for server_id in (id1, id2):
  11:43:18 UnboundLocalError: local variable 'id1' referenced before assignment
  11:43:18 
  11:43:18 ======================================================================
  11:43:18 ERROR: Delete a server while it's VM state is Building
  11:43:18 ----------------------------------------------------------------------
  11:43:18 Traceback (most recent call last):
  11:43:18   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 148, in test_delete_server_while_in_building_state
  11:43:18     self.client.wait_for_server_status(server['id'], 'BUILD')
  11:43:18   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  11:43:18     raise exceptions.BuildErrorException(server_id=server_id)
  11:43:18 BuildErrorException: Server d3bc54f7-8914-4156-abba-600bc54d2550 failed to build and is in ERROR status
  11:43:18 
  11:43:18 ======================================================================
  11:43:18 ERROR: The server's access addresses should reflect the provided values
  11:43:18 ----------------------------------------------------------------------
  11:43:18 Traceback (most recent call last):
  11:43:18   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 125, in test_update_access_server_address
  11:43:18     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  11:43:18   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  11:43:18     raise exceptions.BuildErrorException(server_id=server_id)
  11:43:18 BuildErrorException: Server 245309e8-1645-4331-a9d0-d0ed9e8028bb failed to build and is in ERROR status
  11:43:18 
  11:43:18 ======================================================================
  11:43:18 ERROR: The server name should be changed to the the provided value
  11:43:18 ----------------------------------------------------------------------
  11:43:18 Traceback (most recent call last):
  11:43:18   File "/opt/stack/tempest/tempest/tests/compute/servers/test_servers.py", line 100, in test_update_server_name
  11:43:18     self.client.wait_for_server_status(server['id'], 'ACTIVE')
  11:43:18   File "/opt/stack/tempest/tempest/services/compute/xml/servers_client.py", line 195, in wait_for_server_status
  11:43:18     raise exceptions.BuildErrorException(server_id=server_id)
  11:43:18 BuildErrorException: Server 4db93eed-365e-4721-9f5b-09c10b745c3f failed to build and is in ERROR status

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1079687/+subscriptions