← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #32065

[Bug 1445628] [NEW] Cells: Tempest test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

The tempest test is failing, likely due to a race condition with setting
system_metadata on instances too quickly.

2015-04-17 15:52:47.001 | tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances[id-c881fbb7-d56e-4054-9d76-1c3a60a207b0]
2015-04-17 15:52:47.001 | ------------------------------------------------------------------------------------------------------------------------------------
2015-04-17 15:52:47.001 | 
2015-04-17 15:52:47.001 | Captured traceback:
2015-04-17 15:52:47.001 | ~~~~~~~~~~~~~~~~~~~
2015-04-17 15:52:47.001 |     Traceback (most recent call last):
2015-04-17 15:52:47.001 |       File "tempest/thirdparty/boto/test_ec2_instance_run.py", line 120, in test_run_idempotent_instances
2015-04-17 15:52:47.001 |         self.assertEqual(reservation_1.id, reservation_1a.id)
2015-04-17 15:52:47.001 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
2015-04-17 15:52:47.001 |         self.assertThat(observed, matcher, message)
2015-04-17 15:52:47.002 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
2015-04-17 15:52:47.002 |         raise mismatch_error
2015-04-17 15:52:47.002 |     testtools.matchers._impl.MismatchError: u'r-b5r49kpt' != u'r-pkxdvrw5'
2015-04-17 15:52:47.002 |     
2015-04-17 15:52:47.002 | 
2015-04-17 15:52:47.002 | Captured pythonlogging:
2015-04-17 15:52:47.002 | ~~~~~~~~~~~~~~~~~~~~~~~
2015-04-17 15:52:47.002 |     2015-04-17 15:49:33,598 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.378s
2015-04-17 15:52:47.002 |     2015-04-17 15:49:33,598 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
2015-04-17 15:52:47.002 |             Body: None
2015-04-17 15:52:47.002 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:33 GMT', 'x-openstack-request-id': 'req-d4e9b050-8987-4880-a8ad-bf7d0ddeff46', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
2015-04-17 15:52:47.003 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
2015-04-17 15:52:47.003 |     2015-04-17 15:49:39,084 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.479s
2015-04-17 15:52:47.003 |     2015-04-17 15:49:39,085 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
2015-04-17 15:52:47.003 |             Body: None
2015-04-17 15:52:47.003 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:38 GMT', 'x-openstack-request-id': 'req-7dec7fd6-19e0-4bd1-9819-374b286e2ba1', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
2015-04-17 15:52:47.003 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
2015-04-17 15:52:47.003 |     2015-04-17 15:49:45,016 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.430s
2015-04-17 15:52:47.003 |     2015-04-17 15:49:45,016 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
2015-04-17 15:52:47.003 |             Body: None
2015-04-17 15:52:47.020 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:44 GMT', 'x-openstack-request-id': 'req-4b53172a-d346-4292-bdf5-fcc256ac2310', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
2015-04-17 15:52:47.020 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
2015-04-17 15:52:47.020 |

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1445628

Title:
  Cells: Tempest
  test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances

Status in OpenStack Compute (Nova):
  New

Bug description:
  The tempest test is failing, likely due to a race condition with
  setting system_metadata on instances too quickly.

  2015-04-17 15:52:47.001 | tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances[id-c881fbb7-d56e-4054-9d76-1c3a60a207b0]
  2015-04-17 15:52:47.001 | ------------------------------------------------------------------------------------------------------------------------------------
  2015-04-17 15:52:47.001 | 
  2015-04-17 15:52:47.001 | Captured traceback:
  2015-04-17 15:52:47.001 | ~~~~~~~~~~~~~~~~~~~
  2015-04-17 15:52:47.001 |     Traceback (most recent call last):
  2015-04-17 15:52:47.001 |       File "tempest/thirdparty/boto/test_ec2_instance_run.py", line 120, in test_run_idempotent_instances
  2015-04-17 15:52:47.001 |         self.assertEqual(reservation_1.id, reservation_1a.id)
  2015-04-17 15:52:47.001 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
  2015-04-17 15:52:47.001 |         self.assertThat(observed, matcher, message)
  2015-04-17 15:52:47.002 |       File "/opt/stack/new/tempest/.tox/all/local/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
  2015-04-17 15:52:47.002 |         raise mismatch_error
  2015-04-17 15:52:47.002 |     testtools.matchers._impl.MismatchError: u'r-b5r49kpt' != u'r-pkxdvrw5'
  2015-04-17 15:52:47.002 |     
  2015-04-17 15:52:47.002 | 
  2015-04-17 15:52:47.002 | Captured pythonlogging:
  2015-04-17 15:52:47.002 | ~~~~~~~~~~~~~~~~~~~~~~~
  2015-04-17 15:52:47.002 |     2015-04-17 15:49:33,598 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.378s
  2015-04-17 15:52:47.002 |     2015-04-17 15:49:33,598 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
  2015-04-17 15:52:47.002 |             Body: None
  2015-04-17 15:52:47.002 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:33 GMT', 'x-openstack-request-id': 'req-d4e9b050-8987-4880-a8ad-bf7d0ddeff46', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
  2015-04-17 15:52:47.003 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
  2015-04-17 15:52:47.003 |     2015-04-17 15:49:39,084 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.479s
  2015-04-17 15:52:47.003 |     2015-04-17 15:49:39,085 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
  2015-04-17 15:52:47.003 |             Body: None
  2015-04-17 15:52:47.003 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:38 GMT', 'x-openstack-request-id': 'req-7dec7fd6-19e0-4bd1-9819-374b286e2ba1', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
  2015-04-17 15:52:47.003 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
  2015-04-17 15:52:47.003 |     2015-04-17 15:49:45,016 22297 INFO     [tempest_lib.common.rest_client] Request (InstanceRunTest:test_run_idempotent_instances): 200 GET http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2 0.430s
  2015-04-17 15:52:47.003 |     2015-04-17 15:49:45,016 22297 DEBUG    [tempest_lib.common.rest_client] Request - Headers: {'X-Auth-Token': '<omitted>', 'Accept': 'application/json', 'Content-Type': 'application/json'}
  2015-04-17 15:52:47.003 |             Body: None
  2015-04-17 15:52:47.020 |         Response - Headers: {'date': 'Fri, 17 Apr 2015 15:49:44 GMT', 'x-openstack-request-id': 'req-4b53172a-d346-4292-bdf5-fcc256ac2310', 'vary': 'X-Auth-Token', 'server': 'Apache/2.4.7 (Ubuntu)', 'content-length': '225', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://127.0.0.1:35357/v2.0/users/c70380a98d8a4842a3a40f8470aef63d/credentials/OS-EC2'}
  2015-04-17 15:52:47.020 |             Body: {"credentials": [{"access": "a1dcddda366840f0b39548da591c3eac", "tenant_id": "d3f919661707425eb0cf76113ffd03c4", "secret": "c33e9727f7f743eca190009b96edea13", "user_id": "c70380a98d8a4842a3a40f8470aef63d", "trust_id": null}]}
  2015-04-17 15:52:47.020 |

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1445628/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next