yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1529781] Re: Tempest volume tests are failing in devstack vm

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Bardia Keyoumarsi <bardia.keyoumarsi@xxxxxxxxxxxx>
Date: Tue, 29 Dec 2015 07:33:23 -0000
Reply-to: Bug 1529781 <1529781@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Description changed:

  The following tempest volume tests have been failing in CI's test run
  since Friday Dec 18, 2015.
  
  20:33:46 {0} tempest.api.compute.servers.test_server_rescue_negative.ServerRescueNegativeTestJSON.test_rescued_vm_detach_volume [271.730166s] ... FAILED
  20:33:53 {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... SKIPPED: SSH required for this test
  20:37:23 {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments [210.071655s] ... FAILED
- 20:37:35 {0} 
+ 20:37:35 {0}
  
  The only errors in the cinder logs related to these tests are as follows:
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 585, in execute
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api     quota=quotas[over_name])
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api VolumeSizeExceedsAvailableQuota: Requested volume or snapshot exceeds allowed gigabytes quota. Requested 1G, quota is 1G and 1G has been consumed.
- screen-c-api.txt:2015-12-29 04:57:18.633 22683 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 597, in execute
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api     name=exceeded_vol_limit_name)
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api VolumeLimitExceeded: Maximum number of volumes allowed (1) exceeded for quota 'volumes'.
- screen-c-api.txt:2015-12-29 04:57:19.042 22684 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 585, in execute
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api     quota=quotas[over_name])
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api VolumeSizeExceedsAvailableQuota: Requested volume or snapshot exceeds allowed gigabytes quota. Requested 1G, quota is 1G and 1G has been consumed.
- screen-c-api.txt:2015-12-29 04:57:25.652 22684 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 597, in execute
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api     name=exceeded_vol_limit_name)
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api VolumeLimitExceeded: Maximum number of volumes allowed (1) exceeded for quota 'volumes'.
- screen-c-api.txt:2015-12-29 04:57:26.057 22684 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 370, in execute
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api     size = self._extract_size(size, source_volume, snapshot)
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 189, in _extract_size
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api     func(size)
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 167, in validate_int
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api     raise exception.InvalidInput(reason=msg)
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api InvalidInput: Invalid input received: Volume size '' must be an integer and greater than 0
- screen-c-api.txt:2015-12-29 05:05:27.379 22683 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 05:05:27.943 ERROR cinder.volume.api [req-7d6fc585-a565-4799-b0b5-0692b72fd9da tempest-VolumesV1NegativeTest-6839765] Volume status must be available to reserve.
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api Traceback (most recent call last):
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api   File "/usr/local/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api     result = task.execute(**arguments)
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 370, in execute
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api     size = self._extract_size(size, source_volume, snapshot)
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 189, in _extract_size
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api     func(size)
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api   File "/opt/stack/new/cinder/cinder/volume/flows/api/create_volume.py", line 167, in validate_int
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api     raise exception.InvalidInput(reason=msg)
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api InvalidInput: Invalid input received: Volume size '' must be an integer and greater than 0
- screen-c-api.txt:2015-12-29 05:05:45.128 22684 ERROR cinder.volume.api
- screen-c-api.txt:2015-12-29 05:05:45.750 ERROR cinder.volume.api [req-707b980a-08bd-46e4-bdcc-d3685c4db6ac tempest-VolumesV2NegativeTest-159597411] Volume status must be available to reserve.
+ http://paste.openstack.org/show/482795/
+ 
+ The following tests have also been failing due to changes that were introduced into the Nova libvirt driver:
+ 20:47:52 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshot_create_get_list_update_delete [4.724829s] ... ok
+ 20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshot_create_with_volume_in_use [214.139424s] ... FAILED
+ 20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshots_list_details_with_params [0.083753s] ... FAILED
+ 20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshots_list_with_params [0.074774s] ... FAILED
+ 20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_volume_from_snapshot [0.070822s] ... FAILED
+ 20:54:52 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshot_create_get_list_update_delete [4.996867s] ... ok
+ 20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshot_create_with_volume_in_use [212.700531s] ... FAILED
+ 20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshots_list_details_with_params [0.073216s] ... FAILED
+ 20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshots_list_with_params [0.079156s] ... FAILED
+ 20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_volume_from_snapshot [0.074305s] ... FAILED
+ 
+ These are the only errors found in nova logs that causes these failures:
+ http://paste.openstack.org/show/482796/
  
  The CI has been setup using the instructions given here:
  https://git.openstack.org/cgit/openstack-infra/puppet-
  openstackci/tree/contrib/README.md
  
  The Openstack cloud where the nodepool nodes are created is a private
  devstack deployment.

** Project changed: nova => nova-project

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1529781

Title:
  Tempest volume tests are failing in devstack vm

Status in Cinder:
  New
Status in Nova:
  New

Bug description:
  The following tempest volume tests have been failing in CI's test run
  since Friday Dec 18, 2015.

  20:33:46 {0} tempest.api.compute.servers.test_server_rescue_negative.ServerRescueNegativeTestJSON.test_rescued_vm_detach_volume [271.730166s] ... FAILED
  20:33:53 {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... SKIPPED: SSH required for this test
  20:37:23 {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments [210.071655s] ... FAILED
  20:37:35 {0}

  The only errors in the cinder logs related to these tests are as follows:
  http://paste.openstack.org/show/482795/

  The following tests have also been failing due to changes that were introduced into the Nova libvirt driver:
  20:47:52 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshot_create_get_list_update_delete [4.724829s] ... ok
  20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshot_create_with_volume_in_use [214.139424s] ... FAILED
  20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshots_list_details_with_params [0.083753s] ... FAILED
  20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_snapshots_list_with_params [0.074774s] ... FAILED
  20:51:27 {0} tempest.api.volume.test_volumes_snapshots.VolumesV1SnapshotTestJSON.test_volume_from_snapshot [0.070822s] ... FAILED
  20:54:52 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshot_create_get_list_update_delete [4.996867s] ... ok
  20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshot_create_with_volume_in_use [212.700531s] ... FAILED
  20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshots_list_details_with_params [0.073216s] ... FAILED
  20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_snapshots_list_with_params [0.079156s] ... FAILED
  20:58:25 {0} tempest.api.volume.test_volumes_snapshots.VolumesV2SnapshotTestJSON.test_volume_from_snapshot [0.074305s] ... FAILED

  These are the only errors found in nova logs that causes these failures:
  http://paste.openstack.org/show/482796/

  The CI has been setup using the instructions given here:
  https://git.openstack.org/cgit/openstack-infra/puppet-
  openstackci/tree/contrib/README.md

  The Openstack cloud where the nodepool nodes are created is a private
  devstack deployment.

To manage notifications about this bug go to:
https://bugs.launchpad.net/cinder/+bug/1529781/+subscriptions
References

[Bug 1529781] [NEW] Tempest volume tests are failing in devstack vm
From: Bardia Keyoumarsi, 2015-12-29