yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1705567] [NEW] gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial failed with timeout

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Ihar Hrachyshka <1705567@xxxxxxxxxxxxxxxxxx>
Date: Thu, 20 Jul 2017 20:30:37 -0000
Reply-to: Bug 1705567 <1705567@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

http://logs.openstack.org/85/385085/30/gate/gate-tempest-dsvm-neutron-
linuxbridge-ubuntu-xenial/75e271d/console.html

2017-07-20 19:18:32.693567 | full runtests: commands[2] | tempest run --combine --serial --regex (?!.*\[.*\bslow\b.*\])(^tempest\.scenario) --concurrency=4
2017-07-20 19:18:38.317292 | running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
2017-07-20 19:18:38.317404 | OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
2017-07-20 19:18:38.317449 | OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
2017-07-20 19:18:38.317501 | OS_TEST_LOCK_PATH=${OS_TEST_LOCK_PATH:-${TMPDIR:-'/tmp'}} \
2017-07-20 19:18:38.317574 | ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --list 
2017-07-20 19:18:38.317621 | running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
2017-07-20 19:18:38.317657 | OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
2017-07-20 19:18:38.317692 | OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
2017-07-20 19:18:38.317733 | OS_TEST_LOCK_PATH=${OS_TEST_LOCK_PATH:-${TMPDIR:-'/tmp'}} \
2017-07-20 19:18:38.317814 | ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover}  --load-list /tmp/tmpqrNAOh
2017-07-20 19:20:27.479411 | {0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [101.261843s] ... ok
2017-07-20 19:20:27.479460 | 
2017-07-20 19:20:27.479481 | Captured stderr:
2017-07-20 19:20:27.479498 | ~~~~~~~~~~~~~~~~
2017-07-20 19:20:27.479565 |     /opt/stack/new/tempest/.tox/tempest/local/lib/python2.7/site-packages/cryptography/hazmat/backends/openssl/rsa.py:477: DeprecationWarning: signer and verifier have been deprecated. Please use sign and verify instead.
2017-07-20 19:20:27.479587 |       _warn_sign_verify_deprecated()
2017-07-20 19:20:27.479600 |     
2017-07-20 19:22:09.799157 | {0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_reboot [93.151292s] ... ok
2017-07-20 19:23:37.650731 | {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic [84.459821s] ... ok
2017-07-20 19:25:34.994829 | {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [117.306077s] ... ok
2017-07-20 19:28:02.218494 | {0} tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_slaac [143.769198s] ... ok
2017-07-20 19:28:05.681801 | {0} tempest.scenario.test_object_storage_basic_ops.TestObjectStorageBasicOps.test_swift_basic_ops [0.381328s] ... ok
2017-07-20 19:30:17.429097 | {0} tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic [128.538566s] ... ok
2017-07-20 19:31:43.217495 | {0} tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_in_tenant_traffic [85.784122s] ... ok
2017-07-20 19:32:41.287100 | {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops [49.211398s] ... ok
2017-07-20 19:32:48.257653 | {0} setUpClass (tempest.scenario.test_server_multinode.TestServerMultinode) ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
2017-07-20 19:33:30.275095 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks [30.113681s] ... ok
2017-07-20 19:34:42.975903 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_create_ebs_image_and_check_boot [72.662936s] ... ok
2017-07-20 19:37:50.719757 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [187.710856s] ... ok
2017-07-20 19:38:03.835802 | /home/jenkins/workspace/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/devstack-gate/functions.sh: line 1127: 12175 Killed                  timeout -s 9 ${REMAINING_TIME}m bash -c "source $WORKSPACE/devstack-gate/functions.sh && $cmd"
2017-07-20 19:38:03.835887 | ERROR: the main setup script run by this job failed - exit code: 137
2017-07-20 19:38:03.845801 |     please look at the relevant log files to determine the root cause

It's not fully clear why despite --concurrency=4, it looks like a single
test thread is running. That being said, the slow tests had only 20
minutes to run before being abrupted, so it may as well be an issue in
the previous phase of the job.

** Affects: neutron
     Importance: High
         Status: New


** Tags: gate-failure linuxbridge tempest

** Changed in: neutron
   Importance: Undecided => High

** Tags added: gate-failure linuxbridge

** Tags added: tempest

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1705567

Title:
  gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial failed with
  timeout

Status in neutron:
  New

Bug description:
  http://logs.openstack.org/85/385085/30/gate/gate-tempest-dsvm-neutron-
  linuxbridge-ubuntu-xenial/75e271d/console.html

  2017-07-20 19:18:32.693567 | full runtests: commands[2] | tempest run --combine --serial --regex (?!.*\[.*\bslow\b.*\])(^tempest\.scenario) --concurrency=4
  2017-07-20 19:18:38.317292 | running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
  2017-07-20 19:18:38.317404 | OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
  2017-07-20 19:18:38.317449 | OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
  2017-07-20 19:18:38.317501 | OS_TEST_LOCK_PATH=${OS_TEST_LOCK_PATH:-${TMPDIR:-'/tmp'}} \
  2017-07-20 19:18:38.317574 | ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --list 
  2017-07-20 19:18:38.317621 | running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
  2017-07-20 19:18:38.317657 | OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
  2017-07-20 19:18:38.317692 | OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
  2017-07-20 19:18:38.317733 | OS_TEST_LOCK_PATH=${OS_TEST_LOCK_PATH:-${TMPDIR:-'/tmp'}} \
  2017-07-20 19:18:38.317814 | ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover}  --load-list /tmp/tmpqrNAOh
  2017-07-20 19:20:27.479411 | {0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [101.261843s] ... ok
  2017-07-20 19:20:27.479460 | 
  2017-07-20 19:20:27.479481 | Captured stderr:
  2017-07-20 19:20:27.479498 | ~~~~~~~~~~~~~~~~
  2017-07-20 19:20:27.479565 |     /opt/stack/new/tempest/.tox/tempest/local/lib/python2.7/site-packages/cryptography/hazmat/backends/openssl/rsa.py:477: DeprecationWarning: signer and verifier have been deprecated. Please use sign and verify instead.
  2017-07-20 19:20:27.479587 |       _warn_sign_verify_deprecated()
  2017-07-20 19:20:27.479600 |     
  2017-07-20 19:22:09.799157 | {0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_reboot [93.151292s] ... ok
  2017-07-20 19:23:37.650731 | {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic [84.459821s] ... ok
  2017-07-20 19:25:34.994829 | {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [117.306077s] ... ok
  2017-07-20 19:28:02.218494 | {0} tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_slaac [143.769198s] ... ok
  2017-07-20 19:28:05.681801 | {0} tempest.scenario.test_object_storage_basic_ops.TestObjectStorageBasicOps.test_swift_basic_ops [0.381328s] ... ok
  2017-07-20 19:30:17.429097 | {0} tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic [128.538566s] ... ok
  2017-07-20 19:31:43.217495 | {0} tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_in_tenant_traffic [85.784122s] ... ok
  2017-07-20 19:32:41.287100 | {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops [49.211398s] ... ok
  2017-07-20 19:32:48.257653 | {0} setUpClass (tempest.scenario.test_server_multinode.TestServerMultinode) ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
  2017-07-20 19:33:30.275095 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks [30.113681s] ... ok
  2017-07-20 19:34:42.975903 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_create_ebs_image_and_check_boot [72.662936s] ... ok
  2017-07-20 19:37:50.719757 | {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [187.710856s] ... ok
  2017-07-20 19:38:03.835802 | /home/jenkins/workspace/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/devstack-gate/functions.sh: line 1127: 12175 Killed                  timeout -s 9 ${REMAINING_TIME}m bash -c "source $WORKSPACE/devstack-gate/functions.sh && $cmd"
  2017-07-20 19:38:03.835887 | ERROR: the main setup script run by this job failed - exit code: 137
  2017-07-20 19:38:03.845801 |     please look at the relevant log files to determine the root cause

  It's not fully clear why despite --concurrency=4, it looks like a
  single test thread is running. That being said, the slow tests had
  only 20 minutes to run before being abrupted, so it may as well be an
  issue in the previous phase of the job.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1705567/+subscriptions