yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem@xxxxxxxxxx>]

Public bug reported:

This appears to be spiking since 7/22:

http://logs.openstack.org/80/200380/3/gate/gate-tempest-dsvm-neutron-
full/2b49b0d/console.html#_2015-07-22_09_57_50_146

2015-07-22 09:57:50.146 | tempest.scenario.test_network_v6.TestGettingAddress.test_multi_prefix_slaac[compute,id-dec222b1-180c-4098-b8c5-cc1b8342d611,network]
2015-07-22 09:57:50.146 | ------------------------------------------------------------------------------------------------------------------------------------
2015-07-22 09:57:50.146 | 
2015-07-22 09:57:50.146 | Captured traceback:
2015-07-22 09:57:50.146 | ~~~~~~~~~~~~~~~~~~~
2015-07-22 09:57:50.147 |     Traceback (most recent call last):
2015-07-22 09:57:50.147 |       File "tempest/test.py", line 126, in wrapper
2015-07-22 09:57:50.147 |         return f(self, *func_args, **func_kwargs)
2015-07-22 09:57:50.147 |       File "tempest/scenario/test_network_v6.py", line 183, in test_multi_prefix_slaac
2015-07-22 09:57:50.147 |         self._prepare_and_test(address6_mode='slaac', n_subnets6=2)
2015-07-22 09:57:50.147 |       File "tempest/scenario/test_network_v6.py", line 150, in _prepare_and_test
2015-07-22 09:57:50.147 |         result = sshv4_2.ping_host(ips_from_api_1['4'])
2015-07-22 09:57:50.147 |       File "tempest/common/utils/linux/remote_client.py", line 101, in ping_host
2015-07-22 09:57:50.147 |         return self.exec_command(cmd)
2015-07-22 09:57:50.147 |       File "tempest/common/utils/linux/remote_client.py", line 56, in exec_command
2015-07-22 09:57:50.147 |         return self.ssh_client.exec_command(cmd)
2015-07-22 09:57:50.147 |       File "/opt/stack/new/tempest/.tox/full/local/lib/python2.7/site-packages/tempest_lib/common/ssh.py", line 146, in exec_command
2015-07-22 09:57:50.148 |         strerror=''.join(err_data))
2015-07-22 09:57:50.148 |     tempest_lib.exceptions.SSHExecCommandFailed: Command 'set -eu -o pipefail; PATH=$PATH:/sbin; ping -c1 -w1 -s56 10.100.0.3', exit status: 1, Error:

There are so many errors in the neutron logs for false negatives that I
can't really tell what could be causing the failures, see related bug
1455320 and related bug 1477190.

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiQ29tbWFuZCAnc2V0IC1ldSAtbyBwaXBlZmFpbDsgUEFUSD0kUEFUSDovc2JpbjsgcGluZyAtYzEgLXcxIC1zNTZcIiBBTkQgTk9UIGJ1aWxkX3F1ZXVlOlwiZXhwZXJpbWVudGFsXCIgQU5EIHRhZ3M6XCJjb25zb2xlXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0Mzc1NzU4NzgzNTYsIm1vZGUiOiIiLCJhbmFseXplX2ZpZWxkIjoiIn0=

** Affects: neutron
     Importance: High
         Status: Confirmed

** Changed in: neutron
       Status: New => Confirmed

** Changed in: neutron
   Importance: Undecided => High

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1477192

Title:
  neutron test_multi_prefix_slaac failing in the gate with ping failures
  starting around 7/22

Status in neutron:
  Confirmed

Bug description:
  This appears to be spiking since 7/22:

  http://logs.openstack.org/80/200380/3/gate/gate-tempest-dsvm-neutron-
  full/2b49b0d/console.html#_2015-07-22_09_57_50_146

  2015-07-22 09:57:50.146 | tempest.scenario.test_network_v6.TestGettingAddress.test_multi_prefix_slaac[compute,id-dec222b1-180c-4098-b8c5-cc1b8342d611,network]
  2015-07-22 09:57:50.146 | ------------------------------------------------------------------------------------------------------------------------------------
  2015-07-22 09:57:50.146 | 
  2015-07-22 09:57:50.146 | Captured traceback:
  2015-07-22 09:57:50.146 | ~~~~~~~~~~~~~~~~~~~
  2015-07-22 09:57:50.147 |     Traceback (most recent call last):
  2015-07-22 09:57:50.147 |       File "tempest/test.py", line 126, in wrapper
  2015-07-22 09:57:50.147 |         return f(self, *func_args, **func_kwargs)
  2015-07-22 09:57:50.147 |       File "tempest/scenario/test_network_v6.py", line 183, in test_multi_prefix_slaac
  2015-07-22 09:57:50.147 |         self._prepare_and_test(address6_mode='slaac', n_subnets6=2)
  2015-07-22 09:57:50.147 |       File "tempest/scenario/test_network_v6.py", line 150, in _prepare_and_test
  2015-07-22 09:57:50.147 |         result = sshv4_2.ping_host(ips_from_api_1['4'])
  2015-07-22 09:57:50.147 |       File "tempest/common/utils/linux/remote_client.py", line 101, in ping_host
  2015-07-22 09:57:50.147 |         return self.exec_command(cmd)
  2015-07-22 09:57:50.147 |       File "tempest/common/utils/linux/remote_client.py", line 56, in exec_command
  2015-07-22 09:57:50.147 |         return self.ssh_client.exec_command(cmd)
  2015-07-22 09:57:50.147 |       File "/opt/stack/new/tempest/.tox/full/local/lib/python2.7/site-packages/tempest_lib/common/ssh.py", line 146, in exec_command
  2015-07-22 09:57:50.148 |         strerror=''.join(err_data))
  2015-07-22 09:57:50.148 |     tempest_lib.exceptions.SSHExecCommandFailed: Command 'set -eu -o pipefail; PATH=$PATH:/sbin; ping -c1 -w1 -s56 10.100.0.3', exit status: 1, Error:

  There are so many errors in the neutron logs for false negatives that
  I can't really tell what could be causing the failures, see related
  bug 1455320 and related bug 1477190.

  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiQ29tbWFuZCAnc2V0IC1ldSAtbyBwaXBlZmFpbDsgUEFUSD0kUEFUSDovc2JpbjsgcGluZyAtYzEgLXcxIC1zNTZcIiBBTkQgTk9UIGJ1aWxkX3F1ZXVlOlwiZXhwZXJpbWVudGFsXCIgQU5EIHRhZ3M6XCJjb25zb2xlXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0Mzc1NzU4NzgzNTYsIm1vZGUiOiIiLCJhbmFseXplX2ZpZWxkIjoiIn0=

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1477192/+subscriptions