← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #94252

[Bug 2073251] [NEW] linuxbridge/ovs jobs fails randomly as Test vms not getting ip from dhcp agent

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

Fails as:-
Traceback (most recent call last):
  File "/opt/stack/tempest/tempest/common/utils/__init__.py", line 84, in wrapper
    return func(*func_args, **func_kwargs)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/neutron_tempest_plugin/scenario/test_dhcp.py", line 89, in test_extra_dhcp_opts
    vm_resolv_conf = ssh_client.exec_command(
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 330, in wrapped_f
    return self(f, *args, **kw)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 467, in __call__
    do = self.iter(retry_state=retry_state)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 368, in iter
    result = action(retry_state)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 390, in <lambda>
    self._add_action_func(lambda rs: rs.outcome.result())
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 470, in __call__
    result = fn(*args, **kwargs)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/neutron_tempest_plugin/common/ssh.py", line 172, in exec_command
    return super(Client, self).exec_command(cmd=cmd, encoding=encoding)
  File "/opt/stack/tempest/tempest/lib/common/ssh.py", line 187, in exec_command
    ssh = self._get_ssh_connection()
  File "/opt/stack/tempest/tempest/lib/common/ssh.py", line 155, in _get_ssh_connection
    raise exceptions.SSHTimeout(host=self.host,
tempest.lib.exceptions.SSHTimeout: Connection to the 172.24.5.36 via SSH timed out.
User: cirros, Password: None


as per console log:-
### ifconfig -a
eth0      Link encap:Ethernet  HWaddr FA:16:3E:24:0A:F6  
          inet addr:169.254.208.255  Bcast:169.254.255.255  Mask:255.255.0.0
          inet6 addr: fe80::f816:3eff:fe24:af6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1380  Metric:1
          RX packets:16 errors:0 dropped:0 overruns:0 frame:0
          TX packets:63 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:1276 (1.2 KiB)  TX bytes:4194 (4.0 KiB)

Example failure:-
- https://c0aee8855dbd0037f598-9d06690275593a686ed77270ace0c4ac.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-linuxbridge-tempest-plugin-nftables/575af76/testr_results.html
- https://zuul.opendev.org/t/openstack/build/cc4b44f0b09746e6b43f159b9f24c686
- https://zuul.opendev.org/t/openstack/build/791bb2725c9f4aa69f537f033b3c3ba2

Linux bridge jobs failing more frequently:-
- https://zuul.openstack.org/builds?job_name=neutron-tempest-plugin-linuxbridge&job_name=neutron-linuxbridge-tempest-plugin-nftables&project=openstack%2Fneutron&branch=master&skip=0

Seems to be triggered by
https://review.opendev.org/c/openstack/neutron/+/923625/1/neutron/agent/dhcp/agent.py#371

** Affects: neutron
     Importance: Critical
     Assignee: yatin (yatinkarel)
         Status: Triaged


** Tags: gate-failure linuxbridge ovs

** Changed in: neutron
       Status: New => Triaged

** Changed in: neutron
   Importance: Undecided => Critical

** Tags added: gate-failure linuxbridge ovs

** Changed in: neutron
     Assignee: (unassigned) => yatin (yatinkarel)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2073251

Title:
  linuxbridge/ovs jobs fails randomly as Test vms not getting ip from
  dhcp agent

Status in neutron:
  Triaged

Bug description:
  Fails as:-
  Traceback (most recent call last):
    File "/opt/stack/tempest/tempest/common/utils/__init__.py", line 84, in wrapper
      return func(*func_args, **func_kwargs)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/neutron_tempest_plugin/scenario/test_dhcp.py", line 89, in test_extra_dhcp_opts
      vm_resolv_conf = ssh_client.exec_command(
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 330, in wrapped_f
      return self(f, *args, **kw)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 467, in __call__
      do = self.iter(retry_state=retry_state)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 368, in iter
      result = action(retry_state)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 390, in <lambda>
      self._add_action_func(lambda rs: rs.outcome.result())
    File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
      return self.__get_result()
    File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
      raise self._exception
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/tenacity/__init__.py", line 470, in __call__
      result = fn(*args, **kwargs)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.10/site-packages/neutron_tempest_plugin/common/ssh.py", line 172, in exec_command
      return super(Client, self).exec_command(cmd=cmd, encoding=encoding)
    File "/opt/stack/tempest/tempest/lib/common/ssh.py", line 187, in exec_command
      ssh = self._get_ssh_connection()
    File "/opt/stack/tempest/tempest/lib/common/ssh.py", line 155, in _get_ssh_connection
      raise exceptions.SSHTimeout(host=self.host,
  tempest.lib.exceptions.SSHTimeout: Connection to the 172.24.5.36 via SSH timed out.
  User: cirros, Password: None

  
  as per console log:-
  ### ifconfig -a
  eth0      Link encap:Ethernet  HWaddr FA:16:3E:24:0A:F6  
            inet addr:169.254.208.255  Bcast:169.254.255.255  Mask:255.255.0.0
            inet6 addr: fe80::f816:3eff:fe24:af6/64 Scope:Link
            UP BROADCAST RUNNING MULTICAST  MTU:1380  Metric:1
            RX packets:16 errors:0 dropped:0 overruns:0 frame:0
            TX packets:63 errors:0 dropped:0 overruns:0 carrier:0
            collisions:0 txqueuelen:1000 
            RX bytes:1276 (1.2 KiB)  TX bytes:4194 (4.0 KiB)

  Example failure:-
  - https://c0aee8855dbd0037f598-9d06690275593a686ed77270ace0c4ac.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-linuxbridge-tempest-plugin-nftables/575af76/testr_results.html
  - https://zuul.opendev.org/t/openstack/build/cc4b44f0b09746e6b43f159b9f24c686
  - https://zuul.opendev.org/t/openstack/build/791bb2725c9f4aa69f537f033b3c3ba2

  Linux bridge jobs failing more frequently:-
  - https://zuul.openstack.org/builds?job_name=neutron-tempest-plugin-linuxbridge&job_name=neutron-linuxbridge-tempest-plugin-nftables&project=openstack%2Fneutron&branch=master&skip=0

  Seems to be triggered by
  https://review.opendev.org/c/openstack/neutron/+/923625/1/neutron/agent/dhcp/agent.py#371

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2073251/+subscriptions
  Thread Previous • Date Previous • • Thread Next