yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2051831] Re: [ovn] neutron-ovn-tempest-slow job fail tests relying on FIP

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: OpenStack Infra <2051831@xxxxxxxxxxxxxxxxxx>
Date: Mon, 22 Jul 2024 10:32:14 -0000
Reply-to: Bug 2051831 <2051831@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Reviewed:  https://review.opendev.org/c/openstack/neutron/+/907313
Committed: https://opendev.org/openstack/neutron/commit/413793fa086eddce7bf5fea0141c20ca270de780
Submitter: "Zuul (22348)"
Branch:    master

commit 413793fa086eddce7bf5fea0141c20ca270de780
Author: Rodolfo Alonso Hernandez <ralonsoh@xxxxxxxxxx>
Date:   Mon Jan 29 23:47:06 2024 +0000

    Add "subnet-external-network" extension to "subnet" resource
    
    Added a new extension called "subnet-external-network". This extension
    adds a new field to the subnet resource: "router:external". It is named
    after the field "router:external" in the network resource. The subnet
    inherits the value form the network it belongs.
    
    Subnet OVO: the subnet OVO receives a new field called "external", same
    as the network OVO. It is a synthetic field inherited from the network
    one.
    
    Filter query: same as the network database query, the subnet database
    query receives a new extra filter to add the action
    "access_as_external", inherited from the network RBAC. It is needed
    to be able to retrieve these subnets that belong to external network
    and thus visible by a non-admin user.
    
    The minimum neutron-lib version required is 3.11.0 that contains the
    patch [1].
    
    [1]https://review.opendev.org/c/openstack/neutron-lib/+/907949
    
    Depends-On: https://review.opendev.org/c/openstack/tempest/+/922938
    Depends-On: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/922711
    Depends-On: https://review.opendev.org/c/openstack/neutron-lib/+/912273
    
    Closes-Bug: #2051831
    Change-Id: Ice91de9ae7f82b983579272af6e2bf10c3a02dbf


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2051831

Title:
  [ovn] neutron-ovn-tempest-slow job fail  tests relying on FIP

Status in neutron:
  Fix Released

Bug description:
  Example failure:-
  https://2f4a32f753edcd6fd518-38c49964a79149719549049b602122d6.ssl.cf5.rackcdn.com/906628/1/experimental/neutron-
  ovn-tempest-slow/1b35fb8/testr_results.html

  Fails as:-
  Traceback (most recent call last):
    File "/opt/stack/tempest/tempest/scenario/test_security_groups_basic_ops.py", line 191, in setUp
      self._deploy_tenant(self.primary_tenant)
    File "/opt/stack/tempest/tempest/scenario/test_security_groups_basic_ops.py", line 354, in _deploy_tenant
      self._set_access_point(tenant)
    File "/opt/stack/tempest/tempest/scenario/test_security_groups_basic_ops.py", line 321, in _set_access_point
      self._assign_floating_ips(tenant, server)
    File "/opt/stack/tempest/tempest/scenario/test_security_groups_basic_ops.py", line 325, in _assign_floating_ips
      floating_ip = self.create_floating_ip(
    File "/opt/stack/tempest/tempest/scenario/manager.py", line 1132, in create_floating_ip
      result = client.create_floatingip(**floatingip_kwargs)
    File "/opt/stack/tempest/tempest/lib/services/network/floating_ips_client.py", line 30, in create_floatingip
      return self.create_resource(uri, post_data)
    File "/opt/stack/tempest/tempest/lib/services/network/base.py", line 62, in create_resource
      resp, body = self.post(req_uri, req_post_data)
    File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 300, in post
      return self.request('POST', url, extra_headers, headers, body, chunked)
    File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 742, in request
      self._error_checker(resp, resp_body)
    File "/opt/stack/tempest/tempest/lib/common/rest_client.py", line 852, in _error_checker
      raise exceptions.NotFound(resp_body, resp=resp)
  tempest.lib.exceptions.NotFound: Object not found
  Details: {'type': 'ExternalGatewayForFloatingIPNotFound', 'message': 'External network 43cd92cd-4957-4770-9945-584e8d4da9e3 is not reachable from subnet e354d5ec-5be0-4536-9348-fd819e3f7464.  Therefore, cannot associate Port 63869e58-05b8-4a18-be25-77500966df61 with a Floating IP.', 'detail': ''}

  neutron-server trace:-
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn [None req-1674312b-7443-4d41-bd9b-5f69f5173083 tempest-TestNetworkAdvancedServerOps-1277687553 tempest-TestNetworkAdvancedServerOps-1277687553-project-member] Unable to add router interface to lrouter 31bdd6ba-45cf-45bd-aa3d-907a217ce2a3. Interface info: {'id': '31bdd6ba-45cf-45bd-aa3d-907a217ce2a3', 'tenant_id': 'f7ebd951642c4987ad034d6180f81784', 'port_id': 'f8606824-f658-4634-b9ce-2f8e2ce0d1c3', 'network_id': '2f74ef7b-8374-4f36-a4bf-fbf225b87c48', 'subnet_id': 'd61fb992-2d87-4198-82f1-a687609c3e7c', 'subnet_ids': ['d61fb992-2d87-4198-82f1-a687609c3e7c']}: neutron_lib.exceptions.SubnetNotFound: Subnet a283b869-2e54-44da-b109-06da46933d06 could not be found.
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn Traceback (most recent call last):
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/services/ovn_l3/service_providers/ovn.py", line 122, in _process_add_router_interface
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self.l3plugin._ovn_client.create_router_port(context, router.id,
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1754, in create_router_port
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self._update_lrouter_port(context, router_port,
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1762, in _update_lrouter_port
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self._get_nets_and_ipv6_ra_confs_for_router_port(context, port))
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1236, in _get_nets_and_ipv6_ra_confs_for_router_port
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     subnet = self._plugin.get_subnet(context, subnet_id)
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/db/api.py", line 223, in wrapped
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     return f_with_retry(*args, **kwargs,
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/db/api.py", line 137, in wrapped
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     with excutils.save_and_reraise_exception():
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self.force_reraise()
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     raise self.value
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/db/api.py", line 135, in wrapped
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     return f(*args, **kwargs)
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     with excutils.save_and_reraise_exception() as ectxt:
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self.force_reraise()
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     raise self.value
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     return f(*args, **kwargs)
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/db/api.py", line 183, in wrapped
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     with excutils.save_and_reraise_exception():
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     self.force_reraise()
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     raise self.value
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/db/api.py", line 181, in wrapped
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     return f(*dup_args, **dup_kwargs)
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1184, in get_subnet
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     subnet_obj = self._get_subnet_object(context, id)
  Jan 26 15:10:35.544611 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn   File "/opt/stack/neutron/neutron/db/db_base_plugin_common.py", line 282, in _get_subnet_object
  Jan 26 15:10:35.550111 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn     raise exceptions.SubnetNotFound(subnet_id=id)
  Jan 26 15:10:35.550111 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn neutron_lib.exceptions.SubnetNotFound: Subnet a283b869-2e54-44da-b109-06da46933d06 could not be found.
  Jan 26 15:10:35.550111 np0036547416 neutron-server[63495]: ERROR neutron.services.ovn_l3.service_providers.ovn 

  
  Builds:- https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-slow&project=openstack%2Fneutron&branch=master&skip=0

  Recently merged patches[1] seems to have triggered this, other neutron
  ovn scenario job likely not impacted as those explicitly enable
  extensions.

  [1] https://review.opendev.org/q/topic:%222023-aa-l3-gw-
  multihoming%22+status:merged+file:neutron/common/ovn/extensions.py

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2051831/+subscriptions
References

[Bug 2051831] [NEW] [ovn] neutron-ovn-tempest-slow job fail tests relying on FIP
From: yatin, 2024-01-31