yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2083483] [NEW] [ovn-octavia-provider] [neutron]/endpoint_type is not respected

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Rico Lin <2083483@xxxxxxxxxxxxxxxxxx>
Date: Wed, 02 Oct 2024 07:36:24 -0000
Reply-to: Bug 2083483 <2083483@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

Found same issue as https://bugs.launchpad.net/octavia/+bug/2049551 on
ovn-octavia-provider


2024-10-01 17:32:42.655 13 ERROR futurist.periodics [-] Failed to call immediate 'ovn_octavia_provider.maintenance.DBInconsistenciesPeriodics.change_device_owner_lb_hm_ports' (it runs every 600.00 seconds): keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://network.192-168-1-135.nip.io/v2.0/ports: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 715, in urlopen
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     httplib_response = self._make_request(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 404, in _make_request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self._validate_conn(conn)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1058, in _validate_conn
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     conn.connect()
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connection.py", line 419, in connect
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self.sock = ssl_wrap_socket(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     ssl_sock = _ssl_wrap_socket_impl(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 513, in wrap_socket
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.sslsocket_class._create(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 1100, in _create
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self.do_handshake()
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 1371, in do_handshake
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self._sslobj.do_handshake()
2024-10-01 17:32:42.655 13 ERROR futurist.periodics ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = conn.urlopen(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 799, in urlopen
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     retries = retries.increment(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise MaxRetryError(_pool, url, error or ResponseError(cause))
2024-10-01 17:32:42.655 13 ERROR futurist.periodics urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 1021, in _send_request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = self.session.request(method, url, **kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = self.send(prep, **send_kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     r = adapter.send(request, **kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/adapters.py", line 517, in send
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise SSLError(e, request=request)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics requests.exceptions.SSLError: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 290, in run
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     work()
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 64, in __call__
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 178, in decorator
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return f(*args, **kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/maintenance.py", line 88, in change_device_owner_lb_hm_ports
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     for port in ovn_lb_hm_ports:
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 2087, in list
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     response = session.get(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/adapter.py", line 393, in get
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.request(url, 'GET', **kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/proxy.py", line 190, in request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     response = super().request(
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/adapter.py", line 255, in request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.session.request(url, method, **kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 930, in request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = send(**kwargs)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 1025, in _send_request
2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise exceptions.SSLError(msg)
2024-10-01 17:32:42.655 13 ERROR futurist.periodics keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://network.192-168-1-135.nip.io/v2.0/ports: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
2024-10-01 17:32:42.655 13 ERROR futurist.periodics

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2083483

Title:
  [ovn-octavia-provider] [neutron]/endpoint_type is not respected

Status in neutron:
  New

Bug description:
  Found same issue as https://bugs.launchpad.net/octavia/+bug/2049551 on
  ovn-octavia-provider

  
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics [-] Failed to call immediate 'ovn_octavia_provider.maintenance.DBInconsistenciesPeriodics.change_device_owner_lb_hm_ports' (it runs every 600.00 seconds): keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://network.192-168-1-135.nip.io/v2.0/ports: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 715, in urlopen
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     httplib_response = self._make_request(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 404, in _make_request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self._validate_conn(conn)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1058, in _validate_conn
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     conn.connect()
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connection.py", line 419, in connect
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self.sock = ssl_wrap_socket(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     ssl_sock = _ssl_wrap_socket_impl(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 513, in wrap_socket
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.sslsocket_class._create(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 1100, in _create
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self.do_handshake()
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/usr/lib/python3.10/ssl.py", line 1371, in do_handshake
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     self._sslobj.do_handshake()
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = conn.urlopen(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/connectionpool.py", line 799, in urlopen
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     retries = retries.increment(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise MaxRetryError(_pool, url, error or ResponseError(cause))
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 1021, in _send_request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = self.session.request(method, url, **kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = self.send(prep, **send_kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     r = adapter.send(request, **kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/requests/adapters.py", line 517, in send
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise SSLError(e, request=request)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics requests.exceptions.SSLError: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics During handling of the above exception, another exception occurred:
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics 
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics Traceback (most recent call last):
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 290, in run
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     work()
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 64, in __call__
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/futurist/periodics.py", line 178, in decorator
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return f(*args, **kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/maintenance.py", line 88, in change_device_owner_lb_hm_ports
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     for port in ovn_lb_hm_ports:
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 2087, in list
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     response = session.get(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/adapter.py", line 393, in get
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.request(url, 'GET', **kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/proxy.py", line 190, in request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     response = super().request(
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/adapter.py", line 255, in request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     return self.session.request(url, method, **kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 930, in request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     resp = send(**kwargs)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics   File "/var/lib/openstack/lib/python3.10/site-packages/keystoneauth1/session.py", line 1025, in _send_request
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics     raise exceptions.SSLError(msg)
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics keystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://network.192-168-1-135.nip.io/v2.0/ports: HTTPSConnectionPool(host='network.192-168-1-135.nip.io', port=443): Max retries exceeded with url: /v2.0/ports?device_owner=network%3Adistributed (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))
  2024-10-01 17:32:42.655 13 ERROR futurist.periodics

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2083483/+subscriptions