yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1818649] Re: [pike] neutron-lbaasv2 with barbican error: LookupError: Container XXXXX could not be found

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Grzegorz Grasza <1818649@xxxxxxxxxxxxxxxxxx>
Date: Tue, 25 Apr 2023 10:48:17 -0000
Reply-to: Bug 1818649 <1818649@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Closing out bugs created before migration to StoryBoard. Please re-open
if you are of the opinion it is still current.

** Changed in: barbican
       Status: New => Won't Fix

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1818649

Title:
  [pike] neutron-lbaasv2 with barbican error:  LookupError: Container
  XXXXX could not be found

Status in Barbican:
  Won't Fix
Status in neutron:
  Invalid

Bug description:
  Is there any configuration method about neutron_lbaasv2?. this problem
  troubled me a long time, the doc is not very well. my lbaas'es config
  file has been changed many times, but it didn't work.

  my openstack version is pike.

  It was relate to https://bugs.launchpad.net/barbican/+bug/1689846, but
  my environment is lbaasv2, not octavia.

  I tried create tls listener throuth through lbaasv2, there will be a
  right response on CLI. And neutron-server.log was all right, but there
  will be an ERROR in lbaas-agent.log, the log is bellow.

  ----------------------------------------------------------------------------------------------------------------------------------------------------
  2019-03-05 18:47:52.427 14045 INFO neutron_lbaas.common.cert_manager.barbican_cert_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Loading certificate container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a from Barbican.
  2019-03-05 18:47:52.428 14045 DEBUG barbicanclient.v1.containers [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Getting container - Container href: http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a get /usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py:537
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Error getting http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a: LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager Traceback (most recent call last):
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 174, in get_cert
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager     container_ref=cert_ref
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager   File "/usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py", line 543, in get
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager     .format(container_ref))
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
  2019-03-05 18:47:52.429 14045 ERROR neutron_lbaas.common.cert_manager.barbican_cert_manager
  2019-03-05 18:47:52.430 14045 DEBUG oslo_concurrency.lockutils [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Lock "haproxy-driver" released by "neutron_lbaas.drivers.haproxy.namespace_driver.deploy_instance" :: held 2.682s inner /usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:282
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager [req-6e0b798e-b10c-4132-8665-dfe1122133bb cdb0fbe60ff84eaf932ba6a90dd030b2 502990c9fd4d442693e8d818b01051b5 - - -] Create listener 73a3aacc-3e81-4cee-aec9-1f0fa9cb61ca failed on device driver haproxy_ns: LookupError: Container http://192.168.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager Traceback (most recent call last):
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/agent/agent_manager.py", line 303, in create_listener
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     driver.listener.create(listener)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 480, in create
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     self.driver.loadbalancer.refresh(listener.loadbalancer)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 444, in refresh
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     if (not self.driver.deploy_instance(loadbalancer) and
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     return f(*args, **kwargs)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 214, in deploy_instance
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     self.create(loadbalancer)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 242, in create
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     self._spawn(loadbalancer)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 399, in _spawn
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 90, in save_config
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 234, in render_loadbalancer_obj
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     loadbalancer = _transform_loadbalancer(loadbalancer, haproxy_base_dir)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 249, in _transform_loadbalancer
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     for x in loadbalancer.listeners if x.admin_state_up]
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 290, in _transform_listener
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     certs = _process_tls_certificates(listener)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/drivers/haproxy/jinja_cfg.py", line 162, in _process_tls_certificates
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     check_only=True
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 185, in get_cert
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     LOG.exception("Error getting {0}".format(cert_ref))
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     self.force_reraise()
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     six.reraise(self.type_, self.value, self.tb)
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/neutron_lbaas/common/cert_manager/barbican_cert_manager.py", line 174, in get_cert
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     container_ref=cert_ref
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager   File "/usr/lib/python2.7/site-packages/barbicanclient/v1/containers.py", line 543, in get
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager     .format(container_ref))
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager LookupError: Container http://192.179.10.10:9311/v1/containers/25670926-0f89-42b6-9fe6-05083d59736a could not be found.
  2019-03-05 18:47:52.430 14045 ERROR neutron_lbaas.agent.agent_manager
  2019-03-05 18:47:55.026 14045 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats run_periodic_tasks /usr/lib/python2.7/site-packages/oslo_service/periodic_task.py:215

  ________________________________________________________________________________________________________________________________________
  my config file is :
  neutron_lbaas.conf

  [DEFAULT]
  [certificates]
  cert_manager_type = barbican
  barbican_auth = barbican_acl_auth
  storage_path = /var/lib/neutron-lbaas/certificates/
  [quotas]
  quota_loadbalancer = -1
  quota_listener = -1
  quota_pool = -1
  quota_member = -1
  quota_healthmonitor = -1
  [service_auth]
  auth_url = http://keystone-ha-vip:5000/v2.0
  admin_user = admin
  admin_tenant_name = admin
  admin_password = XXX
  admin_user_domain = default
  admin_project_domain = default
  region = RegionOne
  auth_version = 2
  endpoint_type = public
  [service_providers]
  service_provider = LOADBALANCERV2:Haproxy:neutron_lbaas.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default

  _____________________________________________________________________________________________________________________________________
  cat /etc/neutron/lbaas_agent.ini | grep ^[^#]
  [DEFAULT]
  interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
  ovs_use_veth = True
  verbose = true
  device_driver = neutron_lbaas.drivers.haproxy.namespace_driver.HaproxyNSDriver
  ovs_integration_bridge = br-int
  [haproxy]
  user_group = haproxy

To manage notifications about this bug go to:
https://bugs.launchpad.net/barbican/+bug/1818649/+subscriptions
References

[Bug 1818649] [NEW] [pike] neutron-lbaasv2 with barbican error: LookupError: Container XXXXX could not be found
From: miaoyuliang, 2019-03-05