yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1736468] Re: glance-scrubber does not work using SSL

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Brian Rosmaita <rosmaita.fossdev@xxxxxxxxx>
Date: Fri, 09 Feb 2018 16:27:14 -0000
Reply-to: Bug 1736468 <1736468@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
As of Queens, the scrubber no longer contacts the glance registry (which
required keystone authentication), but instead goes directly to the
database.

Fixed by Change-Id: I26f570b85617200880543b7114730a1ac76d3fb1

** Changed in: glance
   Importance: Undecided => Low

** Changed in: glance
       Status: New => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1736468

Title:
  glance-scrubber does not work using SSL

Status in Glance:
  Fix Released

Bug description:
  Using glance registry and glance api over SSL, glance-scrubber doe not
  work in Ocata.

  This is the error i'm getting :

  glance-scrubber  --config-file /etc/glance/glance-scrubber.conf

  Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.870 950 DEBUG glance_store.backend [-] Attempting to import store cinder _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.871 950 DEBUG glance_store.backend [-] Attempting to import store file _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.871 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.cinder.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.872 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.filesystem.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.872 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.http.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.872 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.rbd.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.873 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.sheepdog.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.873 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.swift.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.873 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.vmware_datastore.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.874 950 DEBUG glance_store.backend [-] Attempting to import store http _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.874 950 DEBUG glance_store.backend [-] Attempting to import store no_conf _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.874 950 DEBUG glance_store.backend [-] Attempting to import store rbd _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.875 950 DEBUG glance_store.backend [-] Attempting to import store sheepdog _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.875 950 DEBUG glance_store.backend [-] Attempting to import store swift _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.876 950 DEBUG glance_store.backend [-] Attempting to import store vmware _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.876 950 DEBUG glance_store.backend [-] Registering options for group glance_store register_opts /usr/lib/python2.7/site-packages/glance_store/backend.py:160
  2017-12-05 10:17:15.876 950 DEBUG glance_store.backend [-] Registering options for group glance_store register_opts /usr/lib/python2.7/site-packages/glance_store/backend.py:160
  2017-12-05 10:17:15.877 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.filesystem.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.878 950 DEBUG glance_store.capabilities [-] Store glance_store._drivers.filesystem.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. update_capabilities /usr/lib/python2.7/site-packages/glance_store/capabilities.py:97
  2017-12-05 10:17:15.878 950 DEBUG glance_store.backend [-] Registering store glance.store.filesystem.Store with schemes ('file', 'filesystem') create_stores /usr/lib/python2.7/site-packages/glance_store/backend.py:278
  2017-12-05 10:17:15.879 950 DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.filesystem.StoreLocation get_store_location_class /usr/lib/python2.7/site-packages/glance_store/driver.py:89
  2017-12-05 10:17:15.879 950 DEBUG glance_store.location [-] Registering scheme file with {'location_class': <class 'glance_store._drivers.filesystem.StoreLocation'>, 'store': <glance_store._drivers.filesystem.Store object at 0x4285910>, 'store_entry': 'glance.store.filesystem.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.879 950 DEBUG glance_store.location [-] Registering scheme filesystem with {'location_class': <class 'glance_store._drivers.filesystem.StoreLocation'>, 'store': <glance_store._drivers.filesystem.Store object at 0x4285910>, 'store_entry': 'glance.store.filesystem.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.880 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.rbd.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.880 950 DEBUG glance_store.capabilities [-] Store glance_store._drivers.rbd.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. update_capabilities /usr/lib/python2.7/site-packages/glance_store/capabilities.py:97
  2017-12-05 10:17:15.881 950 DEBUG glance_store.backend [-] Registering store glance.store.rbd.Store with schemes ('rbd',) create_stores /usr/lib/python2.7/site-packages/glance_store/backend.py:278
  2017-12-05 10:17:15.881 950 DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.rbd.StoreLocation get_store_location_class /usr/lib/python2.7/site-packages/glance_store/driver.py:89
  2017-12-05 10:17:15.881 950 DEBUG glance_store.location [-] Registering scheme rbd with {'location_class': <class 'glance_store._drivers.rbd.StoreLocation'>, 'store': <glance_store._drivers.rbd.Store object at 0x4290910>, 'store_entry': 'glance.store.rbd.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.882 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.http.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.882 950 DEBUG glance_store.capabilities [-] Store glance_store._drivers.http.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. update_capabilities /usr/lib/python2.7/site-packages/glance_store/capabilities.py:97
  2017-12-05 10:17:15.882 950 DEBUG glance_store.backend [-] Registering store glance.store.http.Store with schemes ('http', 'https') create_stores /usr/lib/python2.7/site-packages/glance_store/backend.py:278
  2017-12-05 10:17:15.883 950 DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.http.StoreLocation get_store_location_class /usr/lib/python2.7/site-packages/glance_store/driver.py:89
  2017-12-05 10:17:15.883 950 DEBUG glance_store.location [-] Registering scheme http with {'location_class': <class 'glance_store._drivers.http.StoreLocation'>, 'store': <glance_store._drivers.http.Store object at 0x30ea190>, 'store_entry': 'glance.store.http.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.884 950 DEBUG glance_store.location [-] Registering scheme https with {'location_class': <class 'glance_store._drivers.http.StoreLocation'>, 'store': <glance_store._drivers.http.Store object at 0x30ea190>, 'store_entry': 'glance.store.http.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.884 950 DEBUG glance_store.backend [-] Attempting to import store glance.store.rbd.Store _load_store /usr/lib/python2.7/site-packages/glance_store/backend.py:231
  2017-12-05 10:17:15.885 950 DEBUG glance_store.capabilities [-] Store glance_store._drivers.rbd.Store doesn't support updating dynamic storage capabilities. Please overwrite 'update_capabilities' method of the store to implement updating logics if needed. update_capabilities /usr/lib/python2.7/site-packages/glance_store/capabilities.py:97
  2017-12-05 10:17:15.885 950 DEBUG glance_store.driver [-] Late loading location class glance_store._drivers.rbd.StoreLocation get_store_location_class /usr/lib/python2.7/site-packages/glance_store/driver.py:89
  2017-12-05 10:17:15.886 950 DEBUG glance_store.location [-] Registering scheme rbd with {'location_class': <class 'glance_store._drivers.rbd.StoreLocation'>, 'store': <glance_store._drivers.rbd.Store object at 0x512bbd0>, 'store_entry': 'glance.store.rbd.Store'} register_scheme_map /usr/lib/python2.7/site-packages/glance_store/location.py:88
  2017-12-05 10:17:15.886 950 INFO glance.scrubber [-] Initializing scrubber with configuration: {'registry_host': '10.54.132.10', 'registry_port': 9191}
  2017-12-05 10:17:15.887 950 WARNING oslo_config.cfg [-] Option "use_user_token" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.888 950 WARNING oslo_config.cfg [-] Option "auth_url" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.888 950 WARNING oslo_config.cfg [-] Option "admin_user" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.889 950 WARNING oslo_config.cfg [-] Option "admin_password" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.889 950 WARNING oslo_config.cfg [-] Option "admin_tenant_name" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  2017-12-05 10:17:15.891 950 DEBUG oslo_policy._cache_handler [req-27c9a13f-9731-4f4b-9335-88cc8654d561 - - - - -] Reloading cached file /etc/glance/policy.json read_cached_file /usr/lib/python2.7/site-packages/oslo_policy/_cache_handler.py:40
  2017-12-05 10:17:15.892 950 DEBUG oslo_policy.policy [req-27c9a13f-9731-4f4b-9335-88cc8654d561 - - - - -] Reloaded policy file: /etc/glance/policy.json _load_policy_file /usr/lib/python2.7/site-packages/oslo_policy/policy.py:666
  2017-12-05 10:17:15.894 950 DEBUG oslo_policy._cache_handler [req-358bbeea-e848-4a53-a5e4-37680d7182f3 glance service - - -] Reloading cached file /etc/glance/policy.json read_cached_file /usr/lib/python2.7/site-packages/oslo_policy/_cache_handler.py:40
  2017-12-05 10:17:15.896 950 DEBUG oslo_policy.policy [req-358bbeea-e848-4a53-a5e4-37680d7182f3 glance service - - -] Reloaded policy file: /etc/glance/policy.json _load_policy_file /usr/lib/python2.7/site-packages/oslo_policy/policy.py:666
  2017-12-05 10:17:15.898 950 DEBUG oslo_policy._cache_handler [req-3c963f92-9f4a-45a9-94d7-00c638d744b9 - - - - -] Reloading cached file /etc/glance/policy.json read_cached_file /usr/lib/python2.7/site-packages/oslo_policy/_cache_handler.py:40
  2017-12-05 10:17:15.899 950 DEBUG oslo_policy.policy [req-3c963f92-9f4a-45a9-94d7-00c638d744b9 - - - - -] Reloaded policy file: /etc/glance/policy.json _load_policy_file /usr/lib/python2.7/site-packages/oslo_policy/policy.py:666
  2017-12-05 10:17:15.901 950 DEBUG oslo_policy._cache_handler [req-c7088b44-2e8c-44a5-8ca7-8d20cb5eca42 glance service - - -] Reloading cached file /etc/glance/policy.json read_cached_file /usr/lib/python2.7/site-packages/oslo_policy/_cache_handler.py:40
  2017-12-05 10:17:15.903 950 DEBUG oslo_policy.policy [req-c7088b44-2e8c-44a5-8ca7-8d20cb5eca42 glance service - - -] Reloaded policy file: /etc/glance/policy.json _load_policy_file /usr/lib/python2.7/site-packages/oslo_policy/policy.py:666
  2017-12-05 10:17:16.192 950 DEBUG glance.common.client [req-c7088b44-2e8c-44a5-8ca7-8d20cb5eca42 glance service - - -] Constructed URL: https://10.54.132.10:9191/images/detail?deleted=True&is_public=none&status=pending_delete _construct_url /usr/lib/python2.7/site-packages/glance/common/client.py:402
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client [req-c7088b44-2e8c-44a5-8ca7-8d20cb5eca42 glance service - - -] Registry client request GET /images/detail raised ClientConnectionError
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client Traceback (most recent call last):
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client   File "/usr/lib/python2.7/site-packages/glance/registry/client/v1/client.py", line 124, in do_request
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client     **kwargs)
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client   File "/usr/lib/python2.7/site-packages/glance/common/client.py", line 71, in wrapped
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client     return func(self, *args, **kwargs)
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client   File "/usr/lib/python2.7/site-packages/glance/common/client.py", line 374, in do_request
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client     headers=copy.deepcopy(headers))
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client   File "/usr/lib/python2.7/site-packages/glance/common/client.py", line 88, in wrapped
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client     return func(self, method, url, body, headers)
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client   File "/usr/lib/python2.7/site-packages/glance/common/client.py", line 551, in _do_request
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client     raise exception.ClientConnectionError(e)
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client ClientConnectionError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)
  2017-12-05 10:17:16.206 950 ERROR glance.registry.client.v1.client
  2017-12-05 10:17:16.208 950 ERROR glance.scrubber [req-c7088b44-2e8c-44a5-8ca7-8d20cb5eca42 glance service - - -] Can not get scrub jobs from queue: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)

  My glance-scrubber config file :

  
  [DEFAULT]
  verbose = true
  debug = true
  log_file = /var/log/glance/scrubber.log

  daemon = False
  wakeup_time = 300
  scrub_time = 86400
  scrub_pool_size = 1

  registry_host = x.x.x.10
  registry_port = 9191
  enable_v2_api = true
  enable_v2_registry = true
  enable_v1_registry = false
  enable_v1_api = false

  https_ca_certificates_file = https_insecure
  https_insecure = true
  insecure = true
  registry_client_protocol = https
  registry_client_insecure = true

  auth_uri = https://x.x.x.200:5000/v2.0/
  auth_url = https://x.x.x.200:5000/v2.0/
  identity_uri = https://x.x.x.200:35357
  admin_tenant_name = service
  use_user_token = true
  auth_strategy = keystone
  auth_type = password
  admin_user = glance
  admin_password = xxxx

  [glance_store]
  insecure = true
  rbd_store_ceph_conf = /etc/ceph/ceph.conf
  rbd_store_chunk_size = 8
  rbd_store_user = glance.nubeliu
  rbd_store_pool = nubeliu_images
  default_store = rbd
  stores = glance.store.filesystem.Store,
                 glance.store.http.Store,
                 glance.store.rbd.Store

  [database]

  sql_connection = mysql+pymysql://glance:xxxx@x.x.x.200/glance
  sql_idle_timeout = 3600
  use_db_reconnect = True

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1736468/+subscriptions
References

[Bug 1736468] [NEW] glance-scrubber does not work using SSL
From: Maximiliano, 2017-12-05