yahoo-eng-team team mailing list archive

[Dmitry Tantsur <divius.inside@xxxxxxxxx>]

New finding: it looks like keystone does not even start when the failure
happens. We should probably NOT fail Nova on start up if we can't
connect to it...

** Also affects: nova
   Importance: Undecided
       Status: New

** Tags added: ironic

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1537076

Title:
  Timed out waiting for Nova hypervisor-stats count >= 1 due to Nova
  Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens

Status in Ironic:
  Confirmed
Status in OpenStack Compute (nova):
  New

Bug description:
  e.g. seems like http://logs.openstack.org/61/246161/12/check/gate-
  tempest-dsvm-ironic-pxe_ipa-
  ipxe/169b905/logs/screen-n-cpu.txt.gz?#_2016-01-22_09_01_00_240 causes
  http://logs.openstack.org/61/246161/12/check/gate-tempest-dsvm-ironic-
  pxe_ipa-ipxe/169b905/logs/devstacklog.txt.gz#_2016-01-22_09_08_19_910

  Traceback (most recent call last):
    File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 115, in wait
      listener.cb(fileno)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main
      result = function(*args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 671, in run_service
      service.start()
    File "/opt/stack/new/nova/nova/service.py", line 198, in start
      self.manager.pre_start_hook()
    File "/opt/stack/new/nova/nova/compute/manager.py", line 1340, in pre_start_hook
      self.update_available_resource(nova.context.get_admin_context())
    File "/opt/stack/new/nova/nova/compute/manager.py", line 6290, in update_available_resource
      nodenames = set(self.driver.get_available_nodes())
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 554, in get_available_nodes
      self._refresh_cache()
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 537, in _refresh_cache
      for node in self._get_node_list(detail=True, limit=0):
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 476, in _get_node_list
      node_list = self.ironicclient.call("node.list", **kwargs)
    File "/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 136, in call
      client = self._get_client(retry_on_conflict=retry_on_conflict)
    File "/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 86, in _get_client
      cli = ironic.client.get_client(CONF.ironic.api_version, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/ironicclient/client.py", line 86, in get_client
      _ksclient = _get_ksclient(**ks_kwargs)
    File "/usr/local/lib/python2.7/dist-packages/ironicclient/client.py", line 35, in _get_ksclient
      insecure=kwargs.get('insecure'))
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py", line 166, in __init__
      self.authenticate()
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/utils.py", line 337, in inner
      return func(*args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/httpclient.py", line 589, in authenticate
      resp = self.get_raw_token_from_identity_service(**kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py", line 210, in get_raw_token_from_identity_service
      _("Authorization Failed: %s") % e)
  AuthorizationFailure: Authorization Failed: Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/1537076/+subscriptions