yahoo-eng-team team mailing list archive

[OpenStack Infra <1537076@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.openstack.org/273129
Committed: https://git.openstack.org/cgit/openstack/ironic/commit/?id=fde62528afd5c88737999a3deabeba6c2d389e88
Submitter: Jenkins
Branch:    master

commit fde62528afd5c88737999a3deabeba6c2d389e88
Author: Dmitry Tantsur <dtantsur@xxxxxxxxxx>
Date:   Wed Jan 27 17:10:58 2016 +0100

    [devstack] Restart nova compute before checking hypervisor stats
    
    Nova compute may fail if it was unable to fetch nodes list from Ironic
    during startup. This change makes sure we restart it.
    
    Change-Id: Ibddd34faa0eeb9b42fe0e8d73f14907b1df11734
    Closes-Bug: #1537076


** Changed in: ironic
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1537076

Title:
  Timed out waiting for Nova hypervisor-stats count >= 1 due to Nova
  Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens

Status in Ironic:
  Fix Released
Status in OpenStack Compute (nova):
  In Progress

Bug description:
  e.g. seems like http://logs.openstack.org/61/246161/12/check/gate-
  tempest-dsvm-ironic-pxe_ipa-
  ipxe/169b905/logs/screen-n-cpu.txt.gz?#_2016-01-22_09_01_00_240 causes
  http://logs.openstack.org/61/246161/12/check/gate-tempest-dsvm-ironic-
  pxe_ipa-ipxe/169b905/logs/devstacklog.txt.gz#_2016-01-22_09_08_19_910

  Traceback (most recent call last):
    File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 115, in wait
      listener.cb(fileno)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main
      result = function(*args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/oslo_service/service.py", line 671, in run_service
      service.start()
    File "/opt/stack/new/nova/nova/service.py", line 198, in start
      self.manager.pre_start_hook()
    File "/opt/stack/new/nova/nova/compute/manager.py", line 1340, in pre_start_hook
      self.update_available_resource(nova.context.get_admin_context())
    File "/opt/stack/new/nova/nova/compute/manager.py", line 6290, in update_available_resource
      nodenames = set(self.driver.get_available_nodes())
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 554, in get_available_nodes
      self._refresh_cache()
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 537, in _refresh_cache
      for node in self._get_node_list(detail=True, limit=0):
    File "/opt/stack/new/nova/nova/virt/ironic/driver.py", line 476, in _get_node_list
      node_list = self.ironicclient.call("node.list", **kwargs)
    File "/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 136, in call
      client = self._get_client(retry_on_conflict=retry_on_conflict)
    File "/opt/stack/new/nova/nova/virt/ironic/client_wrapper.py", line 86, in _get_client
      cli = ironic.client.get_client(CONF.ironic.api_version, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/ironicclient/client.py", line 86, in get_client
      _ksclient = _get_ksclient(**ks_kwargs)
    File "/usr/local/lib/python2.7/dist-packages/ironicclient/client.py", line 35, in _get_ksclient
      insecure=kwargs.get('insecure'))
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py", line 166, in __init__
      self.authenticate()
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/utils.py", line 337, in inner
      return func(*args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/httpclient.py", line 589, in authenticate
      resp = self.get_raw_token_from_identity_service(**kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py", line 210, in get_raw_token_from_identity_service
      _("Authorization Failed: %s") % e)
  AuthorizationFailure: Authorization Failed: Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/1537076/+subscriptions