yahoo-eng-team team mailing list archive

[OpenStack Infra <1789484@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.openstack.org/598353
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=df058720434cdca2726eb8c16f323a98bfc73ce3
Submitter: Zuul
Branch:    master

commit df058720434cdca2726eb8c16f323a98bfc73ce3
Author: Dan Smith <dansmith@xxxxxxxxxx>
Date:   Thu Aug 30 14:18:16 2018 -0700

    Move conductor wait_until_ready() delay before manager init
    
    The Service base class already waits for conductor to be responsive
    before allowing service startup to continue. However, it does this
    after the manager __init__, which could do some things expecting
    conductor to be up (and does now in compute). This moves the check
    and wait loop above the manager init so we don't start anything in
    the manager until we know conductor is alive.
    
    Change-Id: Ib56fdb38839434d504fadccbeda65ab2e267b514
    Closes-Bug: #1789484


** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1789484

Title:
  n-cpu fails init on timeout calling n-cond-cell1

Status in OpenStack Compute (nova):
  Fix Released
Status in OpenStack Compute (nova) queens series:
  Triaged
Status in OpenStack Compute (nova) rocky series:
  In Progress

Bug description:
  We've seen several cases now where n-cpu fails to start in gate runs.
  It appears that during the service init it tries to call out to the
  cell1 conductor. Logs show n-cond-cell1 did start about 1 second
  before this, but maybe too soon to accept API calls. Traceback in the
  n-cpu log has the message:

  "MessagingTimeout: Timed out waiting for a reply to message ID"

  http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-
  nova.2018-08-28.log.html#t2018-08-28T19:28:52

  http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22_determine_version_cap%5C%22%20AND%20tags:%5C%22screen-n-cpu.txt%5C%22&from=7d

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1789484/+subscriptions