yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem.os@xxxxxxxxx>]

Public bug reported:

Seen here:

http://logs.openstack.org/46/487246/2/experimental/gate-tempest-dsvm-
neutron-dvr-ha-multinode-full-ubuntu-xenial-nv/6cd2a5b/logs/devstack-
gate-discover-hosts.txt.gz

localhost | SUCCESS | rc=0 >>
Found 2 cell mappings.
Skipping cell0 since it does not contain hosts.
Getting compute nodes from cell 'cell1': a7345ef4-6c48-4c4a-912f-4c1f93b7f880
DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" acquired by "nova.context.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270}}
DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" released by "nova.context.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:282}}
Found 2 unmapped computes in cell: a7345ef4-6c48-4c4a-912f-4c1f93b7f880
Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7
Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7

This is due to caching the DB/MQ connections in the request context and
locking on them:

https://github.com/openstack/nova/commit/f4159d17552603b90912dba6fe5c604e8d0b8aa7

** Affects: nova
     Importance: Medium
     Assignee: Matt Riedemann (mriedem)
         Status: In Progress

** Affects: nova/newton
     Importance: Medium
         Status: Confirmed

** Affects: nova/ocata
     Importance: Medium
         Status: Confirmed


** Tags: nova-manage

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1707001

Title:
  Ugly oslo.concurrency DEBUG output when running nova-manage cell_v2
  discover_hosts

Status in OpenStack Compute (nova):
  In Progress
Status in OpenStack Compute (nova) newton series:
  Confirmed
Status in OpenStack Compute (nova) ocata series:
  Confirmed

Bug description:
  Seen here:

  http://logs.openstack.org/46/487246/2/experimental/gate-tempest-dsvm-
  neutron-dvr-ha-multinode-full-ubuntu-xenial-nv/6cd2a5b/logs/devstack-
  gate-discover-hosts.txt.gz

  localhost | SUCCESS | rc=0 >>
  Found 2 cell mappings.
  Skipping cell0 since it does not contain hosts.
  Getting compute nodes from cell 'cell1': a7345ef4-6c48-4c4a-912f-4c1f93b7f880
  DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" acquired by "nova.context.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270}}
  DEBUG oslo_concurrency.lockutils [None req-510b4930-f0e6-4e15-b8a3-0b7064249e68 None None] Lock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" released by "nova.context.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:282}}
  Found 2 unmapped computes in cell: a7345ef4-6c48-4c4a-912f-4c1f93b7f880
  Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
  Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb
  Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7
  Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7

  This is due to caching the DB/MQ connections in the request context
  and locking on them:

  https://github.com/openstack/nova/commit/f4159d17552603b90912dba6fe5c604e8d0b8aa7

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1707001/+subscriptions