← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1539056] [NEW] nova service-list failed when one or some cell-service exception of multiple child cells

 

Public bug reported:

1. version
kilo 2015.1.0

2. Relevant log

2016-01-28 20:16:27.232 26909 ERROR nova.cells.messaging [req-8daf498b-d2ae-42e6-9089-40046ec550d3 f04e318acd7e4e5093c91e6dc74a28c3 53adc6d6825b43378d6ab89fc38051da - - -] Error waiting for responses from neighbor cells
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging Traceback (most recent call last):
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging   File "/usr/lib/python2.7/site-packages/nova/cells/messaging.py", line 549, in process
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging     num_responses=len(next_hops))
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging   File "/usr/lib/python2.7/site-packages/nova/cells/messaging.py", line 235, in _wait_for_json_responses
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging     raise exception.CellTimeout()
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging CellTimeout: Timeout waiting for response from cell
2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging 

3. Reproduce steps:

3.1 environment described

I have a api cell node:api-cell,
two child cell node: child-cell-01 child-cell-02,
and each child_cell have one compute node

3.2 
excuate “systemctl stop openstack-nova-cells.service” on  child-cell-01

openstack-nova-cells.service - OpenStack Nova Cells Server
   Loaded: loaded (/usr/lib/systemd/system/openstack-nova-cells.service; enabled)
   Active: inactive (dead) since Thu 2016-01-28 19:54:50 CST; 24min ago
  Process: 2566 ExecStart=/usr/bin/nova-cells (code=exited, status=0/SUCCESS)
 Main PID: 2566 (code=exited, status=0/SUCCESS)
 

3.3 excuate “nova service-list” on api-cell
Expected result: list all service and status(Tolerance does not contain service on child-cell-01 and it‘s compute node)
Actual result : ERROR, log reference section 2


4
Only one or some cell’s service exception of many child cell lead to nova service-list failed isunreasonable

** Affects: nova
     Importance: Undecided
     Assignee: jinquanni(ZTE) (ni-jinquan)
         Status: New


** Tags: cells

** Changed in: nova
     Assignee: (unassigned) => jinquanni(ZTE) (ni-jinquan)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1539056

Title:
  nova service-list failed when one or some cell-service exception  of
  multiple child cells

Status in OpenStack Compute (nova):
  New

Bug description:
  1. version
  kilo 2015.1.0

  2. Relevant log

  2016-01-28 20:16:27.232 26909 ERROR nova.cells.messaging [req-8daf498b-d2ae-42e6-9089-40046ec550d3 f04e318acd7e4e5093c91e6dc74a28c3 53adc6d6825b43378d6ab89fc38051da - - -] Error waiting for responses from neighbor cells
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging Traceback (most recent call last):
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging   File "/usr/lib/python2.7/site-packages/nova/cells/messaging.py", line 549, in process
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging     num_responses=len(next_hops))
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging   File "/usr/lib/python2.7/site-packages/nova/cells/messaging.py", line 235, in _wait_for_json_responses
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging     raise exception.CellTimeout()
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging CellTimeout: Timeout waiting for response from cell
  2016-01-28 20:16:27.232 26909 TRACE nova.cells.messaging 

  3. Reproduce steps:

  3.1 environment described

  I have a api cell node:api-cell,
  two child cell node: child-cell-01 child-cell-02,
  and each child_cell have one compute node

  3.2 
  excuate “systemctl stop openstack-nova-cells.service” on  child-cell-01

  openstack-nova-cells.service - OpenStack Nova Cells Server
     Loaded: loaded (/usr/lib/systemd/system/openstack-nova-cells.service; enabled)
     Active: inactive (dead) since Thu 2016-01-28 19:54:50 CST; 24min ago
    Process: 2566 ExecStart=/usr/bin/nova-cells (code=exited, status=0/SUCCESS)
   Main PID: 2566 (code=exited, status=0/SUCCESS)
   

  3.3 excuate “nova service-list” on api-cell
  Expected result: list all service and status(Tolerance does not contain service on child-cell-01 and it‘s compute node)
  Actual result : ERROR, log reference section 2

  
  4
  Only one or some cell’s service exception of many child cell lead to nova service-list failed isunreasonable

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1539056/+subscriptions


Follow ups