← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1398349] [NEW] nova service-update fails for services on non-child (top) cell

 

Public bug reported:

Nova service-update fails for services on non-child (top) cell.

How to reproduce:
1) List available services using below command.
$ nova --os-username admin service-list

Output:
+----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+
| region!child@1 | nova-conductor | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:36.000000 | - |
| region!child@3 | nova-cells | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:29.000000 | - |
| region!child@4 | nova-scheduler | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:30.000000 | - |
| region!child@5 | nova-compute | region!child@ubuntu | nova | enabled | up | 2014-08-18T06:17:31.000000 | - |
| region@1 | nova-cells | region@ubuntu | internal | enabled | up | 2014-08-18T06:17:29.000000 | - |
| region@2 | nova-cert | region@ubuntu | internal | enabled | down | 2014-08-18T06:08:28.000000 | - |
| region@3 | nova-consoleauth | region@ubuntu | internal | enabled | up | 2014-08-18T06:17:37.000000 | - |
+----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+

2) disable one of the services on top cell (e.g. nova-cert)
$ nova --os-username admin service-disable 'region@ubuntu' nova-cert

The above command gives the following error:
a) On user console:
ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-529f926f-fbda-4748-afb7-dfe8c7cc7877)

b) In nova-api logs, it shows following error message:
2014-12-01 00:50:08.459 TRACE nova.api.openstack Traceback (most recent call last):
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2014-12-01 00:50:08.459 TRACE nova.api.openstack     incoming.message))
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2014-12-01 00:50:08.459 TRACE nova.api.openstack     return self._do_dispatch(endpoint, method, ctxt, args)
2014-12-01 00:50:08.459 TRACE nova.api.openstack
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2014-12-01 00:50:08.459 TRACE nova.api.openstack     result = getattr(endpoint, method)(ctxt, **new_args)
2014-12-01 00:50:08.459 TRACE nova.api.openstack
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/manager.py", line 296, in service_update
2014-12-01 00:50:08.459 TRACE nova.api.openstack     service = response.value_or_raise()
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/messaging.py", line 407, in process
2014-12-01 00:50:08.459 TRACE nova.api.openstack     next_hop = self._get_next_hop()
2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/messaging.py", line 362, in _get_next_hop
2014-12-01 00:50:08.459 TRACE nova.api.openstack     dest_hops = target_cell.count(_PATH_CELL_SEP)
2014-12-01 00:50:08.459 TRACE nova.api.openstack
2014-12-01 00:50:08.459 TRACE nova.api.openstack AttributeError: 'NoneType' object has no attribute 'count'

** Affects: nova
     Importance: Undecided
     Assignee: Rajesh Tailor (rajesh-tailor)
         Status: New


** Tags: ntt

** Changed in: nova
     Assignee: (unassigned) => Rajesh Tailor (rajesh-tailor)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1398349

Title:
  nova service-update fails for services on non-child (top) cell

Status in OpenStack Compute (Nova):
  New

Bug description:
  Nova service-update fails for services on non-child (top) cell.

  How to reproduce:
  1) List available services using below command.
  $ nova --os-username admin service-list

  Output:
  +----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+
  | Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
  +----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+
  | region!child@1 | nova-conductor | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:36.000000 | - |
  | region!child@3 | nova-cells | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:29.000000 | - |
  | region!child@4 | nova-scheduler | region!child@ubuntu | internal | enabled | up | 2014-08-18T06:17:30.000000 | - |
  | region!child@5 | nova-compute | region!child@ubuntu | nova | enabled | up | 2014-08-18T06:17:31.000000 | - |
  | region@1 | nova-cells | region@ubuntu | internal | enabled | up | 2014-08-18T06:17:29.000000 | - |
  | region@2 | nova-cert | region@ubuntu | internal | enabled | down | 2014-08-18T06:08:28.000000 | - |
  | region@3 | nova-consoleauth | region@ubuntu | internal | enabled | up | 2014-08-18T06:17:37.000000 | - |
  +----------------+------------------+---------------------+----------+---------+-------+----------------------------+-----------------+

  2) disable one of the services on top cell (e.g. nova-cert)
  $ nova --os-username admin service-disable 'region@ubuntu' nova-cert

  The above command gives the following error:
  a) On user console:
  ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-529f926f-fbda-4748-afb7-dfe8c7cc7877)

  b) In nova-api logs, it shows following error message:
  2014-12-01 00:50:08.459 TRACE nova.api.openstack Traceback (most recent call last):
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     incoming.message))
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     return self._do_dispatch(endpoint, method, ctxt, args)
  2014-12-01 00:50:08.459 TRACE nova.api.openstack
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     result = getattr(endpoint, method)(ctxt, **new_args)
  2014-12-01 00:50:08.459 TRACE nova.api.openstack
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/manager.py", line 296, in service_update
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     service = response.value_or_raise()
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/messaging.py", line 407, in process
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     next_hop = self._get_next_hop()
  2014-12-01 00:50:08.459 TRACE nova.api.openstack   File "/opt/stack/nova/nova/cells/messaging.py", line 362, in _get_next_hop
  2014-12-01 00:50:08.459 TRACE nova.api.openstack     dest_hops = target_cell.count(_PATH_CELL_SEP)
  2014-12-01 00:50:08.459 TRACE nova.api.openstack
  2014-12-01 00:50:08.459 TRACE nova.api.openstack AttributeError: 'NoneType' object has no attribute 'count'

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1398349/+subscriptions


Follow ups

References