← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1969199] [NEW] nova-compute in down state (servicegroup_driver=mc)

 

Public bug reported:

Description
===========

Nova services such as: 
  nova-api-os-compute
  nova-conductor
  nova-consoleauth
  nova-metadata-api
  nova-novncproxy
  nova-scheduler

 > Running on controller nodes (api's) on python3

nova-compute running on python2 on hypervisors hosts (qemu-kvm based)

IF servicegroup_driver=mc (nova.conf):
nova service-list see nova-compute nodes in down state

BUT 
IF servicegroup_driver=db it works perfectly fine: 
nova service-list see nova-compute nodes in up state

ALSO 
IF servicegroup_driver=mc and all nova services running on python2: 
nova service-list see nova-compute nodes in up state

Steps to reproduce
==================
1.Run 
  nova-api-os-compute
  nova-conductor
  nova-consoleauth
  nova-metadata-api
  nova-novncproxy
  nova-scheduler on python3

Run nova-compute on python2

2. Set servicegroup_driver=mc
3. Execute nova service-list

Expected result
===============
All nova services in actual up state 

Actual result
=============

nova-compute in down state

Environment
===========

nova-manage --version
19.3.2

Logs & Configs
==============
nova-compute -> rabbitmq (there is no connection errors,  rabbit available from hosts)

___

nova-conductor logs: 
Apr 13 08:59:08 api2 nova-conductor[1738632]: 2022-04-13 08:59:07,629.629 1 DEBUG nova.servicegroup.drivers.mc [req-26f2e991-af2b-4cde-9cd5-cf8525cbb0ef None None] Memcached_Driver: join new ServiceGroup service = <Service: host=api2, binary=nova-conductor, manager_class_name=nova.conductor.manager.ConductorManager> join /var/lib/openstack/lib/python3.6/site-packages/nova/servicegroup/drivers/mc.py:51

___

nova-api:
e27454b47c0b360072cbbf07008] Seems service compute:cmp1 is down is_up /var/lib/openstack/lib/python3.6/site-packages/nova/servicegroup/drivers/mc.py:68
__

So, I'm a little confused, because there is no Rabbit connection
problems (one of possible reason with this behaviour)

I guess problem connected with: 
nova-api - memcached - nova-compute

I'll appreciate any help with debug.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1969199

Title:
  nova-compute in down state (servicegroup_driver=mc)

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========

  Nova services such as: 
    nova-api-os-compute
    nova-conductor
    nova-consoleauth
    nova-metadata-api
    nova-novncproxy
    nova-scheduler

   > Running on controller nodes (api's) on python3

  nova-compute running on python2 on hypervisors hosts (qemu-kvm based)

  IF servicegroup_driver=mc (nova.conf):
  nova service-list see nova-compute nodes in down state

  BUT 
  IF servicegroup_driver=db it works perfectly fine: 
  nova service-list see nova-compute nodes in up state

  ALSO 
  IF servicegroup_driver=mc and all nova services running on python2: 
  nova service-list see nova-compute nodes in up state

  Steps to reproduce
  ==================
  1.Run 
    nova-api-os-compute
    nova-conductor
    nova-consoleauth
    nova-metadata-api
    nova-novncproxy
    nova-scheduler on python3

  Run nova-compute on python2

  2. Set servicegroup_driver=mc
  3. Execute nova service-list

  Expected result
  ===============
  All nova services in actual up state 

  Actual result
  =============

  nova-compute in down state

  Environment
  ===========

  nova-manage --version
  19.3.2

  Logs & Configs
  ==============
  nova-compute -> rabbitmq (there is no connection errors,  rabbit available from hosts)

  ___

  nova-conductor logs: 
  Apr 13 08:59:08 api2 nova-conductor[1738632]: 2022-04-13 08:59:07,629.629 1 DEBUG nova.servicegroup.drivers.mc [req-26f2e991-af2b-4cde-9cd5-cf8525cbb0ef None None] Memcached_Driver: join new ServiceGroup service = <Service: host=api2, binary=nova-conductor, manager_class_name=nova.conductor.manager.ConductorManager> join /var/lib/openstack/lib/python3.6/site-packages/nova/servicegroup/drivers/mc.py:51

  ___

  nova-api:
  e27454b47c0b360072cbbf07008] Seems service compute:cmp1 is down is_up /var/lib/openstack/lib/python3.6/site-packages/nova/servicegroup/drivers/mc.py:68
  __

  So, I'm a little confused, because there is no Rabbit connection
  problems (one of possible reason with this behaviour)

  I guess problem connected with: 
  nova-api - memcached - nova-compute

  I'll appreciate any help with debug.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1969199/+subscriptions



Follow ups