yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1529090] [NEW] nova-compute status is down when add computer service

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: carl <carl.a.gao@xxxxxxxxxxxxxxxxxx>
Date: Thu, 24 Dec 2015 13:16:55 -0000
Reply-to: Bug 1529090 <1529090@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

nova-compute status is down when add computer service.

On controller node:
[root@controller nova]# nova service-list
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary           | Host       | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
| 1  | nova-cert        | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
| 2  | nova-consoleauth | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
| 3  | nova-conductor   | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
| 4  | nova-scheduler   | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
| 5  | nova-compute     | compute1   | nova     | enabled | down  | -                          | -               |
+----+------------------+------------+----------+---------+-------+----------------------------+-----------------+

I check the log in computer node, it seems there are some errors:
2015-12-24 16:54:12.361 19487 INFO nova.virt.driver [-] Loading compute driver 'libvirt.LibvirtDriver'
2015-12-24 16:54:12.368 19487 INFO nova.openstack.common.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
2015-12-24 16:54:12.427 19487 INFO oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] Connecting to AMQP server on controller:5672
2015-12-24 16:54:12.438 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 1 seconds.
2015-12-24 16:54:13.447 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
2015-12-24 16:54:14.457 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
2015-12-24 16:54:15.467 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
2015-12-24 16:54:16.477 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.

2015-12-24 20:52:18.977 31446 ERROR nova.openstack.common.threadgroup
[req-b01b80f5-3131-4cca-9e23-07118ee91b8f - - - - -] Remote error:
OperationalError (_mysql_exceptions.OperationalError) (1045, "Access
denied for user 'nova'@'135.252.226.147' (using password: YES)")

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1529090

Title:
  nova-compute status is down when add computer service

Status in OpenStack Compute (nova):
  New

Bug description:
  nova-compute status is down when add computer service.

  On controller node:
  [root@controller nova]# nova service-list
  +----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
  | Id | Binary           | Host       | Zone     | Status  | State | Updated_at                 | Disabled Reason |
  +----+------------------+------------+----------+---------+-------+----------------------------+-----------------+
  | 1  | nova-cert        | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
  | 2  | nova-consoleauth | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
  | 3  | nova-conductor   | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
  | 4  | nova-scheduler   | controller | internal | enabled | up    | 2015-12-24T13:05:52.000000 | -               |
  | 5  | nova-compute     | compute1   | nova     | enabled | down  | -                          | -               |
  +----+------------------+------------+----------+---------+-------+----------------------------+-----------------+

  I check the log in computer node, it seems there are some errors:
  2015-12-24 16:54:12.361 19487 INFO nova.virt.driver [-] Loading compute driver 'libvirt.LibvirtDriver'
  2015-12-24 16:54:12.368 19487 INFO nova.openstack.common.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
  2015-12-24 16:54:12.427 19487 INFO oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] Connecting to AMQP server on controller:5672
  2015-12-24 16:54:12.438 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 1 seconds.
  2015-12-24 16:54:13.447 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
  2015-12-24 16:54:14.457 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
  2015-12-24 16:54:15.467 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.
  2015-12-24 16:54:16.477 19487 ERROR oslo_messaging._drivers.impl_rabbit [req-6b60921d-1d17-4a36-bb7e-89572e0b54cc - - - - -] AMQP server on controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 2 seconds.

  2015-12-24 20:52:18.977 31446 ERROR nova.openstack.common.threadgroup
  [req-b01b80f5-3131-4cca-9e23-07118ee91b8f - - - - -] Remote error:
  OperationalError (_mysql_exceptions.OperationalError) (1045, "Access
  denied for user 'nova'@'135.252.226.147' (using password: YES)")

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1529090/+subscriptions
Follow ups

[Bug 1529090] Re: nova-compute status is down when add computer service
From: Yaguang Tang, 2015-12-25