← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #41314

[Bug 1517151] [NEW] Compute node looks for RabbitMQ server in localhost instead of the Controller node ignoring nova.conf configuration

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

OS = Ubuntu 14.04.3 LTS (GNU/Linux 3.13.0-68-generic x86_64)
Openstack = Liberty
Nova version = 2.17.0


Log info
Compute Node

/var/log/nova/nova-compute.log

2015-11-17 11:20:17.827 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 29 seconds.
2015-11-17 11:20:46.852 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
2015-11-17 11:20:46.852 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
2015-11-17 11:20:47.868 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
2015-11-17 11:21:17.894 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
2015-11-17 11:21:17.895 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
2015-11-17 11:21:18.911 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
2015-11-17 11:21:48.937 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
2015-11-17 11:21:48.937 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
2015-11-17 11:21:49.953 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
2015-11-17 11:22:19.979 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
2015-11-17 11:22:19.980 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
2015-11-17 11:22:20.992 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
2015-11-17 11:22:51.017 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
2015-11-17 11:22:51.018 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...

Compute Node
/etc/nova/nova.conf

[DEFAULT]
debug = True
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
iscsi_helper=tgtadm
libvirt_use_virtio_for_bridges=True
connection_type=libvirt
root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
volumes_path=/var/lib/nova/volumes
enabled_apis=ec2,osapi_compute,metadata
rpc_backend = rabbit
auth_strategy = keystone
my_ip = 192.168.1.14
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver


[oslo_messaging_rabbit]
rabbit_host = 192.168.1.13
rabbit_userid = openstack
rabbit_password = ********


Steps

- Fist, I installed Ubuntu 14.04.3 LTS in 2 physical boxes, Controller (cloud03 - 192.168.1.13) and Compute (cloud04 -192.68.1.14)
- Then I did the base configuration on both nodes according to http://docs.openstack.org/liberty/install-guide-ubuntu/environment-packages.html
 - Then I follow the steps to configur/install the  Controller node, Add the SQL Database, then the Message queue , then add the Identity service, then Add the image Sevice.
- Then configure the Compute service for the controller node
 - Then configure the compute service for the compute node (cloud03 - 192.168.1.14) according to http://docs.openstack.org/liberty/install-guide-ubuntu/nova-compute-install.html
-Then restart the nova-compute service

Expected result

compute node should be able to communicate with the controller node

Actual Result:

Compute node tries to connect to the RabbitMQ server in localhost
instead of the server specified in the   [oslo_messaging_rabbit] section
in the /etc/nova/nova.conf file, however, if this values are moved to
the [DEFAULT] section, the compute node is able to connect to the
controller node

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: nova rabbitmq

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1517151

Title:
  Compute node looks for RabbitMQ server in localhost instead of the
  Controller node ignoring nova.conf configuration

Status in OpenStack Compute (nova):
  New

Bug description:
  OS = Ubuntu 14.04.3 LTS (GNU/Linux 3.13.0-68-generic x86_64)
  Openstack = Liberty
  Nova version = 2.17.0

  
  Log info
  Compute Node

  /var/log/nova/nova-compute.log

  2015-11-17 11:20:17.827 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 29 seconds.
  2015-11-17 11:20:46.852 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
  2015-11-17 11:20:46.852 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
  2015-11-17 11:20:47.868 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
  2015-11-17 11:21:17.894 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
  2015-11-17 11:21:17.895 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
  2015-11-17 11:21:18.911 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
  2015-11-17 11:21:48.937 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
  2015-11-17 11:21:48.937 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
  2015-11-17 11:21:49.953 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
  2015-11-17 11:22:19.979 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
  2015-11-17 11:22:19.980 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...
  2015-11-17 11:22:20.992 2543 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on localhost:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
  2015-11-17 11:22:51.017 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Reconnecting to AMQP server on localhost:5672
  2015-11-17 11:22:51.018 2543 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 1.0 seconds...

  Compute Node
  /etc/nova/nova.conf

  [DEFAULT]
  debug = True
  dhcpbridge_flagfile=/etc/nova/nova.conf
  dhcpbridge=/usr/bin/nova-dhcpbridge
  logdir=/var/log/nova
  state_path=/var/lib/nova
  lock_path=/var/lock/nova
  force_dhcp_release=True
  iscsi_helper=tgtadm
  libvirt_use_virtio_for_bridges=True
  connection_type=libvirt
  root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf
  verbose=True
  ec2_private_dns_show_ip=True
  api_paste_config=/etc/nova/api-paste.ini
  volumes_path=/var/lib/nova/volumes
  enabled_apis=ec2,osapi_compute,metadata
  rpc_backend = rabbit
  auth_strategy = keystone
  my_ip = 192.168.1.14
  network_api_class = nova.network.neutronv2.api.API
  security_group_api = neutron
  linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
  firewall_driver = nova.virt.firewall.NoopFirewallDriver

  
  [oslo_messaging_rabbit]
  rabbit_host = 192.168.1.13
  rabbit_userid = openstack
  rabbit_password = ********

  
  Steps

  - Fist, I installed Ubuntu 14.04.3 LTS in 2 physical boxes, Controller (cloud03 - 192.168.1.13) and Compute (cloud04 -192.68.1.14)
  - Then I did the base configuration on both nodes according to http://docs.openstack.org/liberty/install-guide-ubuntu/environment-packages.html
   - Then I follow the steps to configur/install the  Controller node, Add the SQL Database, then the Message queue , then add the Identity service, then Add the image Sevice.
  - Then configure the Compute service for the controller node
   - Then configure the compute service for the compute node (cloud03 - 192.168.1.14) according to http://docs.openstack.org/liberty/install-guide-ubuntu/nova-compute-install.html
  -Then restart the nova-compute service

  Expected result

  compute node should be able to communicate with the controller node

  Actual Result:

  Compute node tries to connect to the RabbitMQ server in localhost
  instead of the server specified in the   [oslo_messaging_rabbit]
  section in the /etc/nova/nova.conf file, however, if this values are
  moved to the [DEFAULT] section, the compute node is able to connect to
  the controller node

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1517151/+subscriptions

Follow ups

  Thread Previous • Date Previous • • Thread Next