openstack team mailing list archive

Thread
Date
Re: Nova-compute doesn't start on reboot, only manually

To: Alessandro Tagliapietra <tagliapietra.alessandro@xxxxxxxxx>, "openstack@xxxxxxxxxxxxxxxxxxx" <openstack@xxxxxxxxxxxxxxxxxxx>
From: Staicu Gabriel <gabriel_staicu@xxxxxxxxx>
Date: Mon, 28 May 2012 01:59:29 -0700 (PDT)
In-reply-to: <EF6AF524-0493-410E-8C67-0FC9A25EFABE@gmail.com>
Reply-to: Staicu Gabriel <gabriel_staicu@xxxxxxxxx>
Hi,

It happend to me in case of a server. Investigating I found out that libvirt-bin isn't starting fast enough for nova-compute. So I added this line in /etc/init/nova-compute.conf "start libvirt-bin" to look as:
pre-start script
        mkdir -p /var/run/nova
        chown nova:root /var/run/nova/

        mkdir -p /var/lock/nova
        chown nova:root /var/lock/nova/

        modprobe nbd

        start libvirt-bin
end script


Regards,
Gabriel



________________________________
 From: Alessandro Tagliapietra <tagliapietra.alessandro@xxxxxxxxx>
To: openstack@xxxxxxxxxxxxxxxxxxx 
Sent: Monday, May 28, 2012 11:41 AM
Subject: [Openstack] Nova-compute doesn't start on reboot, only manually
 
Hello, i've installed openstack following the ubuntu 12.04 deploy guide, only problem is that nova-compute has to be started manually, by default it doesn't start on boot, this is the error log:

2012-05-27 23:47:14 INFO nova.rpc.common [req-46624af9-9d2a-4901-b635-66f557d3b54c None None] Connected to AMQP server on 10.8.0.1:5672
2012-05-27 23:48:14 ERROR nova.rpc.common [req-46624af9-9d2a-4901-b635-66f557d3b54c None None] Timed out waiting for RPC response: timed out
2012-05-27 23:48:14 TRACE nova.rpc.common Traceback (most recent call last):
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 490, in ensure
2012-05-27 23:48:14 TRACE nova.rpc.common     return method(*args, **kwargs)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 567, in _consume
2012-05-27 23:48:14 TRACE nova.rpc.common     return self.connection.drain_events(timeout=timeout)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 175, in drain_events
2012-05-27 23:48:14 TRACE nova.rpc.common     return self.transport.drain_events(self.connection, **kwargs)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 238, in drain_events
2012-05-27 23:48:14 TRACE nova.rpc.common     return connection.drain_events(**kwargs)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 57, in drain_events
2012-05-27 23:48:14 TRACE nova.rpc.common     return self.wait_multi(self.channels.values(), timeout=timeout)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 63, in wait_multi
2012-05-27 23:48:14 TRACE nova.rpc.common     chanmap.keys(), allowed_methods, timeout=timeout)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 120, in _wait_multiple
2012-05-27 23:48:14 TRACE nova.rpc.common     channel, method_sig, args, content = read_timeout(timeout)
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 94, in read_timeout
2012-05-27 23:48:14 TRACE nova.rpc.common     return self.method_reader.read_method()
2012-05-27 23:48:14 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 221, in read_method
2012-05-27 23:48:14 TRACE nova.rpc.common     raise m
2012-05-27 23:48:14 TRACE nova.rpc.common timeout: timed out
2012-05-27 23:48:14 TRACE nova.rpc.common    
2012-05-27 23:48:14
CRITICAL nova [-] Timeout while waiting on RPC response.
2012-05-27 23:48:14 TRACE nova Traceback (most recent call last):
2012-05-27 23:48:14 TRACE nova   File "/usr/bin/nova-compute", line 49, in <module>  
2012-05-27 23:48:14 TRACE nova     service.wait()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 413, in wait  
2012-05-27 23:48:14 TRACE nova     _launcher.wait()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 131, in wait
2012-05-27 23:48:14 TRACE nova     service.wait()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 166, in wait
2012-05-27 23:48:14 TRACE nova     return self._exit_event.wait()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2012-05-27 23:48:14 TRACE nova     return hubs.get_hub().switch()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 177, in switch
2012-05-27 23:48:14 TRACE nova     return self.greenlet.switch()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 192, in main
2012-05-27 23:48:14 TRACE nova     result = function(*args, **kwargs)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 101, in run_server
2012-05-27 23:48:14 TRACE nova     server.start()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 162, in start
2012-05-27 23:48:14 TRACE nova     self.manager.init_host()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 247, in init_host
2012-05-27 23:48:14 TRACE nova     self.reboot_instance(context, instance['uuid'])
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
2012-05-27 23:48:14 TRACE nova     return f(*args, **kw)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 153, in decorated_function
2012-05-27 23:48:14 TRACE nova     function(self, context, instance_uuid, *args, **kwargs)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177, in decorated_function
2012-05-27 23:48:14 TRACE nova     sys.exc_info())
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2012-05-27 23:48:14 TRACE nova     self.gen.next()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 171, in decorated_function
2012-05-27 23:48:14 TRACE nova     return function(self, context, instance_uuid, *args, **kwargs)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 896, in reboot_instance
2012-05-27 23:48:14 TRACE nova     network_info = self._get_instance_nw_info(context, instance)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 313, in _get_instance_nw_info
2012-05-27 23:48:14 TRACE nova     instance)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 219, in get_instance_nw_info
2012-05-27 23:48:14 TRACE nova     'args': args})
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/__init__.py", line 68, in call
2012-05-27 23:48:14 TRACE nova     return _get_impl().call(context, topic, msg, timeout)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 674, in call
2012-05-27 23:48:14 TRACE nova     return rpc_amqp.call(context, topic, msg, timeout, Connection.pool)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 338, in call
2012-05-27 23:48:14 TRACE nova     rv = list(rv)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 299, in __iter__
2012-05-27 23:48:14 TRACE nova     self._iterator.next()
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 572, in iterconsume
2012-05-27 23:48:14 TRACE nova     yield self.ensure(_error_callback, _consume)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 503, in ensure
2012-05-27 23:48:14 TRACE nova     error_callback(e)
2012-05-27 23:48:14 TRACE nova   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 553, in _error_callback
2012-05-27 23:48:14 TRACE nova     raise rpc_common.Timeout()
2012-05-27 23:48:14 TRACE nova Timeout: Timeout while waiting on RPC response.


Then after system boot a start nova-compute make everything working.

Any idea?

Best Regards
_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
References

Nova-compute doesn't start on reboot, only manually
From: Alessandro Tagliapietra, 2012-05-28