openstack team mailing list archive

["Vaze, Mandar" <Mandar.Vaze@xxxxxxxxxxx>]

This may not be related to host flag.

See similar problem being discussed in this thread :  https://lists.launchpad.net/openstack/msg13314.html
(Same symptoms as yours, error in allocate_for_instance, rpc timeouts)

-Mandar

From: openstack-bounces+mandar.vaze=nttdata.com@xxxxxxxxxxxxxxxxxxx [mailto:openstack-bounces+mandar.vaze=nttdata.com@xxxxxxxxxxxxxxxxxxx] On Behalf Of Czubak, Piotr
Sent: Thursday, June 21, 2012 2:28 PM
To: openstack@xxxxxxxxxxxxxxxxxxx
Subject: [Openstack] Instances not starting after changing host flag

Hi All,

I have Essex set up and running, everything works fine till I try to change "host" flag in nova.conf:

--host=test

After reboot, instances don't start, only error is reported. Any ideas how to fix this? Logs from nova-compute and nova-network attached below.

Regards,
Piotr Czubak



Logs from nova-compute.log:

Timed out waiting for RPC response: timed out
2012-06-21 04:35:16 TRACE nova.rpc.common Traceback (most recent call last):
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 490, in ensure
2012-06-21 04:35:16 TRACE nova.rpc.common     return method(*args, **kwargs)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 567, in _consume
2012-06-21 04:35:16 TRACE nova.rpc.common     return self.connection.drain_events(timeout=timeout)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 175, in drain_events
2012-06-21 04:35:16 TRACE nova.rpc.common     return self.transport.drain_events(self.connection, **kwargs)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 238, in drain_events
2012-06-21 04:35:16 TRACE nova.rpc.common     return connection.drain_events(**kwargs)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 57, in drain_events
2012-06-21 04:35:16 TRACE nova.rpc.common     return self.wait_multi(self.channels.values(), timeout=timeout)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 63, in wait_multi
2012-06-21 04:35:16 TRACE nova.rpc.common     chanmap.keys(), allowed_methods, timeout=timeout)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 120, in _wait_multiple
2012-06-21 04:35:16 TRACE nova.rpc.common     channel, method_sig, args, content = read_timeout(timeout)
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 94, in read_timeout
2012-06-21 04:35:16 TRACE nova.rpc.common     return self.method_reader.read_method()
2012-06-21 04:35:16 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 221, in read_method
2012-06-21 04:35:16 TRACE nova.rpc.common     raise m
2012-06-21 04:35:16 TRACE nova.rpc.common timeout: timed out
2012-06-21 04:35:16 TRACE nova.rpc.common
Instance failed network setup
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473] Traceback (most recent call last):
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 559, in _allocate_network
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     requested_networks=requested_networks)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 170, in allocate_for_instance
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     'args': args})
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/__init__.py", line 68, in call
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     return _get_impl().call(context, topic, msg, timeout)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 674, in call
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     return rpc_amqp.call(context, topic, msg, timeout, Connection.pool)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 338, in call
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     rv = list(rv)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 299, in __iter__
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     self._iterator.next()
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 572, in iterconsume
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     yield self.ensure(_error_callback, _consume)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 503, in ensure
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     error_callback(e)
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 553, in _error_callback
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]     raise rpc_common.Timeout()
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473] Timeout: Timeout while waiting on RPC response.
2012-06-21 04:35:16 TRACE nova.compute.manager [instance: acefc36d-81bf-4352-9cb6-ca0228315473]

Nova network:

2012-06-21 04:39:40 INFO nova.rpc.common [req-f691b443-9bbc-424e-9acb-3675da294dfd None None] Connected to AMQP server on 10.102.44.121:5672
2012-06-21 04:39:59 ERROR nova.rpc.common [-] Timed out waiting for RPC response: timed out
2012-06-21 04:39:59 TRACE nova.rpc.common Traceback (most recent call last):
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 490, in ensure
2012-06-21 04:39:59 TRACE nova.rpc.common     return method(*args, **kwargs)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 567, in _consume
2012-06-21 04:39:59 TRACE nova.rpc.common     return self.connection.drain_events(timeout=timeout)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 175, in drain_events
2012-06-21 04:39:59 TRACE nova.rpc.common     return self.transport.drain_events(self.connection, **kwargs)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 238, in drain_events
2012-06-21 04:39:59 TRACE nova.rpc.common     return connection.drain_events(**kwargs)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 57, in drain_events
2012-06-21 04:39:59 TRACE nova.rpc.common     return self.wait_multi(self.channels.values(), timeout=timeout)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 63, in wait_multi
2012-06-21 04:39:59 TRACE nova.rpc.common     chanmap.keys(), allowed_methods, timeout=timeout)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 120, in _wait_multiple
2012-06-21 04:39:59 TRACE nova.rpc.common     channel, method_sig, args, content = read_timeout(timeout)
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 94, in read_timeout
2012-06-21 04:39:59 TRACE nova.rpc.common     return self.method_reader.read_method()
2012-06-21 04:39:59 TRACE nova.rpc.common   File "/usr/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 221, in read_method
2012-06-21 04:39:59 TRACE nova.rpc.common     raise m
2012-06-21 04:39:59 TRACE nova.rpc.common timeout: timed out
2012-06-21 04:39:59 TRACE nova.rpc.common
---------------------------------------------------------------------
Intel Technology Poland sp. z o.o.
z siedziba w Gdansku
ul. Slowackiego 173
80-298 Gdansk

Sad Rejonowy Gdansk Polnoc w Gdansku,
VII Wydzial Gospodarczy Krajowego Rejestru Sadowego,
numer KRS 101882

NIP 957-07-52-316
Kapital zakladowy 200.000 zl

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

______________________________________________________________________
Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data.  If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding