← Back to team overview

openstack team mailing list archive

Re: [nova-compute] vm migration problem

 

Has anybody ever written a script that grabs the host public key from the instance's console and updates the .ssh/config/known_hosts file accordingly, instead of throwing away host key checking?  That would be a handy little thing if it was out there.

Take care,

Lorin
--
Lorin Hochstein
Lead Architect - Cloud Services
Nimbis Services, Inc.
www.nimbisservices.com




On May 21, 2012, at 6:09 AM, Joe Breu wrote:

> Hi Eric,
> 
> It would appear that the nova user on one of the compute nodes had at one time cached the SSH host key of the other node and now the key has changed.  You can bypass this by adding the following to ~nova/.ssh/config on both compute nodes:
> 
> Host *
>    StrictHostKeyChecking no
>    UserKnownHostsFile=/dev/null
> 
> 
> ---
> Joseph Breu
> Deployment Engineer
> Rackspace Cloud Builders
> 210-312-3508
> 
> On May 21, 2012, at 11:34 AM, Eric Luo wrote:
> 
>> Hello ,all.
>> 
>> I have a two nodes installation . OS1 is the cloud controller ,and OS2 is a nova-compute node.
>> I have a vm (name as vm1)  running on OS1.
>> When I use the command   nova migrate  vm1 
>> 
>> The dashboard is showing the vm1 as : status :error ,task :Resize Prep
>> I tail ed  the nova-compute.log in OS1, and found the following error information while running the   nova migrate  vm1 command :
>> 
>> 
>> Can someone please explain to me what does these error mean ,and what's wrong with my config ...
>> 
>> 
>> 2012-05-21 17:20:45 ERROR nova.compute.manager [req-d0f494cb-e9d6-41d2-b6df-6faa432a644d 6ffaaedb60c24f5eb888319e1e387d75 0d7a5a12b6f54aa9bff986bf138bc0b7] Unex pected error while running command.
>> Command: ssh 192.168.0.205 mkdir -p /var/lib/nova/instances/instance-0000000a
>> Exit code: 255
>> Stdout: ''
>> Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to ERROR
>> 2012-05-21 17:20:45 ERROR nova.rpc.amqp [req-d0f494cb-e9d6-41d2-b6df-6faa432a644d 6ffaaedb60c24f5eb888319e1e387d75 0d7a5a12b6f54aa9bff986bf138bc0b7] Exception during message handling
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp Traceback (most recent call last):
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in _process_data
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     rval = node_func(context=ctxt, **node_args)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     return f(*args, **kw)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 153, in decorated_function
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     function(self, context, instance_uuid, *args, **kwargs)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177, in decorated_function
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     sys.exc_info())
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     self.gen.next()
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 171, in decorated_function
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     return function(self, context, instance_uuid, *args, **kwargs)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1330, in resize_instance
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     self._set_instance_error_state(context, instance_uuid)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     self.gen.next()
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1325, in resize_instance
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     instance_type_ref, self._legacy_nw_info(network_info))
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     return f(*args, **kw)
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 2363, in migrate_disk_and_power_off
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp     raise e
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp ProcessExecutionError: Unexpected error while running command.
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp Command: ssh 192.168.0.205 mkdir -p /var/lib/nova/instances/instance-0000000a
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp Exit code: 255
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp Stdout: ''
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp Stderr: 'Host key verification failed.\r\n'
>> 2012-05-21 17:20:45 TRACE nova.rpc.amqp
>> ^C
>> 
>> 
>> 
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
> 
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp


Follow ups

References