← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #13695

[Bug 1309055] [NEW] Post operation of migration fails whith "Connection to neutron failed" error

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

Post migration operation fails  after successful migration, and fields
"node","host","task_state"  in the table "instances" are not changed in
nova database.  When nova configured to work with neutron:

grep neutron /etc/nova/nova.conf :

network_api_class=nova.network.neutronv2.api.API
neutron_url=http://controller:9696
neutron_auth_strategy=keystone
neutron_admin_tenant_name=service
neutron_admin_username=neutron
neutron_admin_password=pass
neutron_admin_auth_url=http://controller:35357/v2.0
neutron_metadata_proxy_shared_secret = pass
service_neutron_metadata_proxy = true

Latest nova/neutron code in Trusty:
 nova-compute                        1:2014.1-0ubuntu1 
 python-novaclient                   1:2.17.0-0ubuntu1 
python-neutronclient                1:2.3.4-0ubuntu1   
 neutron-common                      1:2014.1~rc2-0ubuntu4  

 /var/log/nova/nova-compute.log has stacktrace:
TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
TRACE oslo.messaging.rpc.dispatcher     incoming.message))
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 399, in decorated_function
TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
TRACE oslo.messaging.rpc.dispatcher     payload)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
8 TRACE oslo.messaging.rpc.dispatcher     return f(self, context, *args, **kw)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function
TRACE oslo.messaging.rpc.dispatcher     e, sys.exc_info())
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function
TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4669, in post_live_migration_at_destination
TRACE oslo.messaging.rpc.dispatcher     migration)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 259, in network_migrate_instance_finish
TRACE oslo.messaging.rpc.dispatcher     migration)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 391, in network_migrate_instance_finish
TRACE oslo.messaging.rpc.dispatcher     instance=instance_p, migration=migration_p)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
TRACE oslo.messaging.rpc.dispatcher     wait_for_reply=True, timeout=timeout)
TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
TRACE oslo.messaging.rpc.dispatcher     timeout=timeout)
 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
 TRACE oslo.messaging.rpc.dispatcher     return self._send(target, ctxt, message, wait_for_reply, timeout)
 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
TRACE oslo.messaging.rpc.dispatcher     raise result
TRACE oslo.messaging.rpc.dispatcher RemoteError: Remote error: ConnectionFailed Connection to neutron failed: Maximum attempts reached

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1309055

Title:
   Post operation of migration  fails whith "Connection to neutron
  failed" error

Status in OpenStack Compute (Nova):
  New

Bug description:
  Post migration operation fails  after successful migration, and fields
  "node","host","task_state"  in the table "instances" are not changed
  in nova database.  When nova configured to work with neutron:

  grep neutron /etc/nova/nova.conf :

  network_api_class=nova.network.neutronv2.api.API
  neutron_url=http://controller:9696
  neutron_auth_strategy=keystone
  neutron_admin_tenant_name=service
  neutron_admin_username=neutron
  neutron_admin_password=pass
  neutron_admin_auth_url=http://controller:35357/v2.0
  neutron_metadata_proxy_shared_secret = pass
  service_neutron_metadata_proxy = true

  Latest nova/neutron code in Trusty:
   nova-compute                        1:2014.1-0ubuntu1 
   python-novaclient                   1:2.17.0-0ubuntu1 
  python-neutronclient                1:2.3.4-0ubuntu1   
   neutron-common                      1:2014.1~rc2-0ubuntu4  

   /var/log/nova/nova-compute.log has stacktrace:
  TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
  TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
  TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
  TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 399, in decorated_function
  TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
  TRACE oslo.messaging.rpc.dispatcher     payload)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
  8 TRACE oslo.messaging.rpc.dispatcher     return f(self, context, *args, **kw)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function
  TRACE oslo.messaging.rpc.dispatcher     e, sys.exc_info())
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function
  TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4669, in post_live_migration_at_destination
  TRACE oslo.messaging.rpc.dispatcher     migration)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 259, in network_migrate_instance_finish
  TRACE oslo.messaging.rpc.dispatcher     migration)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 391, in network_migrate_instance_finish
  TRACE oslo.messaging.rpc.dispatcher     instance=instance_p, migration=migration_p)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
  TRACE oslo.messaging.rpc.dispatcher     wait_for_reply=True, timeout=timeout)
  TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
  TRACE oslo.messaging.rpc.dispatcher     timeout=timeout)
   TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
   TRACE oslo.messaging.rpc.dispatcher     return self._send(target, ctxt, message, wait_for_reply, timeout)
   TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
  TRACE oslo.messaging.rpc.dispatcher     raise result
  TRACE oslo.messaging.rpc.dispatcher RemoteError: Remote error: ConnectionFailed Connection to neutron failed: Maximum attempts reached

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1309055/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next