yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1855875] [NEW] When create a new server instance this error occurred.

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: sameera madushan <1855875@xxxxxxxxxxxxxxxxxx>
Date: Tue, 10 Dec 2019 12:25:56 -0000
Reply-to: Bug 1855875 <1855875@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

2019-12-10 17:17:31.679 31059 ERROR oslo.messaging._drivers.impl_rabbit [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Failed to publish message to topic 'nova': 'NoneType' object has no attribute '__getitem__'
2019-12-10 17:17:31.679 31059 ERROR oslo.messaging._drivers.impl_rabbit [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Unexpected exception in API method: MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 671, in wrapped
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return f(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 686, in create
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     **create_kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     rv = f(*args, **kwargs)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1857, in create
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     supports_port_resource_request=supports_port_resource_request)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1367, in _create_instance
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     tags=tags)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 136, in schedule_and_build_instances
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     block_device_mapping, tags)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 403, in schedule_and_build_instances
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     cctxt.cast(context, 'schedule_and_build_instances', **kw)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 153, in cast
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     self.transport._send(self.target, msg_ctxt, msg, retry=self.retry)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 128, in _send
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     retry=retry)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 645, in send
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     call_monitor_timeout, retry=retry)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 630, in _send
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     msg=msg, timeout=timeout, retry=retry)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1210, in topic_send
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     retry=retry)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1086, in _ensure_publishing
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     self.ensure(method, retry=retry, error_callback=_error_callback)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 755, in ensure
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     raise exceptions.MessageDeliveryFailure(msg)
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi
2019-12-10 17:17:31.685 31059 INFO nova.api.openstack.wsgi [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessageDeliveryFailure'>

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1855875

Title:
  When create a new server instance this error occurred.

Status in OpenStack Compute (nova):
  New

Bug description:
  2019-12-10 17:17:31.679 31059 ERROR oslo.messaging._drivers.impl_rabbit [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Failed to publish message to topic 'nova': 'NoneType' object has no attribute '__getitem__'
  2019-12-10 17:17:31.679 31059 ERROR oslo.messaging._drivers.impl_rabbit [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] Unexpected exception in API method: MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi Traceback (most recent call last):
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 671, in wrapped
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return f(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 110, in wrapper
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     return func(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 686, in create
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     **create_kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     rv = f(*args, **kwargs)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1857, in create
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     supports_port_resource_request=supports_port_resource_request)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1367, in _create_instance
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     tags=tags)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/conductor/api.py", line 136, in schedule_and_build_instances
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     block_device_mapping, tags)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/nova/conductor/rpcapi.py", line 403, in schedule_and_build_instances
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     cctxt.cast(context, 'schedule_and_build_instances', **kw)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 153, in cast
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     self.transport._send(self.target, msg_ctxt, msg, retry=self.retry)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 128, in _send
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     retry=retry)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 645, in send
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     call_monitor_timeout, retry=retry)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 630, in _send
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     msg=msg, timeout=timeout, retry=retry)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1210, in topic_send
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     retry=retry)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1086, in _ensure_publishing
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     self.ensure(method, retry=retry, error_callback=_error_callback)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 755, in ensure
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi     raise exceptions.MessageDeliveryFailure(msg)
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.0.204:5672 after inf tries: 'NoneType' object has no attribute '__getitem__'
  2019-12-10 17:17:31.680 31059 ERROR nova.api.openstack.wsgi
  2019-12-10 17:17:31.685 31059 INFO nova.api.openstack.wsgi [req-a5d14694-ebda-449d-9030-0998fc27eb3e c035f19ef5af4a108d5a3704f59362ba b52c7945d86f428e8cf16a4d886f1f9a - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessageDeliveryFailure'>

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1855875/+subscriptions
Follow ups

[Bug 1855875] Re: When create a new server instance this error occurred.
From: Matt Riedemann, 2019-12-10