yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1669840] Re: OCATA: Error: Unable to retrieve instances.

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: kadtab <1669840@xxxxxxxxxxxxxxxxxx>
Date: Mon, 06 Mar 2017 16:56:19 -0000
Reply-to: Bug 1669840 <1669840@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Deployment Scenario:

Deploying ocata in all-in-one setup from openstack packages on Ubuntu
16.01 xenial. Have deployed the following modules; i.e.
rabbitmq,keystone,neutron,nova,glance,cinder. All the modules were
deployed following the documentation on openstack website.

Problem #1 - Everything seems fine until I install Cinder. After I
configure cinder service based on the documented steps I start getting
error on the Horizon page under Instances option. Error: Unable to
retrieve instances.

Solution #1 - After changing the region to openstack under cinder option
of nova.conf, it resolved my issue. No more error messages under
horizon.

Problem #2 - When I am trying to spawn the instance, it goes in a loop
of spawning without any results. After reviewing the nova-conductor.log,
i observed the following message stating : "No cell mapping found for
cell0 while trying to record scheduling failure. Setup is incomplete."

After googling, found a solution to use the following command to resolve the above stated:
nova-manage cell_v2 simple_cell_setup

But the above command resulted in the following error, which prompted me
to create nova_cell0 database; "Access denied for user 'nova'@'%' to
database 'nova_cell0'"

Now when I am trying to spawn the instance getting an error message in
horizon of "No valid host found".

Output of nova-conductor.log states as below;

tail -f /var/log/nova/nova-conductor.log
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 98, in select_destinations
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager     dests = self.driver.select_destinations(ctxt, spec_obj)
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 79, in select_destinations
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager     raise exception.NoValidHost(reason=reason)
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager NoValidHost: No valid host was found. There are not enough hosts available.
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager
2017-03-06 19:18:40.968 3717 ERROR nova.conductor.manager
2017-03-06 19:18:40.981 3717 ERROR nova.conductor.manager [req-1f5bedd7-c771-4873-8add-3ebcf59fdcd3 - - - - -] No cell mapping found for cell0 while trying to record scheduling failure. Setup is incomplete.
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager [req-96a934d1-fec0-414a-9967-91350fe27c87 - - - - -] Failed to schedule instances
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager Traceback (most recent call last):
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 866, in schedule_and_build_instances
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     request_specs[0].to_legacy_filter_properties_dict())
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 597, in _schedule_instances
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     hosts = self.scheduler_client.select_destinations(context, spec_obj)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/utils.py", line 371, in wrapped
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return func(*args, **kwargs)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 51, in select_destinations
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return self.queryclient.select_destinations(context, spec_obj)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return getattr(self.instance, __name)(*args, **kwargs)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/query.py", line 32, in select_destinations
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return self.scheduler_rpcapi.select_destinations(context, spec_obj)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/rpcapi.py", line 129, in select_destinations
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return cctxt.call(ctxt, 'select_destinations', **msg_args)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     retry=self.retry)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 97, in _send
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     timeout=timeout, retry=retry)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     retry=retry)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 449, in _send
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     raise result
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager NoValidHost_Remote: No valid host was found. There are not enough hosts available.
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager Traceback (most recent call last):
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 218, in inner
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     return func(*args, **kwargs)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 98, in select_destinations
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     dests = self.driver.select_destinations(ctxt, spec_obj)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager   File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 79, in select_destinations
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager     raise exception.NoValidHost(reason=reason)
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager NoValidHost: No valid host was found. There are not enough hosts available.
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:35.944 3715 ERROR nova.conductor.manager
2017-03-06 19:29:36.104 3715 WARNING nova.scheduler.utils [req-96a934d1-fec0-414a-9967-91350fe27c87 - - - - -] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available.
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 218, in inner
    return func(*args, **kwargs)

  File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 98, in select_destinations
    dests = self.driver.select_destinations(ctxt, spec_obj)

  File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 79, in select_destinations
    raise exception.NoValidHost(reason=reason)

NoValidHost: No valid host was found. There are not enough hosts
available.

2017-03-06 19:29:36.105 3715 WARNING nova.scheduler.utils [req-
96a934d1-fec0-414a-9967-91350fe27c87 - - - - -] [instance: 80915c31
-367e-480e-980d-c07562077478] Setting instance to ERROR state.



Will appreciate any feedback for the issue being face in Ocata.                                                                            

** Changed in: nova
       Status: Invalid => New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1669840

Title:
  OCATA: Error: Unable to retrieve instances.

Status in OpenStack Compute (nova):
  New

Bug description:
  I have configured Ocata release on Ubuntu 16.

  Everything seems to be working until I install Cinder volume. After
  configuring cinder, I started receiving an error under Instances
  option of Horizon.

  I get an error stating "Unable to retrieve instances."

  Any guide in the above mentioned regard will be highly appreciated.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1669840/+subscriptions
References

[Bug 1669840] [NEW] OCATA: Error: Unable to retrieve instances.
From: Tabrez, 2017-03-03