yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1522667] Re: If instance's disk is not avilable when nova-compute service start which would cause the service failed

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem@xxxxxxxxxx>
Date: Thu, 06 Oct 2016 16:37:36 -0000
Reply-to: Bug 1522667 <1522667@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
At this point I'm going to consider this expired. If someone can
recreate on master then we can revive.

** Changed in: nova
       Status: In Progress => Invalid

** Changed in: nova
     Assignee: Michael Still (mikal) => (unassigned)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1522667

Title:
  If instance's disk is not avilable when nova-compute service start
  which would cause the service failed

Status in OpenStack Compute (nova):
  Invalid

Bug description:
  version : 2015.1

  details:

  nova-compute.service starts,It will do something like update_available_resource .Including get_disk_over_committed_size_total and
  get_instance_disk_info .If the instance's iscsi_path is not available or the ip is unable to connect.That will cause the nova-comute.service inactive.I think It's not reasonable for user.

  
  logs:

  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/commot
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     x.wait()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/commot
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/greenthreadt
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/event.py", t
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.pyh
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/greenthreadn
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/commoe
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     service.start()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/service.py", lit
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     self.manager.pre_start_hook()
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/managerk
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     self.update_available_resource(nova.context.get_admin_con)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/managere
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     rt.update_available_resource(context)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/resource
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     resources = self.driver.get_available_resource(self.noden)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/dre
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     disk_over_committed = self._get_disk_over_committed_size_)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/drl
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     self._get_instance_disk_info(dom.name(), xml))
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/dro
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     dk_size = lvm.get_volume_size(path)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/lve
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     run_as_root=True)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/ute
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return utils.execute(*args, **kwargs)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/utils.py", linee
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     return processutils.execute(*cmd, **kwargs)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/oslo_concurrency/proe
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup     cmd=sanitized_cmd)
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup ProcessExecutionError: Unexpected error while running command.
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup Command: sudo nova-rootwrap /etc/nova/rootwrap.conf blockdev 0
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup Exit code: 1
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup Stdout: u''
  2015-12-03 17:21:23.508 15646 TRACE nova.openstack.common.threadgroup Stderr: u'blockdev: cannot open /dev/disk/by-path/ip-162.161.1.208:3260-iscsi-iqn.2000-09.com.fujitsu:storage-system.eternus-dxl:002859c4-lun-0: No such device or address\n'


  added:
  I have check the error . It is because the ip-162.161.1.208:3260 is unable to connect. If the ip is reachable .The sevice can restart successfully.

  
  please check the bugs. tks

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1522667/+subscriptions
References

[Bug 1522667] [NEW] when nova-compute.service start .If the instance's disk is not avilable.It will cause the service failed.That is not reasonable
From: jingtao liang, 2015-12-04