yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1349268] Re: OverLimit: VolumeLimitExceeded: Maximum number of volumes allowed (10) exceeded

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Thierry Carrez <thierry.carrez+lp@xxxxxxxxx>
Date: Fri, 05 Sep 2014 09:59:46 -0000
Reply-to: Bug 1349268 <1349268@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Changed in: nova
       Status: Fix Committed => Fix Released

** Changed in: nova
    Milestone: None => juno-3

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1349268

Title:
  OverLimit: VolumeLimitExceeded: Maximum number of volumes allowed (10)
  exceeded

Status in OpenStack Compute (Nova):
  Fix Released

Bug description:
  The instance will be ERROR when booting instance from volume, if the
  volume quota is not enough. And there is even no useful error message
  to show to the user. Following is the related nova-compute.log:

  2014-07-27 17:56:19.372 17060 ERROR nova.compute.manager [req-4e876b97-be8a-486b-98e2-7d707266755d 98fa3fd418914a9288b5560e1bb6944e 5254621adfd949a9a3b975f68119e269] [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc] Instance failed block device setup
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc] Traceback (most recent call last):
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1690, in _prep_block_device
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     self.driver, self._await_block_device_map_created))
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/nova/virt/block_device.py", line 363, in attach_block_devices
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     map(_log_and_attach, block_device_mapping)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/nova/virt/block_device.py", line 361, in _log_and_attach
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     bdm.attach(*attach_args, **attach_kwargs)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/nova/virt/block_device.py", line 311, in attach
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     '', '', image_id=self.image_id)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 303, in create
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     item = cinderclient(context).volumes.create(size, **kwargs)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/cinderclient/v1/volumes.py", line 187, in create
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     return self._create('/volumes', body, 'volume')
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/cinderclient/base.py", line 153, in _create
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     resp, body = self.api.client.post(url, body=body)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 209, in post
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     return self._cs_request(url, 'POST', **kwargs)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 173, in _cs_request
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     **kwargs)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 156, in request
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]     raise exceptions.from_response(resp, body)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc] OverLimit: VolumeLimitExceeded: Maximum number of volumes allowed (10) exceeded (HTTP 413) (Request-ID: req-07dcc4c4-182f-4d73-b054-806f31cb7e71)
  2014-07-27 17:56:19.372 17060 TRACE nova.compute.manager [instance: 2a124872-3332-4f54-bb28-f0a96a7ed7bc]
  2014-07-27 17:56:19.693 17060 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: Block Device Mapping is Invalid.
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139, in inner
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return func(*args, **kwargs)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     payload)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return f(self, context, *args, **kw)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 282, in decorated_function
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     pass
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 268, in decorated_function
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 335, in decorated_function
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     function(self, context, *args, **kwargs)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 311, in decorated_function
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     e, sys.exc_info())
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 298, in decorated_function
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2077, in run_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     do_run_instance()
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 249, in inner
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     return f(*args, **kwargs)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2076, in do_run_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     legacy_bdm_in_spec)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1209, in _run_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     notify("error", fault=e)  # notify that build failed
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1193, in _run_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     instance, image_meta, legacy_bdm_in_spec)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1347, in _build_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     LOG.exception(msg, instance=instance)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1304, in _build_instance
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     context, instance, bdms)
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1707, in _prep_block_device
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher     raise exception.InvalidBDM()
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher InvalidBDM: Block Device Mapping is Invalid.
  2014-07-27 17:56:19.693 17060 TRACE oslo.messaging.rpc.dispatcher

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1349268/+subscriptions
References

[Bug 1349268] [NEW] OverLimit: VolumeLimitExceeded: Maximum number of volumes allowed (10) exceeded
From: Liyingjun, 2014-07-28