yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #19771
[Bug 1364588] [NEW] Server in ERROR state after running "nova resize-revert" command.
Public bug reported:
OpenStack version: Icehouse
root@all-in-one:~# dpkg -l | grep nova-common
ii nova-common 10:2014.1-43-cisco1 all OpenStack Compute - common files
Issue: server in ERROR state after running the "nova resize-revert"
command.
Steps to reproduce:
1. Launch an instance with server name all in caps, e.g. CIRROS
2. Verify the server is running; "nova show cirros"
3. Note that in "nova show cirros", the server name is in lower case and it still works. Is this a bug?
4. In subsequent steps, use all lower case for the server name, i.e. cirros
5. Stop the server: "nova stop cirros"
6. Verify server is in "SHUTOFF" state: "nova list"
7. Resize the server: "nova resize cirros 2 --poll"
8. Verify server is in "VERIFY_RESIZE" state: "nova list"
9. Revert the resizing: "nova resize-revert cirros"
10. Server back to "SHUTOFF" state: "nova list"
11. Repeat steps 7-9.
12. Server in "ERROR" state after resize-revert.
root@all-in-one:~# nova boot --image cirros-0.3.2 --flavor 1 --nic net-id=12a21fb5-0506-417c-bf0d-f15dc2b59de5 CIRROS
+--------------------------------------+-----------------------------------------------------+
| Property | Value |
+--------------------------------------+-----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | - |
| OS-EXT-SRV-ATTR:hypervisor_hostname | - |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | hDPzD4q5pyAE |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:19Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+-----------------------------------------------------+
root@all-in-one:~# nova list
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | ACTIVE | - | Running | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
root@all-in-one:~# nova show CIRROS
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | all-in-one |
| OS-EXT-SRV-ATTR:hypervisor_hostname | all-in-one.cisco.com |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2014-09-02T19:13:24.000000 |
| OS-SRV-USG:terminated_at | - |
| Private_Net10 network | 10.10.10.18 |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | 663a6984eb95f9f0250d4f3775c837bd325feaa2f9e77dbeb7a9d31c |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:24Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+----------------------------------------------------------+
root@all-in-one:~# nova show cirros
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | all-in-one |
| OS-EXT-SRV-ATTR:hypervisor_hostname | all-in-one.cisco.com |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2014-09-02T19:13:24.000000 |
| OS-SRV-USG:terminated_at | - |
| Private_Net10 network | 10.10.10.18 |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | 663a6984eb95f9f0250d4f3775c837bd325feaa2f9e77dbeb7a9d31c |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:24Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+----------------------------------------------------------+
root@all-in-one:~# nova stop cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | SHUTOFF | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize cirros 2 --poll
Server resizing... 100% complete
Finished
root@all-in-one:~# nova list
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | VERIFY_RESIZE | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize-revert cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | SHUTOFF | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize cirros 2 --poll
Server resizing... 100% complete
Finished
root@all-in-one:~# nova list
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | VERIFY_RESIZE | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize-revert cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | ERROR | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
root@all-in-one:~#
Snippet of nova-compute.log:
2014-09-02 15:15:50.164 27963 ERROR nova.compute.manager [req-28c4510c-d60a-42bf-9718-d0e93a3bb7a9 923d9ed9427549edaf7a3cbce18bb3ec 70fe7c978d4240619783133dda920574] [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] Setting instance vm_state to ERROR
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] Traceback (most recent call last):
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 5538, in _error_out_instance_on_exception
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] yield
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] block_device_info, power_on)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] block_device_info, power_on)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] domain.resume()
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] rv = execute(f,*args,**kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] rv = meth(*args,**kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] if ret == -1: raise libvirtError ('virDomainResume() failed', dom=self)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] libvirtError: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f]
2014-09-02 15:15:50.404 27963 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher payload)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 280, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher pass
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 266, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info())
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher block_device_info, power_on)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher block_device_info, power_on)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher domain.resume()
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher rv = execute(f,*args,**kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher rv = meth(*args,**kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virDomainResume() failed', dom=self)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher libvirtError: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher
2014-09-02 15:15:50.408 27963 ERROR oslo.messaging._drivers.common [-] Returning exception Requested operation is not valid: domain is not running to caller
2014-09-02 15:15:50.408 27963 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 280, in decorated_function\n pass\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 266, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function\n function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function\n e, sys.exc_info())\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize\n block_device_info, power_on)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration\n block_device_info, power_on)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network\n domain.resume()\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call\n rv = execute(f,*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker\n rv = meth(*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume\n if ret == -1: raise libvirtError (\'virDomainResume() failed\', dom=self)\n', 'libvirtError: Requested operation is not valid: domain is not running\n']
** Affects: nova
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1364588
Title:
Server in ERROR state after running "nova resize-revert" command.
Status in OpenStack Compute (Nova):
New
Bug description:
OpenStack version: Icehouse
root@all-in-one:~# dpkg -l | grep nova-common
ii nova-common 10:2014.1-43-cisco1 all OpenStack Compute - common files
Issue: server in ERROR state after running the "nova resize-revert"
command.
Steps to reproduce:
1. Launch an instance with server name all in caps, e.g. CIRROS
2. Verify the server is running; "nova show cirros"
3. Note that in "nova show cirros", the server name is in lower case and it still works. Is this a bug?
4. In subsequent steps, use all lower case for the server name, i.e. cirros
5. Stop the server: "nova stop cirros"
6. Verify server is in "SHUTOFF" state: "nova list"
7. Resize the server: "nova resize cirros 2 --poll"
8. Verify server is in "VERIFY_RESIZE" state: "nova list"
9. Revert the resizing: "nova resize-revert cirros"
10. Server back to "SHUTOFF" state: "nova list"
11. Repeat steps 7-9.
12. Server in "ERROR" state after resize-revert.
root@all-in-one:~# nova boot --image cirros-0.3.2 --flavor 1 --nic net-id=12a21fb5-0506-417c-bf0d-f15dc2b59de5 CIRROS
+--------------------------------------+-----------------------------------------------------+
| Property | Value |
+--------------------------------------+-----------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | - |
| OS-EXT-SRV-ATTR:hypervisor_hostname | - |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | hDPzD4q5pyAE |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:19Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+-----------------------------------------------------+
root@all-in-one:~# nova list
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | ACTIVE | - | Running | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
root@all-in-one:~# nova show CIRROS
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | all-in-one |
| OS-EXT-SRV-ATTR:hypervisor_hostname | all-in-one.cisco.com |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2014-09-02T19:13:24.000000 |
| OS-SRV-USG:terminated_at | - |
| Private_Net10 network | 10.10.10.18 |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | 663a6984eb95f9f0250d4f3775c837bd325feaa2f9e77dbeb7a9d31c |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:24Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+----------------------------------------------------------+
root@all-in-one:~# nova show cirros
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | all-in-one |
| OS-EXT-SRV-ATTR:hypervisor_hostname | all-in-one.cisco.com |
| OS-EXT-SRV-ATTR:instance_name | instance-00000010 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2014-09-02T19:13:24.000000 |
| OS-SRV-USG:terminated_at | - |
| Private_Net10 network | 10.10.10.18 |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2014-09-02T19:13:19Z |
| flavor | m1.tiny (1) |
| hostId | 663a6984eb95f9f0250d4f3775c837bd325feaa2f9e77dbeb7a9d31c |
| id | fed073b5-bdf1-474f-ab03-c5aa0076d68f |
| image | cirros-0.3.2 (07a033dc-3dde-4d57-897c-1e0974bb1ddf) |
| key_name | - |
| metadata | {} |
| name | CIRROS |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 70fe7c978d4240619783133dda920574 |
| updated | 2014-09-02T19:13:24Z |
| user_id | 923d9ed9427549edaf7a3cbce18bb3ec |
+--------------------------------------+----------------------------------------------------------+
root@all-in-one:~# nova stop cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | SHUTOFF | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize cirros 2 --poll
Server resizing... 100% complete
Finished
root@all-in-one:~# nova list
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | VERIFY_RESIZE | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize-revert cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | SHUTOFF | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize cirros 2 --poll
Server resizing... 100% complete
Finished
root@all-in-one:~# nova list
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | VERIFY_RESIZE | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+---------------+------------+-------------+---------------------------+
root@all-in-one:~# nova resize-revert cirros
root@all-in-one:~# nova list
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
| fed073b5-bdf1-474f-ab03-c5aa0076d68f | CIRROS | ERROR | - | Shutdown | Private_Net10=10.10.10.18 |
+--------------------------------------+--------+--------+------------+-------------+---------------------------+
root@all-in-one:~#
Snippet of nova-compute.log:
2014-09-02 15:15:50.164 27963 ERROR nova.compute.manager [req-28c4510c-d60a-42bf-9718-d0e93a3bb7a9 923d9ed9427549edaf7a3cbce18bb3ec 70fe7c978d4240619783133dda920574] [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] Setting instance vm_state to ERROR
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] Traceback (most recent call last):
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 5538, in _error_out_instance_on_exception
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] yield
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] block_device_info, power_on)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] block_device_info, power_on)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] domain.resume()
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] rv = execute(f,*args,**kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] rv = meth(*args,**kwargs)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] if ret == -1: raise libvirtError ('virDomainResume() failed', dom=self)
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f] libvirtError: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.164 27963 TRACE nova.compute.manager [instance: fed073b5-bdf1-474f-ab03-c5aa0076d68f]
2014-09-02 15:15:50.404 27963 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher payload)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 280, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher pass
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 266, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info())
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher block_device_info, power_on)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher block_device_info, power_on)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher domain.resume()
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher rv = execute(f,*args,**kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher rv = meth(*args,**kwargs)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virDomainResume() failed', dom=self)
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher libvirtError: Requested operation is not valid: domain is not running
2014-09-02 15:15:50.404 27963 TRACE oslo.messaging.rpc.dispatcher
2014-09-02 15:15:50.408 27963 ERROR oslo.messaging._drivers.common [-] Returning exception Requested operation is not valid: domain is not running to caller
2014-09-02 15:15:50.408 27963 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n incoming.message))\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n return self._do_dispatch(endpoint, method, ctxt, args)\n', ' File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n result = getattr(endpoint, method)(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 280, in decorated_function\n pass\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 266, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 333, in decorated_function\n function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in decorated_function\n e, sys.exc_info())\n', ' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in decorated_function\n return function(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3240, in finish_revert_resize\n block_device_info, power_on)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 5043, in finish_revert_migration\n block_device_info, power_on)\n', ' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3667, in _create_domain_and_network\n domain.resume()\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call\n rv = execute(f,*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker\n rv = meth(*args,**kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1784, in resume\n if ret == -1: raise libvirtError (\'virDomainResume() failed\', dom=self)\n', 'libvirtError: Requested operation is not valid: domain is not running\n']
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1364588/+subscriptions
Follow ups
References