← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1491758] Re: Unable to delete instance

 

** Changed in: nova
       Status: Incomplete => Opinion

** Changed in: nova
       Status: Opinion => Invalid

** Description changed:

  Openstack version: Kilo
  
  I am trying to delete an instance that was initially stuck in a Paused
  and then an Error state. I gave up trying to bring it up again, however
  now I am unable to delete it from Openstack.
  
  I have taken the following steps:
  1. I have initially tried to delete the instance directly from Openstack Dashboard while the instance was in an error state the operation was reported as being successful, however, the instance hasn't been removed.
- 2. I have tried resetting the state of the instance to Active: 
-      $ nova reset-state --active 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
+ 2. I have tried resetting the state of the instance to Active:
+      $ nova reset-state --active 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
  3. Deleted the instance using the nova-api:
-      $ nova delete 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
-      Request to delete server 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 has been accepted.
- 
- In addition, the Fault section of the instance on Openstack Dashboard
- displays the following:
- 
- Message Cannot call obj_load_attr on orphaned Instance object
- Code       500
- 
- None of these steps have been successful. I know that I can delete the
- instance from the database, I would like to address this issue.
- 
- Logs from nova-api:
- 2015-09-03 11:06:31.364 2574 DEBUG nova.api.openstack.wsgi [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] Action: 'action', calling method: <bound method ConsoleOutputController.get_console_output of <nova.api.openstack.compute.contrib.console_output.ConsoleOutputController object at 0x7f8b724f0b90>>, body: {"os-getConsoleOutput": {"length": null}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
- 2015-09-03 11:06:31.365 2574 DEBUG nova.compute.api [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] [instance: a23088f2-444f-4de4-89e0-593e5502be41] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
- 2015-09-03 11:06:31.522 2574 INFO nova.osapi_compute.wsgi.server [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] 10.83.100.0 "POST /v2/d819429055d4416bbfc3d693b1571388/servers/a23088f2-444f-4de4-89e0-593e5502be41/action HTTP/1.1" status: 200 len: 8215 time: 0.2391620
- 2015-09-03 11:12:54.877 2586 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}4887951ff0677461e8630e305ace2b3194f3477c" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:12:54.960 2586 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418 vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:12:54 GMT content-type: application/json x-distribution: Ubuntu
- RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:12:54.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["E1HDBQ7sQgudJje8VvW7rg"], "issued_at": "2015-09-03T10:12:54.864888"}}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:12:54.968 2586 DEBUG nova.api.openstack.wsgi [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
- 2015-09-03 11:12:54.969 2586 DEBUG nova.compute.api [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
- 2015-09-03 11:12:55.023 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
- 2015-09-03 11:12:55.076 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `fault' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
- 2015-09-03 11:12:55.083 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:12:55.221 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-50a0e8f9-2a03-4683-bad3-76f9b5f277b8
- RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:12:55.222 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:12:55.239 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-e6d1a2eb-937a-4722-950d-2f6e8c9571a8
- RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:12:55.241 2586 DEBUG nova.policy [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:12:54.964386', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
- 2015-09-03 11:12:55.249 2586 INFO nova.osapi_compute.wsgi.server [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 4618 time: 0.3758421
- 2015-09-03 11:12:55.262 2586 DEBUG nova.api.openstack.wsgi [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Action: 'action', calling method: <bound method AdminActionsController._reset_state of <nova.api.openstack.compute.contrib.admin_actions.AdminActionsController object at 0x7f8b724ed650>>, body: {"os-resetState": {"state": "active"}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
- 2015-09-03 11:12:55.265 2586 DEBUG nova.compute.api [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
- 2015-09-03 11:12:55.378 2586 INFO nova.osapi_compute.wsgi.server [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "POST /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1/action HTTP/1.1" status: 202 len: 209 time: 0.1182261
- 2015-09-03 11:13:01.557 2572 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}df241c7bed89648bf4587a06b175cb03874da3f3" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:13:01.633 2572 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:13:01 GMT content-type: application/json x-distribution: Ubuntu
- RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:13:01.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["OdW70dg8RsuX9_sLI8rGmA"], "issued_at": "2015-09-03T10:13:01.543390"}}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:13:01.636 2572 DEBUG nova.api.openstack.wsgi [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
- 2015-09-03 11:13:01.637 2572 DEBUG nova.compute.api [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
- 2015-09-03 11:13:01.690 2572 DEBUG nova.objects.instance [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
- 2015-09-03 11:13:01.739 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:13:01.852 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-fc3d256a-4b06-4c20-912f-75df7772b05b
- RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:13:01.853 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
- 2015-09-03 11:13:01.874 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-cc8125b5-f785-4b1b-a8e1-0b881e812c3e
- RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
-  _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
- 2015-09-03 11:13:01.876 2572 DEBUG nova.policy [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:13:01.635373', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-0f73aed5-274d-4d80-87b2-9730f0021028', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
- 2015-09-03 11:13:01.900 2572 INFO nova.osapi_compute.wsgi.server [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 1886 time: 0.3459690
- 2015-09-03 11:13:01.920 2572 DEBUG nova.api.openstack.wsgi [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.delete of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
- 2015-09-03 11:13:01.920 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
- 2015-09-03 11:13:01.975 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Going to try to terminate instance delete /usr/lib/python2.7/dist-packages/nova/compute/api.py:1823
- 2015-09-03 11:13:02.033 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Attempting to reserve resources for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a. Deltas: {'instances': -1, 'ram': -2048, 'cores': -1} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:550
- 2015-09-03 11:13:02.035 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quota limits for project 2ff06b822bab4d59a6f0bc81be34980f: {u'injected_file_content_bytes': 10240L, u'metadata_items': 128L, u'ram': 253952L, u'instances': 76L, u'injected_files': 5L, u'cores': 110L, 'project_id': u'2ff06b822bab4d59a6f0bc81be34980f'} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:559
- 2015-09-03 11:13:02.036 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:409
- 2015-09-03 11:13:02.038 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:565
- 2015-09-03 11:13:02.039 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for user c39a72988ef2478a930e627caa7f706a and project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:401
- 2015-09-03 11:13:02.047 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:573
- 2015-09-03 11:13:02.058 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Created reservations ['57b058ad-6211-4dc4-bc27-fa7c4cc1afc8', '3f03f96b-a9ff-401e-a001-6a0374ad6d99', 'effc6ea8-770b-45cb-a90a-5f7ef53715d7'] reserve /usr/lib/python2.7/dist-packages/nova/quota.py:1345
- 2015-09-03 11:13:02.078 2572 INFO nova.osapi_compute.wsgi.server [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "DELETE /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 204 len: 203 time: 0.1622531
+      $ nova delete 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
+      Request to delete server 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 has been accepted.

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1491758

Title:
  Unable to delete instance

Status in OpenStack Compute (nova):
  Invalid

Bug description:
  Openstack version: Kilo

  I am trying to delete an instance that was initially stuck in a Paused
  and then an Error state. I gave up trying to bring it up again,
  however now I am unable to delete it from Openstack.

  I have taken the following steps:
  1. I have initially tried to delete the instance directly from Openstack Dashboard while the instance was in an error state the operation was reported as being successful, however, the instance hasn't been removed.
  2. I have tried resetting the state of the instance to Active:
       $ nova reset-state --active 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
  3. Deleted the instance using the nova-api:
       $ nova delete 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
       Request to delete server 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 has been accepted.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1491758/+subscriptions


References