← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1491758] [NEW] Unable to delete instance

 

Public bug reported:

Openstack version: Kilo

I am trying to delete an instance that was initially stuck in a Paused
and then an Error state. I gave up trying to bring it up again, however
now I am unable to delete it from Openstack.

I have taken the following steps:
1. I have initially tried to delete the instance directly from Openstack Dashboard while the instance was in an error state the operation was reported as being successful, however, the instance hasn't been removed.
2. I have tried resetting the state of the instance to Active: 
     $ nova reset-state --active 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
3. Deleted the instance using the nova-api:
     $ nova delete 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
     Request to delete server 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 has been accepted.

In addition, the Fault section of the instance on Openstack Dashboard
displays the following:

Message Cannot call obj_load_attr on orphaned Instance object
Code       500

None of these steps have been successful. I know that I can delete the
instance from the database, I would like to address this issue.

Logs from nova-api:
2015-09-03 11:06:31.364 2574 DEBUG nova.api.openstack.wsgi [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] Action: 'action', calling method: <bound method ConsoleOutputController.get_console_output of <nova.api.openstack.compute.contrib.console_output.ConsoleOutputController object at 0x7f8b724f0b90>>, body: {"os-getConsoleOutput": {"length": null}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
2015-09-03 11:06:31.365 2574 DEBUG nova.compute.api [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] [instance: a23088f2-444f-4de4-89e0-593e5502be41] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
2015-09-03 11:06:31.522 2574 INFO nova.osapi_compute.wsgi.server [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] 10.83.100.0 "POST /v2/d819429055d4416bbfc3d693b1571388/servers/a23088f2-444f-4de4-89e0-593e5502be41/action HTTP/1.1" status: 200 len: 8215 time: 0.2391620
2015-09-03 11:12:54.877 2586 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}4887951ff0677461e8630e305ace2b3194f3477c" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:12:54.960 2586 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418 vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:12:54 GMT content-type: application/json x-distribution: Ubuntu
RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:12:54.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["E1HDBQ7sQgudJje8VvW7rg"], "issued_at": "2015-09-03T10:12:54.864888"}}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:12:54.968 2586 DEBUG nova.api.openstack.wsgi [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
2015-09-03 11:12:54.969 2586 DEBUG nova.compute.api [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
2015-09-03 11:12:55.023 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
2015-09-03 11:12:55.076 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `fault' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
2015-09-03 11:12:55.083 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:12:55.221 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-50a0e8f9-2a03-4683-bad3-76f9b5f277b8
RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:12:55.222 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:12:55.239 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-e6d1a2eb-937a-4722-950d-2f6e8c9571a8
RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:12:55.241 2586 DEBUG nova.policy [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:12:54.964386', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
2015-09-03 11:12:55.249 2586 INFO nova.osapi_compute.wsgi.server [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 4618 time: 0.3758421
2015-09-03 11:12:55.262 2586 DEBUG nova.api.openstack.wsgi [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Action: 'action', calling method: <bound method AdminActionsController._reset_state of <nova.api.openstack.compute.contrib.admin_actions.AdminActionsController object at 0x7f8b724ed650>>, body: {"os-resetState": {"state": "active"}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
2015-09-03 11:12:55.265 2586 DEBUG nova.compute.api [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
2015-09-03 11:12:55.378 2586 INFO nova.osapi_compute.wsgi.server [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "POST /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1/action HTTP/1.1" status: 202 len: 209 time: 0.1182261
2015-09-03 11:13:01.557 2572 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}df241c7bed89648bf4587a06b175cb03874da3f3" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:13:01.633 2572 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:13:01 GMT content-type: application/json x-distribution: Ubuntu
RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:13:01.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["OdW70dg8RsuX9_sLI8rGmA"], "issued_at": "2015-09-03T10:13:01.543390"}}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:13:01.636 2572 DEBUG nova.api.openstack.wsgi [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
2015-09-03 11:13:01.637 2572 DEBUG nova.compute.api [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
2015-09-03 11:13:01.690 2572 DEBUG nova.objects.instance [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
2015-09-03 11:13:01.739 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:13:01.852 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-fc3d256a-4b06-4c20-912f-75df7772b05b
RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:13:01.853 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-09-03 11:13:01.874 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-cc8125b5-f785-4b1b-a8e1-0b881e812c3e
RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
 _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-09-03 11:13:01.876 2572 DEBUG nova.policy [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:13:01.635373', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-0f73aed5-274d-4d80-87b2-9730f0021028', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
2015-09-03 11:13:01.900 2572 INFO nova.osapi_compute.wsgi.server [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 1886 time: 0.3459690
2015-09-03 11:13:01.920 2572 DEBUG nova.api.openstack.wsgi [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.delete of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
2015-09-03 11:13:01.920 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
2015-09-03 11:13:01.975 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Going to try to terminate instance delete /usr/lib/python2.7/dist-packages/nova/compute/api.py:1823
2015-09-03 11:13:02.033 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Attempting to reserve resources for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a. Deltas: {'instances': -1, 'ram': -2048, 'cores': -1} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:550
2015-09-03 11:13:02.035 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quota limits for project 2ff06b822bab4d59a6f0bc81be34980f: {u'injected_file_content_bytes': 10240L, u'metadata_items': 128L, u'ram': 253952L, u'instances': 76L, u'injected_files': 5L, u'cores': 110L, 'project_id': u'2ff06b822bab4d59a6f0bc81be34980f'} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:559
2015-09-03 11:13:02.036 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:409
2015-09-03 11:13:02.038 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:565
2015-09-03 11:13:02.039 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for user c39a72988ef2478a930e627caa7f706a and project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:401
2015-09-03 11:13:02.047 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:573
2015-09-03 11:13:02.058 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Created reservations ['57b058ad-6211-4dc4-bc27-fa7c4cc1afc8', '3f03f96b-a9ff-401e-a001-6a0374ad6d99', 'effc6ea8-770b-45cb-a90a-5f7ef53715d7'] reserve /usr/lib/python2.7/dist-packages/nova/quota.py:1345
2015-09-03 11:13:02.078 2572 INFO nova.osapi_compute.wsgi.server [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "DELETE /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 204 len: 203 time: 0.1622531

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1491758

Title:
  Unable to delete instance

Status in OpenStack Compute (nova):
  New

Bug description:
  Openstack version: Kilo

  I am trying to delete an instance that was initially stuck in a Paused
  and then an Error state. I gave up trying to bring it up again,
  however now I am unable to delete it from Openstack.

  I have taken the following steps:
  1. I have initially tried to delete the instance directly from Openstack Dashboard while the instance was in an error state the operation was reported as being successful, however, the instance hasn't been removed.
  2. I have tried resetting the state of the instance to Active: 
       $ nova reset-state --active 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
  3. Deleted the instance using the nova-api:
       $ nova delete 27d8f8d0-efd5-42bd-9c56-4ddd159833d1
       Request to delete server 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 has been accepted.

  In addition, the Fault section of the instance on Openstack Dashboard
  displays the following:

  Message Cannot call obj_load_attr on orphaned Instance object
  Code       500

  None of these steps have been successful. I know that I can delete the
  instance from the database, I would like to address this issue.

  Logs from nova-api:
  2015-09-03 11:06:31.364 2574 DEBUG nova.api.openstack.wsgi [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] Action: 'action', calling method: <bound method ConsoleOutputController.get_console_output of <nova.api.openstack.compute.contrib.console_output.ConsoleOutputController object at 0x7f8b724f0b90>>, body: {"os-getConsoleOutput": {"length": null}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
  2015-09-03 11:06:31.365 2574 DEBUG nova.compute.api [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] [instance: a23088f2-444f-4de4-89e0-593e5502be41] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
  2015-09-03 11:06:31.522 2574 INFO nova.osapi_compute.wsgi.server [req-a663fee3-b720-4d9e-bc7d-646d4d80922b ba5daa262bb947079f9d2fc54f5e9234 d819429055d4416bbfc3d693b1571388 - - -] 10.83.100.0 "POST /v2/d819429055d4416bbfc3d693b1571388/servers/a23088f2-444f-4de4-89e0-593e5502be41/action HTTP/1.1" status: 200 len: 8215 time: 0.2391620
  2015-09-03 11:12:54.877 2586 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}4887951ff0677461e8630e305ace2b3194f3477c" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:12:54.960 2586 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418 vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:12:54 GMT content-type: application/json x-distribution: Ubuntu
  RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:12:54.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["E1HDBQ7sQgudJje8VvW7rg"], "issued_at": "2015-09-03T10:12:54.864888"}}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:12:54.968 2586 DEBUG nova.api.openstack.wsgi [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
  2015-09-03 11:12:54.969 2586 DEBUG nova.compute.api [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
  2015-09-03 11:12:55.023 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
  2015-09-03 11:12:55.076 2586 DEBUG nova.objects.instance [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `fault' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
  2015-09-03 11:12:55.083 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:12:55.221 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-50a0e8f9-2a03-4683-bad3-76f9b5f277b8
  RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:12:55.222 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}605ad7f8b06f1a6319321f83741e7dfa6a7b7418" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:12:55.239 2586 DEBUG keystoneclient.session [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:12:55 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-e6d1a2eb-937a-4722-950d-2f6e8c9571a8
  RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:12:55.241 2586 DEBUG nova.policy [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:12:54.964386', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
  2015-09-03 11:12:55.249 2586 INFO nova.osapi_compute.wsgi.server [req-622c5c35-d42c-4aa4-bf69-7cdae5f74ac5 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 4618 time: 0.3758421
  2015-09-03 11:12:55.262 2586 DEBUG nova.api.openstack.wsgi [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Action: 'action', calling method: <bound method AdminActionsController._reset_state of <nova.api.openstack.compute.contrib.admin_actions.AdminActionsController object at 0x7f8b724ed650>>, body: {"os-resetState": {"state": "active"}} _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:780
  2015-09-03 11:12:55.265 2586 DEBUG nova.compute.api [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
  2015-09-03 11:12:55.378 2586 INFO nova.osapi_compute.wsgi.server [req-fc719de9-1fee-409f-84c1-d621cbaaeb98 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "POST /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1/action HTTP/1.1" status: 202 len: 209 time: 0.1182261
  2015-09-03 11:13:01.557 2572 DEBUG keystoneclient.session [-] REQ: curl -g -i -X GET http://10.83.100.0:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}df241c7bed89648bf4587a06b175cb03874da3f3" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:13:01.633 2572 DEBUG keystoneclient.session [-] RESP: [200] content-length: 7110 x-subject-token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b vary: X-Auth-Token connection: keep-alive date: Thu, 03 Sep 2015 10:13:01 GMT content-type: application/json x-distribution: Ubuntu
  RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "9fe2ff9ee4384b1894a90878d3e92bab", "name": "_member_"}, {"id": "8d4178ea39e04db68e9d30c1105a2bd8", "name": "admin"}], "expires_at": "2015-09-06T10:13:01.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6560b54895bf4966bf332659f1c32b32", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "a5296228ddd6417eb8b63201fc258a6f", "name": "admin"}, "audit_ids": ["OdW70dg8RsuX9_sLI8rGmA"], "issued_at": "2015-09-03T10:13:01.543390"}}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:13:01.636 2572 DEBUG nova.api.openstack.wsgi [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
  2015-09-03 11:13:01.637 2572 DEBUG nova.compute.api [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
  2015-09-03 11:13:01.690 2572 DEBUG nova.objects.instance [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Lazy-loading `flavor' on Instance uuid 27d8f8d0-efd5-42bd-9c56-4ddd159833d1 obj_load_attr /usr/lib/python2.7/dist-packages/nova/objects/instance.py:995
  2015-09-03 11:13:01.739 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/ports.json?device_id=27d8f8d0-efd5-42bd-9c56-4ddd159833d1 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:13:01.852 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 728 x-openstack-request-id: req-fc3d256a-4b06-4c20-912f-75df7772b05b
  RESP BODY: {"ports": [{"status": "ACTIVE", "binding:host_id": "ncn11", "allowed_address_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:None", "binding:profile": {}, "fixed_ips": [{"subnet_id": "86086e12-391c-40aa-80f1-ce9301959ac2", "ip_address": "9.0.0.18"}], "id": "1cb1cd34-c0aa-4dd4-aa78-0a79480d0d19", "security_groups": ["2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"], "device_id": "27d8f8d0-efd5-42bd-9c56-4ddd159833d1", "name": "", "admin_state_up": true, "network_id": "cd99aa03-d389-434d-bc3b-de8e24fffe86", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "binding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:d8:a0:9f"}]}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:13:01.853 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] REQ: curl -g -i -X GET http://10.83.100.0:9696/v2.0/security-groups.json?id=2d3b5a93-c393-4bb3-a935-25cdf4c83bf4 -H "User-Agent: python-neutronclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}562ce1215c3032a56c12b0dbc9d082fcd2695c4b" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
  2015-09-03 11:13:01.874 2572 DEBUG keystoneclient.session [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] RESP: [200] date: Thu, 03 Sep 2015 10:13:01 GMT connection: keep-alive content-type: application/json; charset=UTF-8 content-length: 4803 x-openstack-request-id: req-cc8125b5-f785-4b1b-a8e1-0b881e812c3e
  RESP BODY: {"security_groups": [{"tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "description": "default", "id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "security_group_rules": [{"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "1d28e0cc-6a7f-4e41-b15a-cee8c92c934f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "2d282056-94c8-436e-a0ed-ee26c9e6437f", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "2deb60df-7e65-4d84-b654-de1f918a6b8c", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 35357, "port_range_min": 35357, "id": "384e5f48-981c-4069-9862-51ef2e35e6ef", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 80, "port_range_min": 80, "id": "41a2fa40-799f-41cc-917b-ebb19eeeea13", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv6", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "4a5c1956-bd13-40bc-92fb-78baab2f7e78", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 5000, "port_range_min": 5000, "id": "65bc71a9-c154-464b-b0df-befea3f837ee", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 22, "port_range_min": 22, "id": "7808440f-3b5f-49bc-993a-025afd06a116", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "8e79162f-d2e6-4cbf-bba3-73adffc20df3", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4", "direction": "ingress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "a0c0d46d-a649-4bce-8d33-7698083296c2", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "icmp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "bc7fb433-593d-4dd3-9333-0483b6562cd5", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "ingress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 8080, "port_range_min": 8080, "id": "d6ac50a1-414f-4369-a849-03dc5bc50dff", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": "0.0.0.0/0", "protocol": "tcp", "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": 9999, "port_range_min": 9000, "id": "e9c7122a-eb6b-4ed8-a514-4cf7d6bae387", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}, {"remote_group_id": null, "direction": "egress", "remote_ip_prefix": null, "protocol": null, "ethertype": "IPv4", "tenant_id": "2ff06b822bab4d59a6f0bc81be34980f", "port_range_max": null, "port_range_min": null, "id": "fc045c0a-757c-4cc4-af35-7540a0d3fd80", "security_group_id": "2d3b5a93-c393-4bb3-a935-25cdf4c83bf4"}], "name": "default"}]}
   _http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
  2015-09-03 11:13:01.876 2572 DEBUG nova.policy [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Policy check for compute_extension:hide_server_addresses failed with credentials {'domain': None, 'project_name': u'admin', 'project_domain': None, 'timestamp': '2015-09-03T10:13:01.635373', 'remote_address': '10.83.100.0', 'quota_class': None, 'resource_uuid': None, 'is_admin': True, 'user': u'a5296228ddd6417eb8b63201fc258a6f', 'service_catalog': [{u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v1/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v1/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32', u'region': u'regionOne', u'internalURL': u'http://10.83.100.0:9696/v2/6560b54895bf4966bf332659f1c32b32', u'publicURL': u'http://10.83.100.0:8776/v2/6560b54895bf4966bf332659f1c32b32'}], u'type': u'volumev2', u'name': u'cinderv2'}], 'tenant': u'6560b54895bf4966bf332659f1c32b32', 'read_only': False, 'project_id': u'6560b54895bf4966bf332659f1c32b32', 'user_id': u'a5296228ddd6417eb8b63201fc258a6f', 'show_deleted': False, 'roles': [u'_member_', u'admin'], 'user_identity': 'a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -', 'read_deleted': 'no', 'request_id': 'req-0f73aed5-274d-4d80-87b2-9730f0021028', 'instance_lock_checked': False, 'user_domain': None, 'user_name': u'admin'} enforce /usr/lib/python2.7/dist-packages/nova/policy.py:104
  2015-09-03 11:13:01.900 2572 INFO nova.osapi_compute.wsgi.server [req-0f73aed5-274d-4d80-87b2-9730f0021028 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "GET /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 200 len: 1886 time: 0.3459690
  2015-09-03 11:13:01.920 2572 DEBUG nova.api.openstack.wsgi [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Calling method '<bound method Controller.delete of <nova.api.openstack.compute.servers.Controller object at 0x7f8b729f7d10>>' _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:783
  2015-09-03 11:13:01.920 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Fetching instance by UUID get /usr/lib/python2.7/dist-packages/nova/compute/api.py:1911
  2015-09-03 11:13:01.975 2572 DEBUG nova.compute.api [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] [instance: 27d8f8d0-efd5-42bd-9c56-4ddd159833d1] Going to try to terminate instance delete /usr/lib/python2.7/dist-packages/nova/compute/api.py:1823
  2015-09-03 11:13:02.033 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Attempting to reserve resources for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a. Deltas: {'instances': -1, 'ram': -2048, 'cores': -1} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:550
  2015-09-03 11:13:02.035 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quota limits for project 2ff06b822bab4d59a6f0bc81be34980f: {u'injected_file_content_bytes': 10240L, u'metadata_items': 128L, u'ram': 253952L, u'instances': 76L, u'injected_files': 5L, u'cores': 110L, 'project_id': u'2ff06b822bab4d59a6f0bc81be34980f'} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:559
  2015-09-03 11:13:02.036 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:409
  2015-09-03 11:13:02.038 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:565
  2015-09-03 11:13:02.039 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Getting quotas for user c39a72988ef2478a930e627caa7f706a and project 2ff06b822bab4d59a6f0bc81be34980f. Resources: ['instances', 'ram', 'cores'] _get_quotas /usr/lib/python2.7/dist-packages/nova/quota.py:401
  2015-09-03 11:13:02.047 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Quotas for project 2ff06b822bab4d59a6f0bc81be34980f and user c39a72988ef2478a930e627caa7f706a after resource sync: {'instances': 76L, 'ram': 253952L, 'cores': 110L} reserve /usr/lib/python2.7/dist-packages/nova/quota.py:573
  2015-09-03 11:13:02.058 2572 DEBUG nova.quota [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] Created reservations ['57b058ad-6211-4dc4-bc27-fa7c4cc1afc8', '3f03f96b-a9ff-401e-a001-6a0374ad6d99', 'effc6ea8-770b-45cb-a90a-5f7ef53715d7'] reserve /usr/lib/python2.7/dist-packages/nova/quota.py:1345
  2015-09-03 11:13:02.078 2572 INFO nova.osapi_compute.wsgi.server [req-284d1749-7b04-4388-940f-3677d55f9415 a5296228ddd6417eb8b63201fc258a6f 6560b54895bf4966bf332659f1c32b32 - - -] 10.83.100.0 "DELETE /v2/6560b54895bf4966bf332659f1c32b32/servers/27d8f8d0-efd5-42bd-9c56-4ddd159833d1 HTTP/1.1" status: 204 len: 203 time: 0.1622531

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1491758/+subscriptions


Follow ups