yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1736368] [NEW] Create Instance failed （Internal error）

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: vinlin126com <1736368@xxxxxxxxxxxxxxxxxx>
Date: Tue, 05 Dec 2017 09:35:06 -0000
Reply-to: Bug 1736368 <1736368@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Hi， i have installed openstack on my centos7 which hosted on vmware workstastion machine. glance images-list is fine.
but nova image-list fail,and create vm instance fail. log file is following.

/var/log/nova/nova-api.conf
2017-12-05 17:26:38.052 2353 INFO nova.osapi_compute.wsgi.server [req-aa4a2b3c-d623-4a4e-bce2-59328d7154ce a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/flavors/f31fa21a-9730-4b5d-be40-b94cca89f576/os-extra_specs HTTP/1.1" status: 200 len: 351 time: 0.0245221
2017-12-05 17:26:38.101 2350 INFO nova.osapi_compute.wsgi.server [req-11bf5ef8-7dae-4a78-b795-e53f27e2ea52 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/limits?reserved=1 HTTP/1.1" status: 200 len: 844 time: 2.2066791
2017-12-05 17:26:38.456 2350 INFO nova.osapi_compute.wsgi.server [req-494b7dfb-fce1-4b9f-b292-fe42fc04464d a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/os-server-groups HTTP/1.1" status: 200 len: 353 time: 0.2469988
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] Unexpected exception in API method
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 338, in wrapped
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 642, in create
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     **create_kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     rv = f(*args, **kwargs)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1620, in create
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     check_server_group_quota=check_server_group_quota)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1170, in _create_instance
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image_id, boot_meta = self._get_image(context, image_href)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 806, in _get_image
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image = self.image_api.get(context, image_href)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/api.py", line 95, in get
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     show_deleted=show_deleted)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 468, in show
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     _reraise_translated_image_exception(image_id)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 1050, in _reraise_translated_image_exception
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     six.reraise(type(new_exc), new_exc, exc_trace)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 466, in show
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image = self._client.call(context, 2, 'get', image_id)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 164, in call
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     version)
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 149, in _create_onetime_client
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     self.api_servers = get_api_servers()
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 114, in get_api_servers
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     for api_server in CONF.glance.api_servers:
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions TypeError: 'NoneType' object is not iterable
2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions 
2017-12-05 17:26:50.483 2350 INFO nova.api.openstack.wsgi [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'>
2017-12-05 17:26:50.484 2350 INFO nova.osapi_compute.wsgi.server [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "POST /v2.1/servers HTTP/1.1" status: 500 len: 560 time: 


i have check glance conf file ,inclued glance-api.conf and glance-
register.conf, the passwd/user is corrent ,and the same as mysql user
glance used.

[openstack@nod130 ~]$ glance image-list
+--------------------------------------+---------+
| ID                                   | Name    |
+--------------------------------------+---------+
| 2d95e791-c81b-4213-b7fc-807e5218aee4 | cirros  |
| 7d40a83a-3b31-4071-b364-04c1436f6ca7 | cirros2 |
+--------------------------------------+---------+
[openstack@nod130 ~]$ nova image-list
WARNING: Command image-list is deprecated and will be removed after Nova 15.0.0 is released. Use python-glanceclient or openstackclient instead
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-451d7114-c3d4-40ad-b2b7-da640b8f130b)


system version info:
[root@nod130 /]# rpm -qa |grep openstack
openstack-neutron-linuxbridge-10.0.4-1.el7.noarch
openstack-nova-novncproxy-15.0.8-1.el7.noarch
openstack-neutron-common-10.0.4-1.el7.noarch
openstack-nova-scheduler-15.0.8-1.el7.noarch
python-openstackclient-3.8.1-1.el7.noarch
openstack-nova-conductor-15.0.8-1.el7.noarch
openstack-nova-console-15.0.8-1.el7.noarch
python2-django-openstack-auth-3.1.1-1.el7.noarch
centos-release-openstack-ocata-1-2.el7.noarch
openstack-nova-common-15.0.8-1.el7.noarch
openstack-neutron-ml2-10.0.4-1.el7.noarch
openstack-selinux-0.8.7-1.el7.noarch
openstack-dashboard-11.0.4-1.el7.noarch
openstack-nova-api-15.0.8-1.el7.noarch
openstack-neutron-10.0.4-1.el7.noarch
python2-openstacksdk-0.9.13-1.el7.noarch
openstack-keystone-11.0.3-1.el7.noarch
openstack-glance-14.0.0-2.el7.noarch
openstack-nova-placement-api-15.0.8-1.el7.noarch
[root@nod130 /]# 


[root@nod130 /]# cat /proc/version
Linux version 3.10.0-693.5.2.el7.x86_64 (builder@xxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Fri Oct 20 20:32:50 UTC 2017

so need your help .thanks.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1736368

Title:
  Create Instance failed （Internal error）

Status in OpenStack Compute (nova):
  New

Bug description:
  Hi， i have installed openstack on my centos7 which hosted on vmware workstastion machine. glance images-list is fine.
  but nova image-list fail,and create vm instance fail. log file is following.

  /var/log/nova/nova-api.conf
  2017-12-05 17:26:38.052 2353 INFO nova.osapi_compute.wsgi.server [req-aa4a2b3c-d623-4a4e-bce2-59328d7154ce a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/flavors/f31fa21a-9730-4b5d-be40-b94cca89f576/os-extra_specs HTTP/1.1" status: 200 len: 351 time: 0.0245221
  2017-12-05 17:26:38.101 2350 INFO nova.osapi_compute.wsgi.server [req-11bf5ef8-7dae-4a78-b795-e53f27e2ea52 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/limits?reserved=1 HTTP/1.1" status: 200 len: 844 time: 2.2066791
  2017-12-05 17:26:38.456 2350 INFO nova.osapi_compute.wsgi.server [req-494b7dfb-fce1-4b9f-b292-fe42fc04464d a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "GET /v2.1/os-server-groups HTTP/1.1" status: 200 len: 353 time: 0.2469988
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] Unexpected exception in API method
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 338, in wrapped
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 642, in create
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     **create_kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 154, in inner
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     rv = f(*args, **kwargs)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1620, in create
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     check_server_group_quota=check_server_group_quota)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1170, in _create_instance
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image_id, boot_meta = self._get_image(context, image_href)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 806, in _get_image
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image = self.image_api.get(context, image_href)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/api.py", line 95, in get
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     show_deleted=show_deleted)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 468, in show
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     _reraise_translated_image_exception(image_id)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 1050, in _reraise_translated_image_exception
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     six.reraise(type(new_exc), new_exc, exc_trace)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 466, in show
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     image = self._client.call(context, 2, 'get', image_id)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 164, in call
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     version)
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 149, in _create_onetime_client
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     self.api_servers = get_api_servers()
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 114, in get_api_servers
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions     for api_server in CONF.glance.api_servers:
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions TypeError: 'NoneType' object is not iterable
  2017-12-05 17:26:50.482 2350 ERROR nova.api.openstack.extensions 
  2017-12-05 17:26:50.483 2350 INFO nova.api.openstack.wsgi [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'>
  2017-12-05 17:26:50.484 2350 INFO nova.osapi_compute.wsgi.server [req-d7e00de6-0ddd-44e9-a0b7-245e1de4fca5 a423338af20648268007ce109c139069 f1df077dd06349b8a919e189441b736d - default default] 192.168.30.130 "POST /v2.1/servers HTTP/1.1" status: 500 len: 560 time: 


  i have check glance conf file ,inclued glance-api.conf and glance-
  register.conf, the passwd/user is corrent ,and the same as mysql user
  glance used.

  [openstack@nod130 ~]$ glance image-list
  +--------------------------------------+---------+
  | ID                                   | Name    |
  +--------------------------------------+---------+
  | 2d95e791-c81b-4213-b7fc-807e5218aee4 | cirros  |
  | 7d40a83a-3b31-4071-b364-04c1436f6ca7 | cirros2 |
  +--------------------------------------+---------+
  [openstack@nod130 ~]$ nova image-list
  WARNING: Command image-list is deprecated and will be removed after Nova 15.0.0 is released. Use python-glanceclient or openstackclient instead
  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-451d7114-c3d4-40ad-b2b7-da640b8f130b)

  
  system version info:
  [root@nod130 /]# rpm -qa |grep openstack
  openstack-neutron-linuxbridge-10.0.4-1.el7.noarch
  openstack-nova-novncproxy-15.0.8-1.el7.noarch
  openstack-neutron-common-10.0.4-1.el7.noarch
  openstack-nova-scheduler-15.0.8-1.el7.noarch
  python-openstackclient-3.8.1-1.el7.noarch
  openstack-nova-conductor-15.0.8-1.el7.noarch
  openstack-nova-console-15.0.8-1.el7.noarch
  python2-django-openstack-auth-3.1.1-1.el7.noarch
  centos-release-openstack-ocata-1-2.el7.noarch
  openstack-nova-common-15.0.8-1.el7.noarch
  openstack-neutron-ml2-10.0.4-1.el7.noarch
  openstack-selinux-0.8.7-1.el7.noarch
  openstack-dashboard-11.0.4-1.el7.noarch
  openstack-nova-api-15.0.8-1.el7.noarch
  openstack-neutron-10.0.4-1.el7.noarch
  python2-openstacksdk-0.9.13-1.el7.noarch
  openstack-keystone-11.0.3-1.el7.noarch
  openstack-glance-14.0.0-2.el7.noarch
  openstack-nova-placement-api-15.0.8-1.el7.noarch
  [root@nod130 /]# 

  
  [root@nod130 /]# cat /proc/version
  Linux version 3.10.0-693.5.2.el7.x86_64 (builder@xxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Fri Oct 20 20:32:50 UTC 2017

  so need your help .thanks.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1736368/+subscriptions
Follow ups

[Bug 1736368] Re: Create Instance failed （Internal error）
From: vinlin126com, 2017-12-14