yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1706949] [NEW] nova-api report error when generating keypairs

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Aodzip <aodzip@xxxxxxxxx>
Date: Thu, 27 Jul 2017 11:09:20 -0000
Reply-to: Bug 1706949 <1706949@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Description
===========
nova-api got an exception when i create keypair

Steps to reproduce
==================
generate keypair from horizon

Expected result
===============
I get a new keypair

Actual result
=============
HTTP 500

Environment
===========
Ubuntu Server 16.04.2

ii  nova-api                           2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - API frontend
ii  nova-common                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - common files
ii  nova-conductor                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - conductor service
ii  nova-consoleauth                   2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - Console Authenticator
ii  nova-novncproxy                    2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - NoVNC proxy
ii  nova-placement-api                 2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - placement API frontend
ii  nova-scheduler                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - virtual machine scheduler
ii  python-nova                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute Python libraries
ii  python-novaclient                  2:7.1.0-0ubuntu1~cloud0                    all          client library for OpenStack Compute API - Python 2.7

Logs & Configs
==============

2017-07-27 18:54:51.378 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
2017-07-27 18:54:51.386 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
2017-07-27 18:54:51.393 1380 INFO nova.osapi_compute.wsgi.server [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "GET /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 200 len: 841 time: 0.2768128
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unexpected exception in API method
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 338, in wrapped
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 116, in create
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return self._create(req, body)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 137, in _create
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     context, user_id, name, key_type)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 75, in wrapped
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     function_name, call_dict, binary)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.force_reraise()
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 66, in wrapped
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(self, context, *args, **kw)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4610, in create_key_pair
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     user_id, key_type)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4632, in _generate_key_pair
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return crypto.generate_key_pair()
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/crypto.py", line 132, in generate_key_pair
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     key = paramiko.RSAKey.generate(bits)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/paramiko/rsakey.py", line 156, in generate
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     public_exponent=65537, key_size=bits, backend=default_backend()
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/primitives/asymmetric/rsa.py", line 115, in generate_private_key
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return backend.generate_rsa_private_key(public_exponent, key_size)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/multibackend.py", line 137, in generate_rsa_private_key
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return b.generate_rsa_private_key(public_exponent, key_size)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 416, in generate_rsa_private_key
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.openssl_assert(res == 1)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 149, in openssl_assert
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return binding._openssl_assert(self._lib, ok)
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 62, in _openssl_assert
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     errors_with_text
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions InternalError: Unknown OpenSSL error. This error is commonly encountered when another library is not cleaning up the OpenSSL error stack. If you are using cryptography with another library that uses OpenSSL try disabling it before reporting a bug. Otherwise please file an issue at https://github.com/pyca/cryptography/issues with information on how to reproduce this. ([_OpenSSLErrorWithText(code=2147893649L, lib=128, func=100, reason=401, reason_text='error:80064191:lib(128):osrandom_init:getrandom() initialization failed with EAGAIN. Most likely Kernel CPRNG is not seeded yet.'), _OpenSSLErrorWithText(code=2147897744L, lib=128, func=101, reason=400, reason_text='error:80065190:lib(128):osrandom_rand_bytes:getrandom() initialization failed.'), _OpenSSLErrorWithText(code=67637251L, lib=4, func=129, reason=3, reason_text='error:04081003:rsa routines:RSA_BUILTIN_KEYGEN:BN lib')])
2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions
2017-07-27 18:54:53.185 1380 INFO nova.api.openstack.wsgi [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'cryptography.exceptions.InternalError'>
2017-07-27 18:54:53.188 1380 INFO nova.osapi_compute.wsgi.server [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "POST /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 500 len: 554 time: 0.3815529

PS: It only happened after I upgrade my cloud from Mitaka to Octata, it
is not a clean install. But i am not sure it is caused by upgrade.

** Affects: nova
     Importance: Undecided
         Status: New

** Description changed:

  Description
  ===========
  nova-api got an exception when i create keypair
  
  Steps to reproduce
  ==================
  generate keypair from horizon
- 
  
  Expected result
  ===============
  I get a new keypair
  
  Actual result
  =============
  HTTP 500
  
  Environment
  ===========
- Ubuntu Server 16.04.1
+ Ubuntu Server 16.04.2
  
  ii  nova-api                           2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - API frontend
  ii  nova-common                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - common files
  ii  nova-conductor                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - conductor service
  ii  nova-consoleauth                   2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - Console Authenticator
  ii  nova-novncproxy                    2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - NoVNC proxy
  ii  nova-placement-api                 2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - placement API frontend
  ii  nova-scheduler                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - virtual machine scheduler
  ii  python-nova                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute Python libraries
  ii  python-novaclient                  2:7.1.0-0ubuntu1~cloud0                    all          client library for OpenStack Compute API - Python 2.7
  
  Logs & Configs
  ==============
  
  2017-07-27 18:54:51.378 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
  2017-07-27 18:54:51.386 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
  2017-07-27 18:54:51.393 1380 INFO nova.osapi_compute.wsgi.server [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "GET /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 200 len: 841 time: 0.2768128
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unexpected exception in API method
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 338, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 116, in create
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return self._create(req, body)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 137, in _create
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     context, user_id, name, key_type)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 75, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     function_name, call_dict, binary)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.force_reraise()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 66, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(self, context, *args, **kw)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4610, in create_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     user_id, key_type)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4632, in _generate_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return crypto.generate_key_pair()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/crypto.py", line 132, in generate_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     key = paramiko.RSAKey.generate(bits)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/paramiko/rsakey.py", line 156, in generate
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     public_exponent=65537, key_size=bits, backend=default_backend()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/primitives/asymmetric/rsa.py", line 115, in generate_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return backend.generate_rsa_private_key(public_exponent, key_size)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/multibackend.py", line 137, in generate_rsa_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return b.generate_rsa_private_key(public_exponent, key_size)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 416, in generate_rsa_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.openssl_assert(res == 1)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 149, in openssl_assert
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return binding._openssl_assert(self._lib, ok)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 62, in _openssl_assert
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     errors_with_text
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions InternalError: Unknown OpenSSL error. This error is commonly encountered when another library is not cleaning up the OpenSSL error stack. If you are using cryptography with another library that uses OpenSSL try disabling it before reporting a bug. Otherwise please file an issue at https://github.com/pyca/cryptography/issues with information on how to reproduce this. ([_OpenSSLErrorWithText(code=2147893649L, lib=128, func=100, reason=401, reason_text='error:80064191:lib(128):osrandom_init:getrandom() initialization failed with EAGAIN. Most likely Kernel CPRNG is not seeded yet.'), _OpenSSLErrorWithText(code=2147897744L, lib=128, func=101, reason=400, reason_text='error:80065190:lib(128):osrandom_rand_bytes:getrandom() initialization failed.'), _OpenSSLErrorWithText(code=67637251L, lib=4, func=129, reason=3, reason_text='error:04081003:rsa routines:RSA_BUILTIN_KEYGEN:BN lib')])
- 2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions 
+ 2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions
  2017-07-27 18:54:53.185 1380 INFO nova.api.openstack.wsgi [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'cryptography.exceptions.InternalError'>
  2017-07-27 18:54:53.188 1380 INFO nova.osapi_compute.wsgi.server [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "POST /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 500 len: 554 time: 0.3815529
  
- 
- 
- PS: It only happened after I upgrade my cloud from Mitaka to Octata, it is not a clean install. But i am not sure it is caused by upgrade.
+ PS: It only happened after I upgrade my cloud from Mitaka to Octata, it
+ is not a clean install. But i am not sure it is caused by upgrade.

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1706949

Title:
  nova-api report error when generating keypairs

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========
  nova-api got an exception when i create keypair

  Steps to reproduce
  ==================
  generate keypair from horizon

  Expected result
  ===============
  I get a new keypair

  Actual result
  =============
  HTTP 500

  Environment
  ===========
  Ubuntu Server 16.04.2

  ii  nova-api                           2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - API frontend
  ii  nova-common                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - common files
  ii  nova-conductor                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - conductor service
  ii  nova-consoleauth                   2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - Console Authenticator
  ii  nova-novncproxy                    2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - NoVNC proxy
  ii  nova-placement-api                 2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - placement API frontend
  ii  nova-scheduler                     2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute - virtual machine scheduler
  ii  python-nova                        2:15.0.5-0ubuntu1~cloud0                   all          OpenStack Compute Python libraries
  ii  python-novaclient                  2:7.1.0-0ubuntu1~cloud0                    all          client library for OpenStack Compute API - Python 2.7

  Logs & Configs
  ==============

  2017-07-27 18:54:51.378 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
  2017-07-27 18:54:51.386 1380 WARNING oslo_db.sqlalchemy.utils [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unique keys not in sort_keys. The sorting order may be unstable.
  2017-07-27 18:54:51.393 1380 INFO nova.osapi_compute.wsgi.server [req-0ecb356b-5575-4d28-b8fa-a4f10b084ee8 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "GET /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 200 len: 841 time: 0.2768128
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] Unexpected exception in API method
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 338, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/validation/__init__.py", line 108, in wrapper
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 116, in create
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return self._create(req, body)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/keypairs.py", line 137, in _create
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     context, user_id, name, key_type)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 75, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     function_name, call_dict, binary)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.force_reraise()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 66, in wrapped
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return f(self, context, *args, **kw)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4610, in create_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     user_id, key_type)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 4632, in _generate_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return crypto.generate_key_pair()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/crypto.py", line 132, in generate_key_pair
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     key = paramiko.RSAKey.generate(bits)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/paramiko/rsakey.py", line 156, in generate
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     public_exponent=65537, key_size=bits, backend=default_backend()
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/primitives/asymmetric/rsa.py", line 115, in generate_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return backend.generate_rsa_private_key(public_exponent, key_size)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/multibackend.py", line 137, in generate_rsa_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return b.generate_rsa_private_key(public_exponent, key_size)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 416, in generate_rsa_private_key
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     self.openssl_assert(res == 1)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/backends/openssl/backend.py", line 149, in openssl_assert
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     return binding._openssl_assert(self._lib, ok)
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/cryptography/hazmat/bindings/openssl/binding.py", line 62, in _openssl_assert
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions     errors_with_text
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions InternalError: Unknown OpenSSL error. This error is commonly encountered when another library is not cleaning up the OpenSSL error stack. If you are using cryptography with another library that uses OpenSSL try disabling it before reporting a bug. Otherwise please file an issue at https://github.com/pyca/cryptography/issues with information on how to reproduce this. ([_OpenSSLErrorWithText(code=2147893649L, lib=128, func=100, reason=401, reason_text='error:80064191:lib(128):osrandom_init:getrandom() initialization failed with EAGAIN. Most likely Kernel CPRNG is not seeded yet.'), _OpenSSLErrorWithText(code=2147897744L, lib=128, func=101, reason=400, reason_text='error:80065190:lib(128):osrandom_rand_bytes:getrandom() initialization failed.'), _OpenSSLErrorWithText(code=67637251L, lib=4, func=129, reason=3, reason_text='error:04081003:rsa routines:RSA_BUILTIN_KEYGEN:BN lib')])
  2017-07-27 18:54:53.183 1380 ERROR nova.api.openstack.extensions
  2017-07-27 18:54:53.185 1380 INFO nova.api.openstack.wsgi [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'cryptography.exceptions.InternalError'>
  2017-07-27 18:54:53.188 1380 INFO nova.osapi_compute.wsgi.server [req-fb35bf2b-7a8e-47b6-9e3b-be0208abccc2 436e84be1b094483b0807e9bfd60f39d 46f322eba42a49989d74cf571d60fd34 - ca5003fb184e49ecab590c699114e5df ca5003fb184e49ecab590c699114e5df] 10.254.254.5,10.254.254.10 "POST /v2.1/46f322eba42a49989d74cf571d60fd34/os-keypairs HTTP/1.1" status: 500 len: 554 time: 0.3815529

  PS: It only happened after I upgrade my cloud from Mitaka to Octata,
  it is not a clean install. But i am not sure it is caused by upgrade.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1706949/+subscriptions
Follow ups

[Bug 1706949] Re: nova-api report error when generating keypairs
From: Launchpad Bug Tracker, 2017-09-26