← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #32092

[Bug 1446017] [NEW] In Kilo code release, nova boot failed on keystoneclient returns 500 error

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

nova --debug boot --flavor 1 --image dockerc7  --nic net-id=40945ae1-344c-4ebd-a25b-2776feb0f409 d01
.......

DEBUG (iso8601:184) Parsed 2015-04-19T22:56:02Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'22', 'daydash': u'19', 'tz_hour': None, 'month': None, 'timezone': u'Z', 'second': u'02', 'tz_minute': None, 'year': u'2015', 'separator': u'T', 'monthdash': u'04', 'day': None, 'minute': u'56'} with default timezone <iso8601.iso8601.Utc object at 0x16becd0>
DEBUG (iso8601:140) Got u'2015' for 'year' with default None
DEBUG (iso8601:140) Got u'04' for 'monthdash' with default 1
DEBUG (iso8601:140) Got 4 for 'month' with default 4
DEBUG (iso8601:140) Got u'19' for 'daydash' with default 1
DEBUG (iso8601:140) Got 19 for 'day' with default 19
DEBUG (iso8601:140) Got u'22' for 'hour' with default None
DEBUG (iso8601:140) Got u'56' for 'minute' with default None
DEBUG (iso8601:140) Got u'02' for 'second' with default None
DEBUG (iso8601:184) Parsed 2015-04-19T22:56:02Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'22', 'daydash': u'19', 'tz_hour': None, 'month': None, 'timezone': u'Z', 'second': u'02', 'tz_minute': None, 'year': u'2015', 'separator': u'T', 'monthdash': u'04', 'day': None, 'minute': u'56'} with default timezone <iso8601.iso8601.Utc object at 0x16becd0>
DEBUG (iso8601:140) Got u'2015' for 'year' with default None
DEBUG (iso8601:140) Got u'04' for 'monthdash' with default 1
DEBUG (iso8601:140) Got 4 for 'month' with default 4
DEBUG (iso8601:140) Got u'19' for 'daydash' with default 1
DEBUG (iso8601:140) Got 19 for 'day' with default 19
DEBUG (iso8601:140) Got u'22' for 'hour' with default None
DEBUG (iso8601:140) Got u'56' for 'minute' with default None
DEBUG (iso8601:140) Got u'02' for 'second' with default None
DEBUG (session:195) REQ: curl -g -i -X POST http://10.0.0.244:8774/v2/959d7f7e020b48509aea18dcec819491/servers -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d66f80c62fd0af6d801994e38c69d8e2a1833370" -d '{"server": {"name": "d01", "imageRef": "b4ca9864-9ceb-4b42-9c82-620f0e2fd60d", "flavorRef": "1", "max_count": 1, "min_count": 1, "networks": [{"uuid": "40945ae1-344c-4ebd-a25b-2776feb0f409"}]}}'
DEBUG (retry:155) Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0)
DEBUG (connectionpool:383) "POST /v2/959d7f7e020b48509aea18dcec819491/servers HTTP/1.1" 500 128
DEBUG (session:223) RESP:
DEBUG (shell:914) The server has either erred or is incapable of performing the requested operation. (HTTP 500)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 911, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 838, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/site-packages/novaclient/v2/shell.py", line 500, in do_boot
    server = cs.servers.create(*boot_args, **boot_kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 929, in create
    **boot_kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 557, in _boot
    return_raw=return_raw, **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 152, in _create
    _resp, body = self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/site-packages/keystoneclient/adapter.py", line 171, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 97, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500)
ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500)


Traced back found the http 500 was returned by  request() in sessions.py, even the token string was valid.

> /usr/lib/python2.7/site-packages/requests/sessions.py(309)request()-><Response [500]>
-> return resp
(Pdb) 
> /usr/lib/python2.7/site-packages/keystoneclient/session.py(435)_send_request()
-> if log:
(Pdb) p resp
<Response [500]>
(Pdb) p resp.status_code
500

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1446017

Title:
  In Kilo code release, nova boot failed on keystoneclient returns 500
  error

Status in OpenStack Compute (Nova):
  New

Bug description:
  nova --debug boot --flavor 1 --image dockerc7  --nic net-id=40945ae1-344c-4ebd-a25b-2776feb0f409 d01
  .......

  DEBUG (iso8601:184) Parsed 2015-04-19T22:56:02Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'22', 'daydash': u'19', 'tz_hour': None, 'month': None, 'timezone': u'Z', 'second': u'02', 'tz_minute': None, 'year': u'2015', 'separator': u'T', 'monthdash': u'04', 'day': None, 'minute': u'56'} with default timezone <iso8601.iso8601.Utc object at 0x16becd0>
  DEBUG (iso8601:140) Got u'2015' for 'year' with default None
  DEBUG (iso8601:140) Got u'04' for 'monthdash' with default 1
  DEBUG (iso8601:140) Got 4 for 'month' with default 4
  DEBUG (iso8601:140) Got u'19' for 'daydash' with default 1
  DEBUG (iso8601:140) Got 19 for 'day' with default 19
  DEBUG (iso8601:140) Got u'22' for 'hour' with default None
  DEBUG (iso8601:140) Got u'56' for 'minute' with default None
  DEBUG (iso8601:140) Got u'02' for 'second' with default None
  DEBUG (iso8601:184) Parsed 2015-04-19T22:56:02Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'22', 'daydash': u'19', 'tz_hour': None, 'month': None, 'timezone': u'Z', 'second': u'02', 'tz_minute': None, 'year': u'2015', 'separator': u'T', 'monthdash': u'04', 'day': None, 'minute': u'56'} with default timezone <iso8601.iso8601.Utc object at 0x16becd0>
  DEBUG (iso8601:140) Got u'2015' for 'year' with default None
  DEBUG (iso8601:140) Got u'04' for 'monthdash' with default 1
  DEBUG (iso8601:140) Got 4 for 'month' with default 4
  DEBUG (iso8601:140) Got u'19' for 'daydash' with default 1
  DEBUG (iso8601:140) Got 19 for 'day' with default 19
  DEBUG (iso8601:140) Got u'22' for 'hour' with default None
  DEBUG (iso8601:140) Got u'56' for 'minute' with default None
  DEBUG (iso8601:140) Got u'02' for 'second' with default None
  DEBUG (session:195) REQ: curl -g -i -X POST http://10.0.0.244:8774/v2/959d7f7e020b48509aea18dcec819491/servers -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}d66f80c62fd0af6d801994e38c69d8e2a1833370" -d '{"server": {"name": "d01", "imageRef": "b4ca9864-9ceb-4b42-9c82-620f0e2fd60d", "flavorRef": "1", "max_count": 1, "min_count": 1, "networks": [{"uuid": "40945ae1-344c-4ebd-a25b-2776feb0f409"}]}}'
  DEBUG (retry:155) Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0)
  DEBUG (connectionpool:383) "POST /v2/959d7f7e020b48509aea18dcec819491/servers HTTP/1.1" 500 128
  DEBUG (session:223) RESP:
  DEBUG (shell:914) The server has either erred or is incapable of performing the requested operation. (HTTP 500)
  Traceback (most recent call last):
    File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 911, in main
      OpenStackComputeShell().main(argv)
    File "/usr/lib/python2.7/site-packages/novaclient/shell.py", line 838, in main
      args.func(self.cs, args)
    File "/usr/lib/python2.7/site-packages/novaclient/v2/shell.py", line 500, in do_boot
      server = cs.servers.create(*boot_args, **boot_kwargs)
    File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 929, in create
      **boot_kwargs)
    File "/usr/lib/python2.7/site-packages/novaclient/v2/servers.py", line 557, in _boot
      return_raw=return_raw, **kwargs)
    File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 152, in _create
      _resp, body = self.api.client.post(url, body=body)
    File "/usr/lib/python2.7/site-packages/keystoneclient/adapter.py", line 171, in post
      return self.request(url, 'POST', **kwargs)
    File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 97, in request
      raise exceptions.from_response(resp, body, url, method)
  ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500)
  ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500)

  
  Traced back found the http 500 was returned by  request() in sessions.py, even the token string was valid.

  > /usr/lib/python2.7/site-packages/requests/sessions.py(309)request()-><Response [500]>
  -> return resp
  (Pdb) 
  > /usr/lib/python2.7/site-packages/keystoneclient/session.py(435)_send_request()
  -> if log:
  (Pdb) p resp
  <Response [500]>
  (Pdb) p resp.status_code
  500

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1446017/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next