yahoo-eng-team team mailing list archive

Thread
Date
[Bug 940430] Re: nova-api should check UTF8 char in parameters

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Joe Gordon <940430@xxxxxxxxxxxxxxxxxx>
Date: Fri, 06 Jun 2014 07:05:53 -0000
Reply-to: Bug 940430 <940430@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Changed in: nova
       Status: In Progress => Invalid

** Changed in: nova
       Status: Invalid => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/940430

Title:
  nova-api should check UTF8 char in parameters

Status in OpenStack Compute (Nova):
  Confirmed

Bug description:
  I got following error.

  root@localhost:~# nova --debug list
  connect: (keystone.thefreecloud.org, 5000)
  send: 'POST /v2.0/tokens HTTP/1.1\r\nHost: keystone.thefreecloud.org:5000\r\nContent-Length: 108\r\ncontent-type: application/json\r\naccept-encoding: gzip, deflate\r\nuser-agent: python-novaclient\r\n\r\n{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "XXXXXXXXX"}}}'
  reply: 'HTTP/1.1 200 OK\r\n'
  header: Content-Type: application/json; charset=UTF-8
  header: Content-Length: 1148
  header: Date: Fri, 24 Feb 2012 16:13:00 GMT
  connect: (nova-api.thefreecloud.org, 8774)
  send: u'GET /v1.1/1/servers/detail HTTP/1.1\r\nHost: nova-api.thefreecloud.org:8774\r\nx-auth-project-id: admin\r\nx-auth-token: XXXXXXXXXXXXXXXXXX g\r\naccept-encoding: gzip, deflate\r\nuser-agent: python-novaclient\r\n\r\n'
  reply: 'HTTP/1.1 500 Internal Server Error\r\n'
  header: Content-Length: 133
  header: Content-Type: application/json; charset=UTF-8
  header: Date: Fri, 24 Feb 2012 16:13:00 GMT
  Traceback (most recent call last):
    File "/usr/local/bin/nova", line 9, in <module>
      load_entry_point('python-novaclient==2012.1', 'console_scripts', 'nova')()
    File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 338, in main
      OpenStackComputeShell().main(sys.argv[1:])
    File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 289, in main
      args.func(self.cs, args)
    File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/shell.py", line 480, in do_list
      utils.print_list(cs.servers.list(search_opts=search_opts), columns,
    File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/servers.py", line 247, in list
      return self._list("/servers%s%s" % (detail, query_string), "servers")
    File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 69, in _list
      resp, body = self.api.client.get(url)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 130, in get
      return self._cs_request(url, 'GET', **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 118, in _cs_request
      **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 101, in request
      raise exceptions.from_response(resp, body)
  novaclient.exceptions.ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500)

  I got error

   byte 0xe7 in position 8: unexpected end of data
  (nova.api.openstack): TRACE: Traceback (most recent call last):
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/__init__.py", line 64, in __call__
  (nova.api.openstack): TRACE:     return req.get_response(self.application)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/request.py", line 1053, in get_response
  (nova.api.openstack): TRACE:     application, catch_exc_info=False)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/request.py", line 1022, in call_application
  (nova.api.openstack): TRACE:     app_iter = application(self.environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/python2.7/dist-packages/keystone/middleware/auth_token.py", line 212, in __call__
  (nova.api.openstack): TRACE:     return self._forward_request(env, start_response, proxy_headers)
  (nova.api.openstack): TRACE:   File "/usr/lib/python2.7/dist-packages/keystone/middleware/auth_token.py", line 344, in _forward_request
  (nova.api.openstack): TRACE:     return self.app(env, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/routes/middleware.py", line 131, in __call__
  (nova.api.openstack): TRACE:     response = self.app(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/routes/middleware.py", line 131, in __call__
  (nova.api.openstack): TRACE:     response = self.app(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 159, in __call__
  (nova.api.openstack): TRACE:     return resp(environ, start_response)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 147, in __call__
  (nova.api.openstack): TRACE:     resp = self.call_func(req, *args, **self.kwargs)
  (nova.api.openstack): TRACE:   File "/usr/lib/pymodules/python2.7/webob/dec.py", line 208, in call_func
  (nova.api.openstack): TRACE:     return self.func(req, *args, **kwargs)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 508, in __call__
  (nova.api.openstack): TRACE:     action=action)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 428, in serialize
  (nova.api.openstack): TRACE:     self.serialize_body(response, response_data, content_type, action)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 438, in serialize_body
  (nova.api.openstack): TRACE:     response.body = serializer.serialize(data, action)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 283, in serialize
  (nova.api.openstack): TRACE:     return self.dispatch(data, action=action)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 70, in dispatch
  (nova.api.openstack): TRACE:     return action_method(*args, **kwargs)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 293, in default
  (nova.api.openstack): TRACE:     return utils.dumps(data)
  (nova.api.openstack): TRACE:   File "/opt/stack/nova/nova/utils.py", line 604, in dumps
  (nova.api.openstack): TRACE:     return json.dumps(value)
  (nova.api.openstack): TRACE:   File "/usr/lib/python2.7/json/__init__.py", line 231, in dumps
  (nova.api.openstack): TRACE:     return _default_encoder.encode(obj)
  (nova.api.openstack): TRACE:   File "/usr/lib/python2.7/json/encoder.py", line 201, in encode
  (nova.api.openstack): TRACE:     chunks = self.iterencode(o, _one_shot=True)
  (nova.api.openstack): TRACE:   File "/usr/lib/python2.7/json/encoder.py", line 264, in iterencode
  (nova.api.openstack): TRACE:     return _iterencode(o, 0)
  (nova.api.openstack): TRACE: UnicodeDecodeError: 'utf8' codec can't decode byte 0xe7 in position 8: unexpected end of data
  (nova.api.openstack): TRACE:

  nova --debug image-list was OK

  I could reproduce this error with curl.
  curl -H "x-auth-token: XXXXXXXXXXXXXXXXXXXXXXX" https://nova-api.trystack.org:9774/v1.1/1/servers/detail --insecure
  {"cloudServersFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500}}

  
  Then I checked instance name,
  SELECT id,display_name FROM `instances`

  Then I found an instance use uft08 char in display name.
  I removed this instance, then nova list command back to normal.

  nova-api should check UTF8 char in parameters

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/940430/+subscriptions