yahoo-eng-team team mailing list archive

[Ivan-Zhu <bozhu@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

I install openstack via devstack on my ubuntu 12.04, successfully in the morning . And run some tempest tests on my laptop.
But at afternoon, the client cann't connect keystone. 
when run: nova --debug list
REQ: curl -i 'http://localhost:35357/v2.0/tokens' -X POST -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-novaclient" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "pass"}}}'

DEBUG (shell:777) HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
Traceback (most recent call last):
  File "/opt/stack/python-novaclient/novaclient/shell.py", line 774, in main
    OpenStackComputeShell().main(map(strutils.safe_decode, sys.argv[1:]))
  File "/opt/stack/python-novaclient/novaclient/shell.py", line 685, in main
    self.cs.authenticate()
  File "/opt/stack/python-novaclient/novaclient/v1_1/client.py", line 169, in authenticate
    self.client.authenticate()
  File "/opt/stack/python-novaclient/novaclient/client.py", line 353, in authenticate
    auth_url = self._v2_auth(auth_url)
  File "/opt/stack/python-novaclient/novaclient/client.py", line 440, in _v2_auth
    return self._authenticate(url, body)
  File "/opt/stack/python-novaclient/novaclient/client.py", line 453, in _authenticate
    **kwargs)
  File "/opt/stack/python-novaclient/novaclient/client.py", line 213, in _time_request
    resp, body = self.request(url, method, **kwargs)
  File "/opt/stack/python-novaclient/novaclient/client.py", line 185, in request
    **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 378, in send
    raise ConnectionError(e)
ConnectionError: HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
ERROR: HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)


when run: keystone --debug tenant-list
WARNING: Bypassing authentication using a token & endpoint (authentication credentials are being ignored).
DEBUG:keystoneclient.session:REQ: curl -i -X GET http://localhost:35357/v2.0/tenants -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: token"
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): localhost
Unable to establish connection to http://localhost:35357/v2.0/tenants


stack@stack:/opt/stack$ ps -aux | grep keystone
Warning: bad ps syntax, perhaps a bogus '-'? See http://procps.sf.net/faq.html
stack    12163  0.0  0.6 217744 51076 pts/0    S+   17:39   0:00 python /opt/stack/keystone/bin/keystone-all --config-file /etc/keystone/keystone.conf --debug


the wiresharke summary is:( catch the tcp packets via tcpdump 'tcp port 35357' -i lo)
1	0.000000	127.0.0.1	127.0.0.1	TCP	74	42820 > openstack-id [SYN] Seq=0 Win=32792 Len=0 MSS=16396 SACK_PERM=1 TSval=6371058 TSecr=0 WS=128
2	0.000021	127.0.0.1	127.0.0.1	TCP	54	openstack-id > 42820 [RST, ACK] Seq=1 Ack=1 Win=0 Len=0


kill the keystone proccess, and run it again, the issue remain.

./unstack.sh and then ./stack.sh, the issue remain.

reboot the laptop, it's ok.

** Affects: keystone
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1279722

Title:
  cann't connect the keystone after long time used

Status in OpenStack Identity (Keystone):
  New

Bug description:
  I install openstack via devstack on my ubuntu 12.04, successfully in the morning . And run some tempest tests on my laptop.
  But at afternoon, the client cann't connect keystone. 
  when run: nova --debug list
  REQ: curl -i 'http://localhost:35357/v2.0/tokens' -X POST -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-novaclient" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "pass"}}}'

  DEBUG (shell:777) HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
  Traceback (most recent call last):
    File "/opt/stack/python-novaclient/novaclient/shell.py", line 774, in main
      OpenStackComputeShell().main(map(strutils.safe_decode, sys.argv[1:]))
    File "/opt/stack/python-novaclient/novaclient/shell.py", line 685, in main
      self.cs.authenticate()
    File "/opt/stack/python-novaclient/novaclient/v1_1/client.py", line 169, in authenticate
      self.client.authenticate()
    File "/opt/stack/python-novaclient/novaclient/client.py", line 353, in authenticate
      auth_url = self._v2_auth(auth_url)
    File "/opt/stack/python-novaclient/novaclient/client.py", line 440, in _v2_auth
      return self._authenticate(url, body)
    File "/opt/stack/python-novaclient/novaclient/client.py", line 453, in _authenticate
      **kwargs)
    File "/opt/stack/python-novaclient/novaclient/client.py", line 213, in _time_request
      resp, body = self.request(url, method, **kwargs)
    File "/opt/stack/python-novaclient/novaclient/client.py", line 185, in request
      **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 383, in request
      resp = self.send(prep, **send_kwargs)
    File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 486, in send
      r = adapter.send(request, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 378, in send
      raise ConnectionError(e)
  ConnectionError: HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
  ERROR: HTTPConnectionPool(host='localhost', port=35357): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)

  
  when run: keystone --debug tenant-list
  WARNING: Bypassing authentication using a token & endpoint (authentication credentials are being ignored).
  DEBUG:keystoneclient.session:REQ: curl -i -X GET http://localhost:35357/v2.0/tenants -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: token"
  INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): localhost
  Unable to establish connection to http://localhost:35357/v2.0/tenants

  
  stack@stack:/opt/stack$ ps -aux | grep keystone
  Warning: bad ps syntax, perhaps a bogus '-'? See http://procps.sf.net/faq.html
  stack    12163  0.0  0.6 217744 51076 pts/0    S+   17:39   0:00 python /opt/stack/keystone/bin/keystone-all --config-file /etc/keystone/keystone.conf --debug


  the wiresharke summary is:( catch the tcp packets via tcpdump 'tcp port 35357' -i lo)
  1	0.000000	127.0.0.1	127.0.0.1	TCP	74	42820 > openstack-id [SYN] Seq=0 Win=32792 Len=0 MSS=16396 SACK_PERM=1 TSval=6371058 TSecr=0 WS=128
  2	0.000021	127.0.0.1	127.0.0.1	TCP	54	openstack-id > 42820 [RST, ACK] Seq=1 Ack=1 Win=0 Len=0


  kill the keystone proccess, and run it again, the issue remain.

  ./unstack.sh and then ./stack.sh, the issue remain.

  reboot the laptop, it's ok.

To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1279722/+subscriptions