yahoo-eng-team team mailing list archive

["Davanum Srinivas \(DIMS\)" <davanum@xxxxxxxxx>]

** Also affects: keystone
   Importance: Undecided
       Status: New

** Changed in: keystone
     Assignee: (unassigned) => Davanum Srinivas (DIMS) (dims-v)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1413341

Title:
  keystone doesn't respond if cluster is actively used

Status in OpenStack Identity (Keystone):
  New
Status in Mirantis OpenStack:
  Confirmed
Status in Logging configuration library for OpenStack:
  Confirmed

Bug description:
  [root@fuel ~]# fuel --fuel-version
  api: '1.0'
  astute_sha: f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0
  auth_required: true
  build_id: 2015-01-20_08-49-23
  build_number: '38'
  feature_groups:
  - mirantis
  fuellib_sha: 9aa913096fb93ea4847ee14bfaf33597326886f3
  fuelmain_sha: 1ee1766a51bdb5bed75d5c2efdcaaa318118e439
  nailgun_sha: 5f91157daa6798ff522ca9f6d34e7e135f150a90
  ostf_sha: 3d2f44dcfa32d6ce0372cc64695e9edcc1913ea7
  production: docker
  release: 6.0.1
  release_versions:
    2014.2-6.0:
      VERSION:
        api: '1.0'
        astute_sha: f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0
        build_id: 2015-01-20_08-49-23
        build_number: '38'
        feature_groups:
        - mirantis
        fuellib_sha: 9aa913096fb93ea4847ee14bfaf33597326886f3
        fuelmain_sha: 1ee1766a51bdb5bed75d5c2efdcaaa318118e439
        nailgun_sha: 5f91157daa6798ff522ca9f6d34e7e135f150a90
        ostf_sha: 3d2f44dcfa32d6ce0372cc64695e9edcc1913ea7
        production: docker
        release: 6.0.1

  Ubuntu, HA, neutron-gre, Ceilometer, debug, Ceph for volumes,images,ephemerals,objects
  controllers: 3
  computes: 97

  root@node-47:~# keystone --debug user-list
  DEBUG:keystoneclient.auth.identity.v2:Making authentication request to http://192.168.0.2:5000/v2.0/tokens
  INFO:urllib3.connectionpool:Starting new HTTP connection (1): 192.168.0.2
  DEBUG:urllib3.connectionpool:Setting read timeout to 600.0
  DEBUG:urllib3.connectionpool:"POST /v2.0/tokens HTTP/1.1" 200 4102
  DEBUG:keystoneclient.session:REQ: curl -i -X GET http://172.16.45.101:35357/v2.0/users -H "User-Agent: python-keystoneclient" -H "X-Auth-Token: TOKEN_REDACTED"
  INFO:urllib3.connectionpool:Starting new HTTP connection (1): 172.16.45.101
  DEBUG:urllib3.connectionpool:Setting read timeout to 600.0
  DEBUG:urllib3.connectionpool:"GET /v2.0/users HTTP/1.1" 503 None
  DEBUG:keystoneclient.session:RESP:
  DEBUG:keystoneclient.session:Request returned failure status: 503
  Service Unavailable (HTTP 503)

  root@node-47:~# crm status
  Last updated: Wed Jan 21 15:30:14 2015
  Last change: Tue Jan 20 20:09:03 2015 via cibadmin on node-47
  Stack: classic openais (with plugin)
  Current DC: node-72 - partition with quorum
  Version: 1.1.10-42f2063
  3 Nodes configured, 3 expected votes
  29 Resources configured

  
  Online: [ node-47 node-71 node-72 ]

   vip__public    (ocf::mirantis:ns_IPaddr2):     Started node-71
   Clone Set: clone_ping_vip__public [ping_vip__public]
       Started: [ node-47 node-71 node-72 ]
   vip__management        (ocf::mirantis:ns_IPaddr2):     Started node-72
   Clone Set: clone_p_heat-engine [p_heat-engine]
       Started: [ node-47 node-71 node-72 ]
   Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server]
       Masters: [ node-71 ]
       Slaves: [ node-47 node-72 ]
   Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent]
       Started: [ node-47 node-71 node-72 ]
   p_neutron-dhcp-agent   (ocf::mirantis:neutron-agent-dhcp):     Started node-47
   Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent]
       Started: [ node-47 node-71 node-72 ]
   Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent]
       Started: [ node-47 node-71 node-72 ]
   Clone Set: clone_p_mysql [p_mysql]
       Started: [ node-47 node-71 node-72 ]
   Clone Set: clone_p_haproxy [p_haproxy]
       Started: [ node-47 node-71 node-72 ]

  diagnostic snapshot is here
  https://drive.google.com/a/mirantis.com/file/d/0Bx4ptZV1Jt7hRTZlUWIzUk5PYmM/view?usp=sharing

To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1413341/+subscriptions