← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1499397] Re: openstack Kilo Nova-Docker:Container will be hung in "powering-on" state.

 

** Project changed: neutron => nova

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1499397

Title:
  openstack Kilo  Nova-Docker:Container will be hung in "powering-on"
  state.

Status in OpenStack Compute (nova):
  New

Bug description:
  Bug description:
    [Summary]
  When nova-compute service on compute node is down, issuing "nova start xxx" to start SHUTOFF container,  container will be hung in "powering-on" state, even the nova-compute service has been started on compute node.  

  # Expected behavior:
  Cmd "Nova start xx" of start container should not be issued and prompt an error notice to inform that compute node nova-compute service is down; 
  or 
  The state of container should be changed to ACTIVE from powering-on after compute node's nova-compute service up. 

    [Topo]
    Unbuntu Kilo 14.04 OS , Kilo docker setup , 1 controller ,2 network node,6 computenode

    [Reproduceable or not]
    Can be reproduced, 
    

    [Recreate Steps]
  1, Build up a openstack & docker setup based on Ubuntu 14.04 trusty;
  2, 1 controller, 2 network node and 7 computer node ;
  3, Launch docker containers;

  root@quasarucn3:~# nova list
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | ID                                   | Name         | Status  | Task State   | Power State | Networks      |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.27 |
  | d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.28 |
  | 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.29 |
  | 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.30 |
  | 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.31 |
  | 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.32 |
  | af4ec54b-dc90-410d-87e4-170b8a643bba | d5           | SHUTOFF | -            | Shutdown    | vmn=12.1.1.14 |
  | ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7           | SHUTOFF | -            | Shutdown    | vmn=12.1.1.20 |
  | 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1      | ACTIVE  | -            | Running     | vmn=12.1.1.22 |
  | 925df284-3339-4af7-86e9-f66c41d947ce | d9_220       | ACTIVE  | -            | Running     | vmn=12.1.1.26 |
  | 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve     | ACTIVE  | -            | Running     | vmn=12.1.1.25 |
  | 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE  | -            | Running     | vmn=12.1.1.18 |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  root@quasarucn3:~# 


  
  root@quasarucn3:~# nova show d7
  +--------------------------------------+----------------------------------------------------------+
  | Property                             | Value                                                    |
  +--------------------------------------+----------------------------------------------------------+
  | OS-DCF:diskConfig                    | MANUAL                                                   |
  | OS-EXT-AZ:availability_zone          | nova                                                     |
  | OS-EXT-SRV-ATTR:host                 | quasarsdn2                                               |
  | OS-EXT-SRV-ATTR:hypervisor_hostname  | quasarsdn2                                               |
  | OS-EXT-SRV-ATTR:instance_name        | instance-00000017                                        |
  | OS-EXT-STS:power_state               | 1                                                        |
  | OS-EXT-STS:task_state                | -                                                        |
  | OS-EXT-STS:vm_state                  | active                                                   |
  | OS-SRV-USG:launched_at               | 2015-09-19T07:03:41.000000                               |
  | OS-SRV-USG:terminated_at             | -                                                        |
  | accessIPv4                           |                                                          |
  | accessIPv6                           |                                                          |
  | config_drive                         |                                                          |
  | created                              | 2015-09-19T07:03:39Z                                     |
  | flavor                               | m1.tiny (1)                                              |
  | hostId                               | 95f7fa6ddf5fcdcfc0806bb0e58ab0401a6e5c595ef42560603ebe07 |
  | id                                   | ae6d1bc5-635a-453d-8cec-143a2b8240f6                     |
  | image                                | cirros (798aa1fd-5c83-4cd9-a450-cbc307eb0e7f)            |
  | key_name                             | -                                                        |
  | metadata                             | {}                                                       |
  | name                                 | d7                                                       |
  | os-extended-volumes:volumes_attached | []                                                       |
  | progress                             | 0                                                        |
  | security_groups                      | default                                                  |
  | status                               | ACTIVE                                                   |
  | tenant_id                            | 066c321d33c24ea4acaf2e1a0451e85c                         |
  | updated                              | 2015-09-21T06:01:09Z                                     |
  | user_id                              | 7c4dd09b6fe74d10b793a6172d0cce1b                         |
  | vmn network                          | 12.1.1.20                                                |
  +--------------------------------------+----------------------------------------------------------+
  root@quasarucn3:~# 

  
  root@quasarucn3:~# nova service-list
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | Id | Binary           | Host         | Zone     | Status  | State | Updated_at                 | Disabled Reason |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | 1  | nova-cert        | quasarucn3   | internal | enabled | up    | 2015-09-21T05:56:22.000000 | -               |
  | 2  | nova-conductor   | quasarucn3   | internal | enabled | up    | 2015-09-21T05:56:23.000000 | -               |
  | 3  | nova-consoleauth | quasarucn3   | internal | enabled | up    | 2015-09-21T05:56:23.000000 | -               |
  | 4  | nova-scheduler   | quasarucn3   | internal | enabled | up    | 2015-09-21T05:56:25.000000 | -               |
  | 5  | nova-compute     | quasarucn1   | nova     | enabled | up    | 2015-09-21T05:56:24.000000 | -               |
  | 6  | nova-compute     | quasarsdn2   | nova     | enabled | down  | 2015-09-21T02:36:08.000000 | -               |
  | 7  | nova-compute     | quasarsdnve1 | nova     | enabled | up    | 2015-09-21T05:56:28.000000 | -               |
  | 8  | nova-compute     | quasarsdn1   | nova     | enabled | up    | 2015-09-21T05:56:24.000000 | -               |
  | 9  | nova-compute     | quasarsdnve  | nova     | enabled | up    | 2015-09-21T05:56:26.000000 | -               |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  root@quasarucn3:~# 


  
  root@quasarucn3:~# 
  root@quasarucn3:~# nova start d7
  Request to start server d7 has been accepted.
  root@quasarucn3:~# 
  root@quasarucn3:~#    
  root@quasarucn3:~# 
  root@quasarucn3:~# nova list    
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | ID                                   | Name         | Status  | Task State   | Power State | Networks      |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.27 |
  | d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.28 |
  | 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.29 |
  | 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.30 |
  | 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.31 |
  | 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.32 |
  | af4ec54b-dc90-410d-87e4-170b8a643bba | d5           | SHUTOFF | -            | Shutdown    | vmn=12.1.1.14 |
  | ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7           | SHUTOFF | powering-on  | Shutdown    | vmn=12.1.1.20 |
  | 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1      | ACTIVE  | -            | Running     | vmn=12.1.1.22 |
  | 925df284-3339-4af7-86e9-f66c41d947ce | d9_220       | ACTIVE  | -            | Running     | vmn=12.1.1.26 |
  | 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve     | ACTIVE  | -            | Running     | vmn=12.1.1.25 |
  | 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu   | ACTIVE  | powering-off | Running     | vmn=12.1.1.15 |
  | 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE  | -            | Running     | vmn=12.1.1.18 |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  root@quasarucn3:~# 


  
  root@quasarucn3:~# nova service-list
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | Id | Binary           | Host         | Zone     | Status  | State | Updated_at                 | Disabled Reason |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | 1  | nova-cert        | quasarucn3   | internal | enabled | up    | 2015-09-21T09:03:02.000000 | -               |
  | 2  | nova-conductor   | quasarucn3   | internal | enabled | up    | 2015-09-21T09:03:03.000000 | -               |
  | 3  | nova-consoleauth | quasarucn3   | internal | enabled | up    | 2015-09-21T09:03:03.000000 | -               |
  | 4  | nova-scheduler   | quasarucn3   | internal | enabled | up    | 2015-09-21T09:03:06.000000 | -               |
  | 5  | nova-compute     | quasarucn1   | nova     | enabled | up    | 2015-09-21T09:03:05.000000 | -               |
  | 6  | nova-compute     | quasarsdn2   | nova     | enabled | up    | 2015-09-21T09:03:03.000000 | -               |
  | 7  | nova-compute     | quasarsdnve1 | nova     | enabled | up    | 2015-09-21T09:03:09.000000 | -               |
  | 8  | nova-compute     | quasarsdn1   | nova     | enabled | up    | 2015-09-21T09:03:04.000000 | -               |
  | 9  | nova-compute     | quasarsdnve  | nova     | enabled | up    | 2015-09-21T09:03:07.000000 | -               |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  root@quasarucn3:~# 

  
  root@quasarucn3:~# nova list
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | ID                                   | Name         | Status  | Task State   | Power State | Networks      |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+
  | 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.27 |
  | d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.28 |
  | 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.29 |
  | 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.30 |
  | 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.31 |
  | 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36     | SHUTOFF | -            | Shutdown    | vmn=12.1.1.32 |
  | af4ec54b-dc90-410d-87e4-170b8a643bba | d5           | SHUTOFF | -            | Shutdown    | vmn=12.1.1.14 |
  | ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7           | SHUTOFF | powering-on  | Shutdown    | vmn=12.1.1.20 |
  | 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1      | ACTIVE  | -            | Running     | vmn=12.1.1.22 |
  | 925df284-3339-4af7-86e9-f66c41d947ce | d9_220       | ACTIVE  | -            | Running     | vmn=12.1.1.26 |
  | 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve     | ACTIVE  | -            | Running     | vmn=12.1.1.25 |
  | 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu   | ACTIVE  | powering-off | Running     | vmn=12.1.1.15 |
  | 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | SHUTOFF | -            | Shutdown    | vmn=12.1.1.18 |
  +--------------------------------------+--------------+---------+--------------+-------------+---------------+



    [Log]

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1499397/+subscriptions


References