yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #39107
[Bug 1499397] Re: openstack Kilo Nova-Docker:Container will be hung in "powering-on" state.
** Project changed: neutron => nova
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1499397
Title:
openstack Kilo Nova-Docker:Container will be hung in "powering-on"
state.
Status in OpenStack Compute (nova):
New
Bug description:
Bug description:
[Summary]
When nova-compute service on compute node is down, issuing "nova start xxx" to start SHUTOFF container, container will be hung in "powering-on" state, even the nova-compute service has been started on compute node.
# Expected behavior:
Cmd "Nova start xx" of start container should not be issued and prompt an error notice to inform that compute node nova-compute service is down;
or
The state of container should be changed to ACTIVE from powering-on after compute node's nova-compute service up.
[Topo]
Unbuntu Kilo 14.04 OS , Kilo docker setup , 1 controller ,2 network node,6 computenode
[Reproduceable or not]
Can be reproduced,
[Recreate Steps]
1, Build up a openstack & docker setup based on Ubuntu 14.04 trusty;
2, 1 controller, 2 network node and 7 computer node ;
3, Launch docker containers;
root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | - | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#
root@quasarucn3:~# nova show d7
+--------------------------------------+----------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | quasarsdn2 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | quasarsdn2 |
| OS-EXT-SRV-ATTR:instance_name | instance-00000017 |
| OS-EXT-STS:power_state | 1 |
| OS-EXT-STS:task_state | - |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2015-09-19T07:03:41.000000 |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| config_drive | |
| created | 2015-09-19T07:03:39Z |
| flavor | m1.tiny (1) |
| hostId | 95f7fa6ddf5fcdcfc0806bb0e58ab0401a6e5c595ef42560603ebe07 |
| id | ae6d1bc5-635a-453d-8cec-143a2b8240f6 |
| image | cirros (798aa1fd-5c83-4cd9-a450-cbc307eb0e7f) |
| key_name | - |
| metadata | {} |
| name | d7 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | ACTIVE |
| tenant_id | 066c321d33c24ea4acaf2e1a0451e85c |
| updated | 2015-09-21T06:01:09Z |
| user_id | 7c4dd09b6fe74d10b793a6172d0cce1b |
| vmn network | 12.1.1.20 |
+--------------------------------------+----------------------------------------------------------+
root@quasarucn3:~#
root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:22.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:23.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T05:56:25.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | down | 2015-09-21T02:36:08.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T05:56:28.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T05:56:24.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T05:56:26.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~# nova start d7
Request to start server d7 has been accepted.
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~#
root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | ACTIVE | - | Running | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
root@quasarucn3:~#
root@quasarucn3:~# nova service-list
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:02.000000 | - |
| 2 | nova-conductor | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 3 | nova-consoleauth | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 4 | nova-scheduler | quasarucn3 | internal | enabled | up | 2015-09-21T09:03:06.000000 | - |
| 5 | nova-compute | quasarucn1 | nova | enabled | up | 2015-09-21T09:03:05.000000 | - |
| 6 | nova-compute | quasarsdn2 | nova | enabled | up | 2015-09-21T09:03:03.000000 | - |
| 7 | nova-compute | quasarsdnve1 | nova | enabled | up | 2015-09-21T09:03:09.000000 | - |
| 8 | nova-compute | quasarsdn1 | nova | enabled | up | 2015-09-21T09:03:04.000000 | - |
| 9 | nova-compute | quasarsdnve | nova | enabled | up | 2015-09-21T09:03:07.000000 | - |
+----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
root@quasarucn3:~#
root@quasarucn3:~# nova list
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
| 3f62d6c5-a3e4-420d-b6b6-9a719f60c580 | cirros31 | SHUTOFF | - | Shutdown | vmn=12.1.1.27 |
| d65433d0-001b-4e24-9553-42ec5baeb056 | cirros32 | SHUTOFF | - | Shutdown | vmn=12.1.1.28 |
| 28914c07-a0cc-40a0-b743-48136ee997e3 | cirros33 | SHUTOFF | - | Shutdown | vmn=12.1.1.29 |
| 8c1c6f0d-c385-45b3-aef5-eead0dbbd54b | cirros34 | SHUTOFF | - | Shutdown | vmn=12.1.1.30 |
| 40d40e57-7bdb-4a97-8e49-b2b6f7fbb8b5 | cirros35 | SHUTOFF | - | Shutdown | vmn=12.1.1.31 |
| 6dc4c963-124b-4264-adbc-3a32f705318f | cirros36 | SHUTOFF | - | Shutdown | vmn=12.1.1.32 |
| af4ec54b-dc90-410d-87e4-170b8a643bba | d5 | SHUTOFF | - | Shutdown | vmn=12.1.1.14 |
| ae6d1bc5-635a-453d-8cec-143a2b8240f6 | d7 | SHUTOFF | powering-on | Shutdown | vmn=12.1.1.20 |
| 914c2f05-b56a-4689-9c1b-63f5bb36c7db | d8_sdn1 | ACTIVE | - | Running | vmn=12.1.1.22 |
| 925df284-3339-4af7-86e9-f66c41d947ce | d9_220 | ACTIVE | - | Running | vmn=12.1.1.26 |
| 518f7d49-07fb-474b-b18c-647d558562ea | d9_sdnve | ACTIVE | - | Running | vmn=12.1.1.25 |
| 59b3512a-8f6b-443d-ae1a-ca1ff615dba4 | leo_ubuntu | ACTIVE | powering-off | Running | vmn=12.1.1.15 |
| 90cc6a5e-e8ce-4a75-a9c5-f0393b68560d | spark_docker | SHUTOFF | - | Shutdown | vmn=12.1.1.18 |
+--------------------------------------+--------------+---------+--------------+-------------+---------------+
[Log]
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1499397/+subscriptions
References