← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1708127] [NEW] openstack server list command crashes

 

Public bug reported:

Description
===========
Hopefully this bug was not already raised.
I'm new to openstack so it could come from a faulty installation.
I followed the guide https://docs.openstack.org/ocata/install-guide-rdo for an installation of ocata openstack over centos 7.
During the step https://docs.openstack.org/ocata/install-guide-rdo/launch-instance-provider.html
the instance creation on the compute seems ok (I can even ping the instance from the qrouter on the controller), but then the command "openstack server list" crashes and asked to report the bug.


Steps to reproduce
==================
A chronological list of steps which will bring off the
issue you noticed:
* I installed 2 VMs Centos 7 (CentOS Linux release 7.3.1611 (Core)) over ESXI
* Then I followed the https://docs.openstack.org/ocata/install-guide-rdo guide (identity, image, compute, networking, dashboard). 
* at the first instance creation I saw one openstack command crashes and asked to report the bug
"openstack server creation" is ok
"openstack server list" crashed
"openstack server show xxx" is ok

[root@controller manuopenstack]# openstack server create --flavor m1.nano --image cirros \
>   --nic net-id=90266090-8fa8-429a-903b-1dea2eb84c60 --security-group default \
>   --key-name mykey provider-instance
+-----------------------------+-----------------------------------------------+
| Field                       | Value                                         |
+-----------------------------+-----------------------------------------------+
| OS-DCF:diskConfig           | MANUAL                                        |
| OS-EXT-AZ:availability_zone |                                               |
| OS-EXT-STS:power_state      | NOSTATE                                       |
| OS-EXT-STS:task_state       | scheduling                                    |
| OS-EXT-STS:vm_state         | building                                      |
| OS-SRV-USG:launched_at      | None                                          |
| OS-SRV-USG:terminated_at    | None                                          |
| accessIPv4                  |                                               |
| accessIPv6                  |                                               |
| addresses                   |                                               |
| adminPass                   | 87nquA2JpyH5                                  |
| config_drive                |                                               |
| created                     | 2017-08-02T08:25:15Z                          |
| flavor                      | m1.nano (0)                                   |
| hostId                      |                                               |
| id                          | 5c6b2f56-e0d3-4e22-a2ab-95b08128d921          |
| image                       | cirros (df2980b7-4d72-45c8-8023-665c2bd1c296) |
| key_name                    | mykey                                         |
| name                        | provider-instance                             |
| progress                    | 0                                             |
| project_id                  | fed6a774e6024de393e858d26e97a1fa              |
| properties                  |                                               |
| security_groups             | name='default'                                |
| status                      | BUILD                                         |
| updated                     | 2017-08-02T08:25:15Z                          |
| user_id                     | 918b69a9e68341b382b1ddf5b697add2              |
| volumes_attached            |                                               |
+-----------------------------+-----------------------------------------------+
[root@controller manuopenstack]# openstack server list
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.ProgrammingError'> (HTTP 500) (Request-ID: req-1e2840dc-84a6-4f76-94df-67fa9a684f69)
[root@controller manuopenstack]# openstack server list
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.ProgrammingError'> (HTTP 500) (Request-ID: req-b88a9d59-b7c3-4b2c-8250-12698e073c2c)
[root@controller manuopenstack]# openstack server show 5c6b2f56-e0d3-4e22-a2ab-95b08128d921
+-----------------------------+----------------------------------------------------------+
| Field                       | Value                                                    |
+-----------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig           | MANUAL                                                   |
| OS-EXT-AZ:availability_zone | nova                                                     |
| OS-EXT-STS:power_state      | Running                                                  |
| OS-EXT-STS:task_state       | None                                                     |
| OS-EXT-STS:vm_state         | active                                                   |
| OS-SRV-USG:launched_at      | 2017-08-02T08:25:26.000000                               |
| OS-SRV-USG:terminated_at    | None                                                     |
| accessIPv4                  |                                                          |
| accessIPv6                  |                                                          |
| addresses                   | provider=1.2.3.55                                        |
| config_drive                |                                                          |
| created                     | 2017-08-02T08:25:15Z                                     |
| flavor                      | m1.nano (0)                                              |
| hostId                      | 5c9b45f615a14582c799709e763d0fadc46cc26b55f38ef21874e56e |
| id                          | 5c6b2f56-e0d3-4e22-a2ab-95b08128d921                     |
| image                       | cirros (df2980b7-4d72-45c8-8023-665c2bd1c296)            |
| key_name                    | mykey                                                    |
| name                        | provider-instance                                        |
| progress                    | 0                                                        |
| project_id                  | fed6a774e6024de393e858d26e97a1fa                         |
| properties                  |                                                          |
| security_groups             | name='default'                                           |
| status                      | ACTIVE                                                   |
| updated                     | 2017-08-02T08:25:26Z                                     |
| user_id                     | 918b69a9e68341b382b1ddf5b697add2                         |
| volumes_attached            |                                                          |
+-----------------------------+----------------------------------------------------------+


Expected result
===============
the list of the instances should be seen

Actual result
=============
message that it crashed, and to report the bug

Environment
===========
1. Exact version of OpenStack you are running. See the following
  list for all releases: http://docs.openstack.org/releases/

[root@controller log]# nova-manage --version
15.0.4
You have new mail in /var/spool/mail/root
[root@controller log]# keystone-manage --version
11.0.1
[root@controller log]# glance-manage --version
Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
14.0.0
[root@controller log]# neutron-server --version
Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
neutron-server 10.0.1


[root@controller manuopenstack]# yum list installed | grep nova
openstack-nova-api.noarch              1:15.0.4-1.el7           @openstack-ocata
openstack-nova-common.noarch           1:15.0.4-1.el7           @openstack-ocata
openstack-nova-conductor.noarch        1:15.0.4-1.el7           @openstack-ocata
openstack-nova-console.noarch          1:15.0.4-1.el7           @openstack-ocata
openstack-nova-novncproxy.noarch       1:15.0.4-1.el7           @openstack-ocata
openstack-nova-placement-api.noarch    1:15.0.4-1.el7           @openstack-ocata
openstack-nova-scheduler.noarch        1:15.0.4-1.el7           @openstack-ocata
python-nova.noarch                     1:15.0.4-1.el7           @openstack-ocata
python2-novaclient.noarch              1:7.1.1-1.el7            @openstack-ocata


2. Which hypervisor did you use?
   (For example: Libvirt + KVM, Libvirt + XEN, Hyper-V, PowerKVM, ...)
   What's the version of that?
[root@controller manuopenstack]# virsh version
Compiled against library: libvirt 2.0.0
Using library: libvirt 2.0.0
Using API: QEMU 2.0.0
Running hypervisor: QEMU 2.6.0

(CentOS VMs over ESXI 5.5): this is for a training.

2. Which storage type did you use?
   (For example: Ceph, LVM, GPFS, ...)
   What's the version of that?

Just the local file system as per https://docs.openstack.org/mitaka
/install-guide-rdo/glance-install.html

3. Which networking type did you use?
   (For example: nova-network, Neutron with OpenVSwitch, ...)

Neutron with linuxbridge as per https://docs.openstack.org/mitaka
/install-guide-rdo/neutron-controller-install.html


Logs & Configs
==============
Nova API log attached

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1708127

Title:
  openstack server list command crashes

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========
  Hopefully this bug was not already raised.
  I'm new to openstack so it could come from a faulty installation.
  I followed the guide https://docs.openstack.org/ocata/install-guide-rdo for an installation of ocata openstack over centos 7.
  During the step https://docs.openstack.org/ocata/install-guide-rdo/launch-instance-provider.html
  the instance creation on the compute seems ok (I can even ping the instance from the qrouter on the controller), but then the command "openstack server list" crashes and asked to report the bug.

  
  Steps to reproduce
  ==================
  A chronological list of steps which will bring off the
  issue you noticed:
  * I installed 2 VMs Centos 7 (CentOS Linux release 7.3.1611 (Core)) over ESXI
  * Then I followed the https://docs.openstack.org/ocata/install-guide-rdo guide (identity, image, compute, networking, dashboard). 
  * at the first instance creation I saw one openstack command crashes and asked to report the bug
  "openstack server creation" is ok
  "openstack server list" crashed
  "openstack server show xxx" is ok

  [root@controller manuopenstack]# openstack server create --flavor m1.nano --image cirros \
  >   --nic net-id=90266090-8fa8-429a-903b-1dea2eb84c60 --security-group default \
  >   --key-name mykey provider-instance
  +-----------------------------+-----------------------------------------------+
  | Field                       | Value                                         |
  +-----------------------------+-----------------------------------------------+
  | OS-DCF:diskConfig           | MANUAL                                        |
  | OS-EXT-AZ:availability_zone |                                               |
  | OS-EXT-STS:power_state      | NOSTATE                                       |
  | OS-EXT-STS:task_state       | scheduling                                    |
  | OS-EXT-STS:vm_state         | building                                      |
  | OS-SRV-USG:launched_at      | None                                          |
  | OS-SRV-USG:terminated_at    | None                                          |
  | accessIPv4                  |                                               |
  | accessIPv6                  |                                               |
  | addresses                   |                                               |
  | adminPass                   | 87nquA2JpyH5                                  |
  | config_drive                |                                               |
  | created                     | 2017-08-02T08:25:15Z                          |
  | flavor                      | m1.nano (0)                                   |
  | hostId                      |                                               |
  | id                          | 5c6b2f56-e0d3-4e22-a2ab-95b08128d921          |
  | image                       | cirros (df2980b7-4d72-45c8-8023-665c2bd1c296) |
  | key_name                    | mykey                                         |
  | name                        | provider-instance                             |
  | progress                    | 0                                             |
  | project_id                  | fed6a774e6024de393e858d26e97a1fa              |
  | properties                  |                                               |
  | security_groups             | name='default'                                |
  | status                      | BUILD                                         |
  | updated                     | 2017-08-02T08:25:15Z                          |
  | user_id                     | 918b69a9e68341b382b1ddf5b697add2              |
  | volumes_attached            |                                               |
  +-----------------------------+-----------------------------------------------+
  [root@controller manuopenstack]# openstack server list
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'sqlalchemy.exc.ProgrammingError'> (HTTP 500) (Request-ID: req-1e2840dc-84a6-4f76-94df-67fa9a684f69)
  [root@controller manuopenstack]# openstack server list
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'sqlalchemy.exc.ProgrammingError'> (HTTP 500) (Request-ID: req-b88a9d59-b7c3-4b2c-8250-12698e073c2c)
  [root@controller manuopenstack]# openstack server show 5c6b2f56-e0d3-4e22-a2ab-95b08128d921
  +-----------------------------+----------------------------------------------------------+
  | Field                       | Value                                                    |
  +-----------------------------+----------------------------------------------------------+
  | OS-DCF:diskConfig           | MANUAL                                                   |
  | OS-EXT-AZ:availability_zone | nova                                                     |
  | OS-EXT-STS:power_state      | Running                                                  |
  | OS-EXT-STS:task_state       | None                                                     |
  | OS-EXT-STS:vm_state         | active                                                   |
  | OS-SRV-USG:launched_at      | 2017-08-02T08:25:26.000000                               |
  | OS-SRV-USG:terminated_at    | None                                                     |
  | accessIPv4                  |                                                          |
  | accessIPv6                  |                                                          |
  | addresses                   | provider=1.2.3.55                                        |
  | config_drive                |                                                          |
  | created                     | 2017-08-02T08:25:15Z                                     |
  | flavor                      | m1.nano (0)                                              |
  | hostId                      | 5c9b45f615a14582c799709e763d0fadc46cc26b55f38ef21874e56e |
  | id                          | 5c6b2f56-e0d3-4e22-a2ab-95b08128d921                     |
  | image                       | cirros (df2980b7-4d72-45c8-8023-665c2bd1c296)            |
  | key_name                    | mykey                                                    |
  | name                        | provider-instance                                        |
  | progress                    | 0                                                        |
  | project_id                  | fed6a774e6024de393e858d26e97a1fa                         |
  | properties                  |                                                          |
  | security_groups             | name='default'                                           |
  | status                      | ACTIVE                                                   |
  | updated                     | 2017-08-02T08:25:26Z                                     |
  | user_id                     | 918b69a9e68341b382b1ddf5b697add2                         |
  | volumes_attached            |                                                          |
  +-----------------------------+----------------------------------------------------------+

  
  Expected result
  ===============
  the list of the instances should be seen

  Actual result
  =============
  message that it crashed, and to report the bug

  Environment
  ===========
  1. Exact version of OpenStack you are running. See the following
    list for all releases: http://docs.openstack.org/releases/

  [root@controller log]# nova-manage --version
  15.0.4
  You have new mail in /var/spool/mail/root
  [root@controller log]# keystone-manage --version
  11.0.1
  [root@controller log]# glance-manage --version
  Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  14.0.0
  [root@controller log]# neutron-server --version
  Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
  Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
  neutron-server 10.0.1

  
  [root@controller manuopenstack]# yum list installed | grep nova
  openstack-nova-api.noarch              1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-common.noarch           1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-conductor.noarch        1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-console.noarch          1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-novncproxy.noarch       1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-placement-api.noarch    1:15.0.4-1.el7           @openstack-ocata
  openstack-nova-scheduler.noarch        1:15.0.4-1.el7           @openstack-ocata
  python-nova.noarch                     1:15.0.4-1.el7           @openstack-ocata
  python2-novaclient.noarch              1:7.1.1-1.el7            @openstack-ocata


  2. Which hypervisor did you use?
     (For example: Libvirt + KVM, Libvirt + XEN, Hyper-V, PowerKVM, ...)
     What's the version of that?
  [root@controller manuopenstack]# virsh version
  Compiled against library: libvirt 2.0.0
  Using library: libvirt 2.0.0
  Using API: QEMU 2.0.0
  Running hypervisor: QEMU 2.6.0

  (CentOS VMs over ESXI 5.5): this is for a training.

  2. Which storage type did you use?
     (For example: Ceph, LVM, GPFS, ...)
     What's the version of that?

  Just the local file system as per https://docs.openstack.org/mitaka
  /install-guide-rdo/glance-install.html

  3. Which networking type did you use?
     (For example: nova-network, Neutron with OpenVSwitch, ...)

  Neutron with linuxbridge as per https://docs.openstack.org/mitaka
  /install-guide-rdo/neutron-controller-install.html

  
  Logs & Configs
  ==============
  Nova API log attached

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1708127/+subscriptions


Follow ups