← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1469661] [NEW] 'volumes_attached' included the volume_id which is actually available

 

Public bug reported:

[Env]
Ubuntu 14.04
OpenStack Icehouse


[Descrition]
I am usting pdb to debug nova attach_volume operation, due to the reason that the command is timeout, the volume failed to be attached to the instance, however, in the nova db, the attachment device is already recorded other than fallback, which is completely not right from user's perspective.

For example, nova instance '1' shows "os-extended-
volumes:volumes_attached | [{"id":
"3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
"3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
"3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
"3c8205b9-5066-42ea-9180-601fac50a08e"}] |"  even if the volume
3c8205b9-5066-42ea-9180-601fac50a08e is actually available.

I am concerning there are some situations nova attach_volume would fail
in the middle procedure which would have this issue as well, is it
better to delay the db persistent step after the device is really being
attached?

ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova list
+--------------------------------------+------+--------+------------+-------------+----------------------+
| ID                                   | Name | Status | Task State | Power State | Networks             |
+--------------------------------------+------+--------+------------+-------------+----------------------+
| d58a3b25-0434-4b92-a3a8-8b4188c611c3 | 1    | ACTIVE | -          | Running     | private=192.168.21.4 |
+--------------------------------------+------+--------+------------+-------------+----------------------+
ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova volume-list
+--------------------------------------+-----------+--------------+------+-------------+-------------+
| ID                                   | Status    | Display Name | Size | Volume Type | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+-------------+
| 3c8205b9-5066-42ea-9180-601fac50a08e | available | test         | 2    | None        |             |
+--------------------------------------+-----------+--------------+------+-------------+-------------+
ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova show 1
+--------------------------------------+-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------+
| Property                             | Value                                                                                                 
                                                                                           |
+--------------------------------------+-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                                                                
                                                                                           |
| OS-EXT-AZ:availability_zone          | nova                                                                                                  
                                                                                           |
| OS-EXT-SRV-ATTR:host                 | juju-xianghui-machine-12                                                                              
                                                                                           |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | juju-xianghui-machine-12.openstacklocal                                                               
                                                                                           |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000002                                                                                     
                                                                                           |
| OS-EXT-STS:power_state               | 1                                                                                                     
                                                                                           |
| OS-EXT-STS:task_state                | -                                                                                                     
                                                                                           |
| OS-EXT-STS:vm_state                  | active                                                                                                
                                                                                           |
| OS-SRV-USG:launched_at               | 2015-06-29T05:22:09.000000                                                                            
                                                                                           |
| OS-SRV-USG:terminated_at             | -                                                                                                                                                                                                |
| accessIPv4                           |                                                                                                                                                                                                  |
| accessIPv6                           |                                                                                                                                                                                                  |
| config_drive                         |                                                                                                                                                                                                  |
| created                              | 2015-06-29T05:22:03Z                                                                                                                                                                             |
| flavor                               | m1.small (2)                                                                                                                                                                                     |
| hostId                               | 101a1d8f15e8d05cd9435d49e42c2c95b3c9f3d6665663bfa3ad23a0                                                                                                                                         |
| id                                   | d58a3b25-0434-4b92-a3a8-8b4188c611c3                                                                                                                                                             |
| image                                | trusty (1d009366-0c2a-4495-8245-a00b5f8ade1d)                                                                                                                                                    |
| key_name                             | -                                                                                                                                                                                                |
| metadata                             | {}                                                                                                                                                                                               |
| name                                 | 1                                                                                                                                                                                                |
| os-extended-volumes:volumes_attached | [{"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}] |
| private network                      | 192.168.21.4                                                                                                                                                                                     |
| progress                             | 0                                                                                                                                                                                                |
| security_groups                      | default                                                                                                                                                                                          |
| status                               | ACTIVE                                                                                                                                                                                           |
| tenant_id                            | 678f85bad9bd43b5a3ef50b1ff84eb17                                                                                                                                                                 |
| updated                              | 2015-06-29T05:22:10Z                                                                                                                                                                             |
| user_id                              | 42eb684528754ba2b78ecca15ff01c4d                                                                                                                                                                 |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| 3c8205b9-5066-42ea-9180-601fac50a08e | available |     test     |  2   |     None    |  false   |             |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1469661

Title:
   'volumes_attached' included the volume_id which is actually available

Status in OpenStack Compute (Nova):
  New

Bug description:
  [Env]
  Ubuntu 14.04
  OpenStack Icehouse

  
  [Descrition]
  I am usting pdb to debug nova attach_volume operation, due to the reason that the command is timeout, the volume failed to be attached to the instance, however, in the nova db, the attachment device is already recorded other than fallback, which is completely not right from user's perspective.

  For example, nova instance '1' shows "os-extended-
  volumes:volumes_attached | [{"id":
  "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
  "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
  "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id":
  "3c8205b9-5066-42ea-9180-601fac50a08e"}] |"  even if the volume
  3c8205b9-5066-42ea-9180-601fac50a08e is actually available.

  I am concerning there are some situations nova attach_volume would
  fail in the middle procedure which would have this issue as well, is
  it better to delay the db persistent step after the device is really
  being attached?

  ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova list
  +--------------------------------------+------+--------+------------+-------------+----------------------+
  | ID                                   | Name | Status | Task State | Power State | Networks             |
  +--------------------------------------+------+--------+------------+-------------+----------------------+
  | d58a3b25-0434-4b92-a3a8-8b4188c611c3 | 1    | ACTIVE | -          | Running     | private=192.168.21.4 |
  +--------------------------------------+------+--------+------------+-------------+----------------------+
  ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova volume-list
  +--------------------------------------+-----------+--------------+------+-------------+-------------+
  | ID                                   | Status    | Display Name | Size | Volume Type | Attached to |
  +--------------------------------------+-----------+--------------+------+-------------+-------------+
  | 3c8205b9-5066-42ea-9180-601fac50a08e | available | test         | 2    | None        |             |
  +--------------------------------------+-----------+--------------+------+-------------+-------------+
  ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ nova show 1
  +--------------------------------------+-------------------------------------------------------------------------------------------------------
  -------------------------------------------------------------------------------------------+
  | Property                             | Value                                                                                                 
                                                                                             |
  +--------------------------------------+-------------------------------------------------------------------------------------------------------
  -------------------------------------------------------------------------------------------+
  | OS-DCF:diskConfig                    | MANUAL                                                                                                
                                                                                             |
  | OS-EXT-AZ:availability_zone          | nova                                                                                                  
                                                                                             |
  | OS-EXT-SRV-ATTR:host                 | juju-xianghui-machine-12                                                                              
                                                                                             |
  | OS-EXT-SRV-ATTR:hypervisor_hostname  | juju-xianghui-machine-12.openstacklocal                                                               
                                                                                             |
  | OS-EXT-SRV-ATTR:instance_name        | instance-00000002                                                                                     
                                                                                             |
  | OS-EXT-STS:power_state               | 1                                                                                                     
                                                                                             |
  | OS-EXT-STS:task_state                | -                                                                                                     
                                                                                             |
  | OS-EXT-STS:vm_state                  | active                                                                                                
                                                                                             |
  | OS-SRV-USG:launched_at               | 2015-06-29T05:22:09.000000                                                                            
                                                                                             |
  | OS-SRV-USG:terminated_at             | -                                                                                                                                                                                                |
  | accessIPv4                           |                                                                                                                                                                                                  |
  | accessIPv6                           |                                                                                                                                                                                                  |
  | config_drive                         |                                                                                                                                                                                                  |
  | created                              | 2015-06-29T05:22:03Z                                                                                                                                                                             |
  | flavor                               | m1.small (2)                                                                                                                                                                                     |
  | hostId                               | 101a1d8f15e8d05cd9435d49e42c2c95b3c9f3d6665663bfa3ad23a0                                                                                                                                         |
  | id                                   | d58a3b25-0434-4b92-a3a8-8b4188c611c3                                                                                                                                                             |
  | image                                | trusty (1d009366-0c2a-4495-8245-a00b5f8ade1d)                                                                                                                                                    |
  | key_name                             | -                                                                                                                                                                                                |
  | metadata                             | {}                                                                                                                                                                                               |
  | name                                 | 1                                                                                                                                                                                                |
  | os-extended-volumes:volumes_attached | [{"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}, {"id": "3c8205b9-5066-42ea-9180-601fac50a08e"}] |
  | private network                      | 192.168.21.4                                                                                                                                                                                     |
  | progress                             | 0                                                                                                                                                                                                |
  | security_groups                      | default                                                                                                                                                                                          |
  | status                               | ACTIVE                                                                                                                                                                                           |
  | tenant_id                            | 678f85bad9bd43b5a3ef50b1ff84eb17                                                                                                                                                                 |
  | updated                              | 2015-06-29T05:22:10Z                                                                                                                                                                             |
  | user_id                              | 42eb684528754ba2b78ecca15ff01c4d                                                                                                                                                                 |
  +--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
  ubuntu@xianghui-bastion:~/openstack-charm-testing/test$ cinder list
  +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
  |                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
  +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
  | 3c8205b9-5066-42ea-9180-601fac50a08e | available |     test     |  2   |     None    |  false   |             |
  +--------------------------------------+-----------+--------------+------+-------------+----------+-------------+

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1469661/+subscriptions


Follow ups

References