yahoo-eng-team team mailing list archive

[Walt Boring <waboring@xxxxxxxxx>]

Public bug reported:

rbdimages information isn't updated during a live migration.

I have a customer that has updated their ceph cluster and added a new monitor IP.
He adds a new monitor to his ceph cluster and updates ceph.conf on all of the openstack nodes to reflect the new monitor IP.  

They have running VMs that are boot from ceph volume and also has attached ceph volumes.
He does a live migration to try and get nova to update the libvirt.xml and it seems that only the volumes section is updated, not the vms section.

This is a copy of xml after the live migrate.

    <disk type='network' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <auth username='nova'>
        <secret type='ceph' uuid='820ccd0b-b180-4528-93ed-76ae82edf832'/>
      </auth>
      <source protocol='rbd' name='vms/3b97914e-3f9b-410a-b3d9-6c1a83244136_disk'> <-- this one is NOT changed, old ips
        <host name='192.168.200.12' port='6789'/>
        <host name='192.168.200.14' port='6789'/>
        <host name='192.168.200.24' port='6789'/>
        <host name='192.168.240.17' port='6789'/>
        <host name='192.168.240.23' port='6789'/>
      </source>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='network' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <auth username='nova'>
        <secret type='ceph' uuid='820ccd0b-b180-4528-93ed-76ae82edf832'/>
      </auth>
      <source protocol='rbd' name='volumes/volume-6d04520d-0029-499c-af81-516a7ba37a54'> <-- this one is changed, new ips
        <host name='192.168.200.12' port='6789'/>
        <host name='192.168.200.14' port='6789'/>
        <host name='192.168.200.24' port='6789'/>
        <host name='192.168.210.15' port='6789'/>
        <host name='192.168.240.17' port='6789'/>
        <host name='192.168.240.23' port='6789'/>
      </source>
      <backingStore/>
      <target dev='vdb' bus='virtio'/>
      <serial>6d04520d-0029-499c-af81-516a7ba37a54</serial>
      <alias name='virtio-disk1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </disk>

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: ceph

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1741364

Title:
  ceph ephemeral info not updated during live migrate

Status in OpenStack Compute (nova):
  New

Bug description:
  rbdimages information isn't updated during a live migration.

  I have a customer that has updated their ceph cluster and added a new monitor IP.
  He adds a new monitor to his ceph cluster and updates ceph.conf on all of the openstack nodes to reflect the new monitor IP.  

  They have running VMs that are boot from ceph volume and also has attached ceph volumes.
  He does a live migration to try and get nova to update the libvirt.xml and it seems that only the volumes section is updated, not the vms section.

  This is a copy of xml after the live migrate.

      <disk type='network' device='disk'>
        <driver name='qemu' type='raw' cache='none'/>
        <auth username='nova'>
          <secret type='ceph' uuid='820ccd0b-b180-4528-93ed-76ae82edf832'/>
        </auth>
        <source protocol='rbd' name='vms/3b97914e-3f9b-410a-b3d9-6c1a83244136_disk'> <-- this one is NOT changed, old ips
          <host name='192.168.200.12' port='6789'/>
          <host name='192.168.200.14' port='6789'/>
          <host name='192.168.200.24' port='6789'/>
          <host name='192.168.240.17' port='6789'/>
          <host name='192.168.240.23' port='6789'/>
        </source>
        <backingStore/>
        <target dev='vda' bus='virtio'/>
        <alias name='virtio-disk0'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
      </disk>
      <disk type='network' device='disk'>
        <driver name='qemu' type='raw' cache='none'/>
        <auth username='nova'>
          <secret type='ceph' uuid='820ccd0b-b180-4528-93ed-76ae82edf832'/>
        </auth>
        <source protocol='rbd' name='volumes/volume-6d04520d-0029-499c-af81-516a7ba37a54'> <-- this one is changed, new ips
          <host name='192.168.200.12' port='6789'/>
          <host name='192.168.200.14' port='6789'/>
          <host name='192.168.200.24' port='6789'/>
          <host name='192.168.210.15' port='6789'/>
          <host name='192.168.240.17' port='6789'/>
          <host name='192.168.240.23' port='6789'/>
        </source>
        <backingStore/>
        <target dev='vdb' bus='virtio'/>
        <serial>6d04520d-0029-499c-af81-516a7ba37a54</serial>
        <alias name='virtio-disk1'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
      </disk>

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1741364/+subscriptions