yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1609279] [NEW] cloud-init doesn't support dpdkvhostuser port

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Ethan Lynn <xuanlangjian@xxxxxxxxx>
Date: Wed, 03 Aug 2016 07:34:16 -0000
Reply-to: Bug 1609279 <1609279@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Hi I met a problem when booting VM using dpdkvhostuser port, I'm using
the ubuntu 16.04 cloud image and boot from openstack.

Error messages are like following:
[    6.635759] cloud-init[1904]: Cloud-init v. 0.7.7 running 'init-local' at Tue, 02 Aug 2016 06:44:54 +0000. Up 6.55 seconds.
[    6.637238] cloud-init[1904]: 2016-08-02 06:44:54,224 - util.py[WARNING]: failed stage init-local
[    6.640376] cloud-init[1904]: failed run of stage init-local
[    6.641156] cloud-init[1904]: ------------------------------------------------------------
[    6.642089] cloud-init[1904]: Traceback (most recent call last):
[    6.642869] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 530, in status_wrapper
[    6.643959] cloud-init[1904]:     ret = functor(name, args)
[    6.644712] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 277, in main_init
[    6.645859] cloud-init[1904]:     init.apply_network_config(bring_up=bool(mode != sources.DSMODE_LOCAL))
[    6.646924] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 631, in apply_network_config
[    6.648113] cloud-init[1904]:     netcfg, src = self._find_networking_config()
[    6.649076] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 618, in _find_networking_config
[    6.650287] cloud-init[1904]:     if self.datasource and hasattr(self.datasource, 'network_config'):
[    6.651327] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceConfigDrive.py", line 159, in network_config
[    6.652618] cloud-init[1904]:     self.network_json, known_macs=self.known_macs)
[    6.653547] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/sources/helpers/openstack.py", line 599, in convert_net_json
[    6.654801] cloud-init[1904]:     'Unknown network_data link type: %s' % link['type'])
[    6.655764] cloud-init[1904]: ValueError: Unknown network_data link type: vhostuser
[    6.656732] cloud-init[1904]: ------------------------------------------------------------
[[0;1;31mFAILED[0m] Failed to start Initial cloud-init job (pre-networking).


I found that difference between normal ovs VM and dpdk ovs VM is in the network_json, the key 'type' is not the same:
normal ovs port:
{
   'services':[

   ],
   'links':[
      {
         'mtu':None,
         'id':'tap7668d181-fb',
         'vif_id':'7668d181-fbce-4e4a-a366-b3dc22dbb831',
         'type':'ovs',
         'ethernet_mac_address':'fa:16:3e:a3:27:27'
      }
   ],
   'networks':[
      {
         'id':'network0',
         'type':'ipv4_dhcp',
         'link':'tap7668d181-fb',
         'network_id':'b42e1ea8-7486-47e0-94df-006bd95edfe5'
      }
   ]
}

dpdk vhost port:
{
   'networks':[
      {
         'id':'network0',
         'network_id':'2173c81e-2799-4645-acff-623fab93e9ec',
         'type':'ipv4_dhcp',
         'link':'tap69061801-e6'
      }
   ],
   'links':[
      {
         'id':'tap69061801-e6',
         'vif_id':'69061801-e6fd-4371-bb4a-8e0b5da21eef',
         'ethernet_mac_address':'fa:16:3e:69:58:84',
         'mtu':None,
         'type':'vhostuser'
      }
   ],
   'services':[

   ]
}

** Affects: cloud-init
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to cloud-init.
https://bugs.launchpad.net/bugs/1609279

Title:
  cloud-init doesn't support dpdkvhostuser port

Status in cloud-init:
  New

Bug description:
  Hi I met a problem when booting VM using dpdkvhostuser port, I'm using
  the ubuntu 16.04 cloud image and boot from openstack.

  Error messages are like following:
  [    6.635759] cloud-init[1904]: Cloud-init v. 0.7.7 running 'init-local' at Tue, 02 Aug 2016 06:44:54 +0000. Up 6.55 seconds.
  [    6.637238] cloud-init[1904]: 2016-08-02 06:44:54,224 - util.py[WARNING]: failed stage init-local
  [    6.640376] cloud-init[1904]: failed run of stage init-local
  [    6.641156] cloud-init[1904]: ------------------------------------------------------------
  [    6.642089] cloud-init[1904]: Traceback (most recent call last):
  [    6.642869] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 530, in status_wrapper
  [    6.643959] cloud-init[1904]:     ret = functor(name, args)
  [    6.644712] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 277, in main_init
  [    6.645859] cloud-init[1904]:     init.apply_network_config(bring_up=bool(mode != sources.DSMODE_LOCAL))
  [    6.646924] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 631, in apply_network_config
  [    6.648113] cloud-init[1904]:     netcfg, src = self._find_networking_config()
  [    6.649076] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 618, in _find_networking_config
  [    6.650287] cloud-init[1904]:     if self.datasource and hasattr(self.datasource, 'network_config'):
  [    6.651327] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceConfigDrive.py", line 159, in network_config
  [    6.652618] cloud-init[1904]:     self.network_json, known_macs=self.known_macs)
  [    6.653547] cloud-init[1904]:   File "/usr/lib/python3/dist-packages/cloudinit/sources/helpers/openstack.py", line 599, in convert_net_json
  [    6.654801] cloud-init[1904]:     'Unknown network_data link type: %s' % link['type'])
  [    6.655764] cloud-init[1904]: ValueError: Unknown network_data link type: vhostuser
  [    6.656732] cloud-init[1904]: ------------------------------------------------------------
  [[0;1;31mFAILED[0m] Failed to start Initial cloud-init job (pre-networking).

  
  I found that difference between normal ovs VM and dpdk ovs VM is in the network_json, the key 'type' is not the same:
  normal ovs port:
  {
     'services':[

     ],
     'links':[
        {
           'mtu':None,
           'id':'tap7668d181-fb',
           'vif_id':'7668d181-fbce-4e4a-a366-b3dc22dbb831',
           'type':'ovs',
           'ethernet_mac_address':'fa:16:3e:a3:27:27'
        }
     ],
     'networks':[
        {
           'id':'network0',
           'type':'ipv4_dhcp',
           'link':'tap7668d181-fb',
           'network_id':'b42e1ea8-7486-47e0-94df-006bd95edfe5'
        }
     ]
  }

  dpdk vhost port:
  {
     'networks':[
        {
           'id':'network0',
           'network_id':'2173c81e-2799-4645-acff-623fab93e9ec',
           'type':'ipv4_dhcp',
           'link':'tap69061801-e6'
        }
     ],
     'links':[
        {
           'id':'tap69061801-e6',
           'vif_id':'69061801-e6fd-4371-bb4a-8e0b5da21eef',
           'ethernet_mac_address':'fa:16:3e:69:58:84',
           'mtu':None,
           'type':'vhostuser'
        }
     ],
     'services':[

     ]
  }

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1609279/+subscriptions
Follow ups

[Bug 1609279] Re: cloud-init doesn't support dpdkvhostuser port
From: ivano, 2016-10-25