cloud-init-dev team mailing list archive

[Vaidas Jablonskis <jablonskis@xxxxxxxxx>]

Vaidas Jablonskis has proposed merging lp:~jablonskis/cloud-init/add-gce-datasource into lp:cloud-init.

Requested reviews:
  cloud init development team (cloud-init-dev)

For more details, see:
https://code.launchpad.net/~jablonskis/cloud-init/add-gce-datasource/+merge/204464

This adds GCE support for cloud-init. I have tested it in GCE and it works pretty well. The only thing it does not do yet is read user-data from GCE metadata API, because GCE does not distinguish between key:value attributes, they are all the same from their point of view which is not the case from cloud-init point of view.

Should I assume that people will create a GCE metadata attribute called 'user-data' if they want to get cloud-init to setup their instance initially?

Let me know if any issues.

Thanks,
Vaidas
-- 
https://code.launchpad.net/~jablonskis/cloud-init/add-gce-datasource/+merge/204464
Your team cloud init development team is requested to review the proposed merge of lp:~jablonskis/cloud-init/add-gce-datasource into lp:cloud-init.

=== modified file 'cloudinit/settings.py'
--- cloudinit/settings.py	2014-01-16 21:53:21 +0000
+++ cloudinit/settings.py	2014-02-03 11:44:31 +0000
@@ -36,6 +36,7 @@
         'AltCloud',
         'OVF',
         'MAAS',
+        'GCE',
         'Ec2',
         'CloudStack',
         'SmartOS',

=== added file 'cloudinit/sources/DataSourceGCE.py'
--- cloudinit/sources/DataSourceGCE.py	1970-01-01 00:00:00 +0000
+++ cloudinit/sources/DataSourceGCE.py	2014-02-03 11:44:31 +0000
@@ -0,0 +1,100 @@
+# vi: ts=4 expandtab
+#
+#    Author: Vaidas Jablonskis <jablonskis@xxxxxxxxx>
+#
+#    This program is free software: you can redistribute it and/or modify
+#    it under the terms of the GNU General Public License version 3, as
+#    published by the Free Software Foundation.
+#
+#    This program is distributed in the hope that it will be useful,
+#    but WITHOUT ANY WARRANTY; without even the implied warranty of
+#    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#    GNU General Public License for more details.
+#
+#    You should have received a copy of the GNU General Public License
+#    along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+import requests
+
+from cloudinit import log as logging
+from cloudinit import sources
+
+LOG = logging.getLogger(__name__)
+
+MD_URL = 'http://metadata/computeMetadata/v1/'
+
+
+class DataSourceGCE(sources.DataSource):
+    def __init__(self, sys_cfg, distro, paths):
+        sources.DataSource.__init__(self, sys_cfg, distro, paths)
+        self.metadata_address = MD_URL
+        self.metadata = {}
+
+    # GCE takes sshKeys attribute in the format of '<user>:<public_key>'
+    # so we have to trim each key to remove the username part
+    def _trim_key(self, public_key):
+        try:
+            index = public_key.index(':')
+            if index > 0:
+                return public_key[(index + 1):]
+        except:
+            return public_key
+
+    def get_data(self):
+        # GCE metadata server requires a custom header since v1
+        headers = {'X-Google-Metadata-Request': True}
+
+        url_map = {
+            'instance-id': self.metadata_address + 'instance/id',
+            'availability-zone': self.metadata_address + 'instance/zone',
+            'public-keys': self.metadata_address + 'project/attributes/sshKeys',
+            'local-hostname': self.metadata_address + 'instance/hostname',
+        }
+
+        with requests.Session() as s:
+            for mkey in url_map.iterkeys():
+                try:
+                    r = s.get(url_map[mkey], headers=headers)
+                except requests.exceptions.ConnectionError:
+                    return False
+                if r.ok:
+                    if mkey == 'public-keys':
+                        pub_keys = [self._trim_key(k) for k in r.text.splitlines()]
+                        self.metadata[mkey] = pub_keys
+                    else:
+                        self.metadata[mkey] = r.text
+                else:
+                    self.metadata[mkey] = None
+                    return False
+            return True
+
+    @property
+    def launch_index(self):
+        # GCE does not provide lauch_index property
+        return None
+
+    def get_instance_id(self):
+        return self.metadata['instance-id']
+
+    def get_public_ssh_keys(self):
+        return self.metadata['public-keys']
+
+    def get_hostname(self, fqdn=False):
+        return self.metadata['local-hostname']
+
+    def get_userdata_raw(self):
+        return None
+
+    @property
+    def availability_zone(self):
+        return self.metadata['instance-zone']
+
+# Used to match classes to dependencies
+datasources = [
+    (DataSourceGCE, (sources.DEP_FILESYSTEM, sources.DEP_NETWORK)),
+]
+
+
+# Return a list of data sources that match this set of dependencies
+def get_datasource_list(depends):
+    return sources.list_from_depends(depends, datasources)