cloud-init-dev team mailing list archive

[Robert Schweikert <rjschwei@xxxxxxxx>]

The traceback I get with the unmodified code is as follows:

# /usr/bin/cloud-init init --local
failed run of stage init-local
------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cloudinit/cmd/main.py", line 521, in status_wrapper
    ret = functor(name, args)
  File "/usr/lib/python2.7/site-packages/cloudinit/cmd/main.py", line 180, in main_init
    init.read_cfg(extract_fns(args))
  File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 187, in read_cfg
    self._cfg = self._read_cfg(extra_fns)
  File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 195, in _read_cfg
    base_cfg=fetch_base_config())
  File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 849, in fetch_base_config
    kern_contents = util.read_cc_from_cmdline()
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 989, in read_cc_from_cmdline
    cmdline = get_cmdline()
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 1291, in get_cmdline
    if is_container():
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 1907, in is_container
    pid1env = get_proc_env(1)
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 1941, in get_proc_env
    contents = load_file(fn)
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 1278, in load_file
    return decode_binary(contents)
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 160, in decode_binary
    return blob.decode(encoding)
  File "/usr/lib64/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 3339: invalid start byte
------------------------------------------------------------


# python --version
Python 2.7.9

the blob that is being attempted to be decoded is plain ASCII text:

NON_PERSISTENT_DEVICE_NAMES=1UDEVD_PID=207kiwi_iversion=0.1.6TEXT_CANCEL=CancelTERM=linuxROOTFS_FSCK=0kiwi_startsector=2048kiwi_cmdline=console=ttyS0,115200n8 multipath=off net.ifnames=0 NON_PERSISTENT_DEVICE_NAMES=1kiwi_BootPart=1imageBootDevice=/dev/hda1TEXT_INSTALLTITLE=Installation...HAVE_MODULES_ORDER=1SYSALIAS=undefinedKERNEL_PAIR=vmlinuz-3.12.49-1-default:initrd-3.12.49-1-defaultkiwi_strip_tools=arch ata_id atftp atftpd awk basename bash bc blkid blockdev blogd btrfs btrfsck btrfsctl btrfstune busybox bzip2 cat checkmedia checkproc chroot clear clicfs cmp column cp cryptsetup curl cut dasd_configure dasdinfo date dbus-uuidgen dcounter dd debugreiserfs depmod df dhcpcd dialog diff dirname dmesg dmevent_tool dmraid dmsetup driveready dropbear dropbearkey du dumpe2fs e2fsck echo edd_id egrep eject env expr false fbiterm fbmngplay fdasd fdisk file find free fsck.btrfs fsck.ext2 fsck.ext3 fsck.ext4 fuser gawk gdisk gettext grep grub gzip halt haveged hdparm head hexdump host hostname hwinfo hwup id ifup init insmod ip isoinfo kexec kill killall killall5 killproc klogconsole kmod kpartx kpartx_id ldconfig ldd ln loadkeys losetup ls lsdasd lsmod lvchange lvcreate lvextend lvm lvmetad lvresize md5sum mdadm mdmon mkdir mkdosfs mke2fs mkfifo mkfs.btrfs mkfs.cramfs mkfs.ext2 mkfs.ext3 mkfs.ext4 mkfs.fat mkfs.ntfs mkfs.xfs mkinitrd mknod mkreiserfs mkswap modinfo modprobe mount mount.nfs mount.nfs4 mount.zfs mountpoint mpath_id mpath_wait mpathpersist multipath multipathd mv nbd-client nvram ofpathname pam_console_apply parted path_id pidof ping pivot_root plymouth plymouth-set-default-theme plymouthd portmap posbios printf ps pseries_platform pvchange pvcreate pvresize pvscan pwd qemu-img qeth_configure readlink reboot reiserfsck reset resize2fs resize_reiserfs rev rm rmdir rmmod route rpc.idmapd rpc.statd rpcbind rsync scsi_id scsi_tur sed seq setctsid setfont setterm sfdisk sg_inq sgdisk sh showconsole shutdown sleep sm-notify sort splash start-statd startproc stat sulogin swapoff swapon switch_root systemctl tac tail tar test touch tr true tset tty tune2fs udevadm udevcontrol udevd udevsettle udevtrigger umount uname unionfs uniq usb_id usleep utimer vgcfgbackup vgcfgrestore vgchange vgcreate vgdisplay vgextend vgremove vgrename vgs vgscan vol_id wc which wicked wpa_supplicant xargs xfs_admin xfs_db xfs_growfs xfs_repair xz yes zfcp_disk_configure zfcp_host_configure zfs zpoolkiwi_keytable=us.map.gzkiwi_cpio_name=initrd-vmxboot-suse-SLES12kiwi_bootkernel=stdHYBRID_PERSISTENT_FS=btrfsOLDPWD=/TEXT_NO=NoELOG_BOOTSHELL=/dev/tty2TEXT_SELECT=Select disk for installation:TEXT_CDPULL=Please remove the CD/DVD before rebootPART_IDS=/config.partidsTEXT_YES=Yeskiwi_iname=SLES12-SP1-EC2-HVMCONSOLE_FONT=/usr/share/kbd/consolefonts/default8x16.gzNAME=0DOMURD_MODULES=xennet xenblkimageDiskDevice=/dev/hdaUFONT=/usr/share/fbiterm/fonts/b16.pcf.gzbootPartitionFSType=ext4kiwi_strip_delete=/lib/i686/nosegneg /usr/lib*/gconv /usr/lib/rpm /usr/share/X11/locale /usr/share/backgrounds /usr/share/grub2/backgrounds /usr/share/info /usr/share/splashy /usr/src/packages /var/log/* usr/share/bash-completion usr/share/bash/helpfiles usr/share/emacs usr/share/sgml usr/share/zoneinfo usr/share/zshELOG_STOPPED=0kiwi_revision=3a6c252fe1d3a2b0001214e19e3d31bc60b32be2BOOTABLE_FLAG=�init=/bin/systemdTRANSFER_ERRORS_FILE=/tmp/transfer.errorsbootid=1TEXT_EXIT=Exithave_devtmpfs=truekiwi_drivers=crypto/*,drivers/acpi/dock.ko,drivers/ata/*,drivers/block/loop.ko,drivers/block/virtio_blk.ko,drivers/char/hw_random/virtio-rng.ko,drivers/gpu/drm/*,drivers/hid/*,drivers/hv/*,drivers/ide/*,drivers/md/*,drivers/message/fusion/*,drivers/net/hyperv/hv_netvsc.ko,drivers/net/virtio_net.ko,drivers/scsi/*,drivers/staging/hv/*,drivers/virtio/*,fs/binfmt_aout.ko,fs/binfmt_misc.ko,fs/btrfs/*,fs/exportfs/*,fs/ext2/*,fs/ext3/*,fs/ext4/*,fs/fat/*,fs/fuse/*,fs/hfs/*,fs/isofs/*,fs/jbd/*,fs/jbd2/*,fs/mbcache.ko,fs/nls/nls_cp437.ko,fs/nls/nls_iso8859-1.ko,fs/nls/nls_utf8.ko,fs/overlayfs/*,fs/quota_v1.ko,fs/quota_v2.ko,fs/squashfs/*,fs/vfat/*,fs/xfs/*,lib/crc-t10dif.ko,lib/crc16.ko,lib/libcrc32c.ko,lib/zlib_deflate/zlib_deflate.kosystemIntegrity=cleanimageRootDevice=/dev/hda1kiwi_bootloader=grub2TEXT_USBPULL=Please unplug the USB stick before rebootkiwi_type=vmxELOG_EXCEPTION=/dev/consoleenablePlymouth=1kiwi_loader_theme=openSUSETEXT_BOOT_SETUP_FAILED_INFO=The system will not be able to reboot. Please make sure to fixup and install the bootloader before next reboot. Check /var/log/boot.kiwi for detailsTEXT_USBPULL_SDOWN=System will be shutdown. Remove USB stick before power onPATH=/sbin:/bin:/usr/sbin:/usr/binTEXT_RESTORE=Do you want to start the System-Restore ?TEXT_OK=OKkiwi_sectorsize=512partitionerWriteStatus=0PART_NEED_EXTENDED=0KERNEL_LIST=vmlinuz-3.12.49-1-default:initrd-3.12.49-1-defaultkiwi_boot_timeout=1MEDIACHECK_OK_TIMER=5kiwi_firmware=ec2hvmPWD=/mntELOG_FILE=/var/log/boot.kiwimultipath=offbiosBootDevice=/dev/hdaconsole=ttyS0,115200n8UTIMER_INFO=/dev/utimerLANG=en_US.utf8LOCAL_BOOT=nokiwi_language=en_USkiwi_bootprofile=defaultNO_FILE_SYSTEM=0PART_NEED_FILL=0build_day=20151214root=/dev/hda1PART_FILE=/etc/partition.tableFSTYPE=ext4TEXT_TIMEOUT=Boot continues in 10 sec...kiwi_profiles=loader=grub2PART_NUMBER=0TEXT_BOOT_SETUP_FAILED=Bootloader installation has failedPARTITIONER=partedUTIMER=165IFS_ORIG= 	
TEXT_RECOVERYTITLE=Restoring base operating system...SHLVL=0HOME=/kiwi_hwclock=utckiwi_strip_libs=libaio libdevmapper libdmraid-events-isw libdrm libfontenc libfreetype libgcc_s libjpeg libkmod libkms libnsl libnss_compat libnss_dns libnss_files libply-boot-client libply-splash-graphics libpng libresolv librt libselinux libsepol libsplashy libsplashycnf libsysfs libutempter libutilBOOT_IMAGE=/boot/linux.vmxTEXT_REPAIR=Do you want to start the System-Recovery ?PARTED_HAVE_ALIGN=1haveZFCP=0RECOVERY_THEME=openSUSEPART_COUNT=0INITRD_MODULES= ehci-hcd ohci-hcd uhci-hcd xhci-hcd usbcore usb-storage sdTEXT_LUKS=Enter LUKS passphraseDEFAULT_VGA=0x314splitroot_size=512TEXT_CDPULL_SDOWN=Please remove the CD/DVD before shutdownkiwi_align=1048576haveDASD=0HYBRID_PERSISTENT_DIR=/read-writePARTED_HAVE_MACHINE=1kiwi_RootPart=1kiwi_splash_theme=openSUSEarch=x86_64ARCH=x86_64TEXT_LICENSE=Do you accept the license agreement ?kiwi_delete=Mesa cracklib-dict-full cyrus-sasl fillup gdbm info insserv iproute2 make mingetty pam pam-modules perl perl-Bootloader permissions python python-base sles-releaseHYBRID_PERSISTENT_ID=83DHCPCD_HAVE_PERSIST=1DEBUG=0kiwi_displayname=SLES12-SP1-EC2-HVMDIALOG_LANG=en_USbootLoaderOK=0

The above is obtained with a simple

print "\n\n", blob, "\n\n"

inserted above line 160 in util.py

After the changes proposed here are applied:

# /usr/bin/cloud-init init --local
Cloud-init v. 0.7.8 running 'init-local' at Thu, 15 Sep 2016 19:23:23 +0000. Up 1160.63 seconds.
2016-09-15 19:23:23,703 - __init__.py[WARNING]: apply_network_config is not currently implemented for distribution '<class 'cloudinit.distros.sles.Distro'>'.  Attempting to use apply_network

-- 
https://code.launchpad.net/~rjschwei/cloud-init/+git/cloud-init/+merge/305857
Your team cloud init development team is requested to review the proposed merge of ~rjschwei/cloud-init:propertypecheck into cloud-init:master.