yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1638964] [NEW] azure mirrors fallback to defaults in zesty

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: "Jose L. VG" <1638964@xxxxxxxxxxxxxxxxxx>
Date: Thu, 03 Nov 2016 15:47:08 -0000
Reply-to: Bug 1638964 <1638964@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

CPC AzureTests verify that azure vm instances get configured to access
azurre mirror:

azure.archive.ubuntu.com

But those are now failing for zesty:

06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ======================================================================
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: FAIL [15.669s]: test_archive (__main__.BasicAzureTests)
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ----------------------------------------------------------------------
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: Traceback (most recent call last):
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:   File "tests.py", line 111, in test_archive
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:     self._check_archive(suite)
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:   File "tests.py", line 96, in _check_archive
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:     list(configured_sources[suite]))
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: AssertionError: Lists differ: ['http://azure.archive.ubuntu.com/ubuntu'] != ['http://archive.ubuntu.com/ubuntu']
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: First differing element 0:
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 'http://azure.archive.ubuntu.com/ubuntu'
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 'http://archive.ubuntu.com/ubuntu'
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: - ['http://azure.archive.ubuntu.com/ubuntu']
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ?          ------
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: + ['http://archive.ubuntu.com/ubuntu']
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ----------------------------------------------------------------------
06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: Ran 8 tests in 19.926s


In zesty cloud-init logs show that no mirrors get detected and non azure ones get picked:

https://cloud-images-jenkins.canonical.com/job/Azure-Tests/767/TEST
=azure-
general,VMSIZE=A9,WITH_PASSWORD=yes,label=EC2-Tester/artifact/debug
/jenk-bhzejytlnepwbyswwtcb/log/cloud-init.log

Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: got primary mirror: None
Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: got security mirror: None
Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] util.py[DEBUG]: Running command ['dpkg', '--print-architecture'] with allowed return codes [0] (shell=False, capture=True)
Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] __init__.py[DEBUG]: filtered distro mirror info: {'primary': 'http://archive.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu'}
Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: Apt Mirror info: {'SECURITY': 'http://security.ubuntu.com/ubuntu', 'MIRROR': 'http://archive.ubuntu.com/ubuntu', 'primary': 'http://archive.ubuntu.com/ubuntu', 'PRIMARY': 'http://archive.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu'}


Whereas for yakkety, nothing is detected either but it does the right
thing when falling back to azure... mirrors:

https://cloud-images-jenkins.canonical.com/job/Azure-Tests/771/TEST
=azure-
general,VMSIZE=A9,WITH_PASSWORD=no,label=EC2-Tester/artifact/debug/jenk-
oowesmowfntzrrnvntko/log/cloud-init.log

Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: got primary mirror: None
Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: got security mirror: None
Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] util.py[DEBUG]: Running command ['dpkg', '--print-architecture'] with allowed return codes [0] (shell=False, capture=True)
Nov  3 10:26:27 jenk-oowesmowfntzrrnvntko [CLOUDINIT] __init__.py[DEBUG]: filtered distro mirror info: {'primary': 'http://azure.archive.ubuntu.com/ubuntu/', 'security': 'http://security.ubuntu.com/ubuntu'}
Nov  3 10:26:27 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: Apt Mirror info: {'primary': 'http://azure.archive.ubuntu.com/ubuntu/', 'SECURITY': 'http://security.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu', 'PRIMARY': 'http://azure.archive.ubuntu.com/ubuntu/', 'MIRROR': 'http://azure.archive.ubuntu.com/ubuntu/'}

** Affects: cloud-images
     Importance: Undecided
         Status: New

** Affects: cloud-init
     Importance: Undecided
         Status: New

** Project changed: cloud-init => cloud-images

** Also affects: cloud-init
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to cloud-init.
https://bugs.launchpad.net/bugs/1638964

Title:
  azure mirrors fallback to defaults in zesty

Status in cloud-images:
  New
Status in cloud-init:
  New

Bug description:
  CPC AzureTests verify that azure vm instances get configured to access
  azurre mirror:

  azure.archive.ubuntu.com

  But those are now failing for zesty:

  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ======================================================================
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: FAIL [15.669s]: test_archive (__main__.BasicAzureTests)
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ----------------------------------------------------------------------
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: Traceback (most recent call last):
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:   File "tests.py", line 111, in test_archive
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:     self._check_archive(suite)
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:   File "tests.py", line 96, in _check_archive
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out:     list(configured_sources[suite]))
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: AssertionError: Lists differ: ['http://azure.archive.ubuntu.com/ubuntu'] != ['http://archive.ubuntu.com/ubuntu']
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: First differing element 0:
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 'http://azure.archive.ubuntu.com/ubuntu'
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 'http://archive.ubuntu.com/ubuntu'
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: - ['http://azure.archive.ubuntu.com/ubuntu']
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ?          ------
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: + ['http://archive.ubuntu.com/ubuntu']
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: 
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: ----------------------------------------------------------------------
  06:03:40  [jenk-xzwlmlnhynsbvejazvmj.cloudapp.net:22] out: Ran 8 tests in 19.926s

  
  In zesty cloud-init logs show that no mirrors get detected and non azure ones get picked:

  https://cloud-images-jenkins.canonical.com/job/Azure-Tests/767/TEST
  =azure-
  general,VMSIZE=A9,WITH_PASSWORD=yes,label=EC2-Tester/artifact/debug
  /jenk-bhzejytlnepwbyswwtcb/log/cloud-init.log

  Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: got primary mirror: None
  Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: got security mirror: None
  Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] util.py[DEBUG]: Running command ['dpkg', '--print-architecture'] with allowed return codes [0] (shell=False, capture=True)
  Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] __init__.py[DEBUG]: filtered distro mirror info: {'primary': 'http://archive.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu'}
  Nov  3 06:15:52 jenk-bhzejytlnepwbyswwtcb [CLOUDINIT] cc_apt_configure.py[DEBUG]: Apt Mirror info: {'SECURITY': 'http://security.ubuntu.com/ubuntu', 'MIRROR': 'http://archive.ubuntu.com/ubuntu', 'primary': 'http://archive.ubuntu.com/ubuntu', 'PRIMARY': 'http://archive.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu'}


  Whereas for yakkety, nothing is detected either but it does the right
  thing when falling back to azure... mirrors:

  https://cloud-images-jenkins.canonical.com/job/Azure-Tests/771/TEST
  =azure-
  general,VMSIZE=A9,WITH_PASSWORD=no,label=EC2-Tester/artifact/debug
  /jenk-oowesmowfntzrrnvntko/log/cloud-init.log

  Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: got primary mirror: None
  Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: got security mirror: None
  Nov  3 10:26:26 jenk-oowesmowfntzrrnvntko [CLOUDINIT] util.py[DEBUG]: Running command ['dpkg', '--print-architecture'] with allowed return codes [0] (shell=False, capture=True)
  Nov  3 10:26:27 jenk-oowesmowfntzrrnvntko [CLOUDINIT] __init__.py[DEBUG]: filtered distro mirror info: {'primary': 'http://azure.archive.ubuntu.com/ubuntu/', 'security': 'http://security.ubuntu.com/ubuntu'}
  Nov  3 10:26:27 jenk-oowesmowfntzrrnvntko [CLOUDINIT] cc_apt_configure.py[DEBUG]: Apt Mirror info: {'primary': 'http://azure.archive.ubuntu.com/ubuntu/', 'SECURITY': 'http://security.ubuntu.com/ubuntu', 'security': 'http://security.ubuntu.com/ubuntu', 'PRIMARY': 'http://azure.archive.ubuntu.com/ubuntu/', 'MIRROR': 'http://azure.archive.ubuntu.com/ubuntu/'}

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-images/+bug/1638964/+subscriptions
Follow ups

[Bug 1638964] Re: azure mirrors fallback to defaults in zesty
From: Launchpad Bug Tracker, 2019-04-21
[Bug 1638964] Re: azure mirrors fallback to defaults in zesty
From: Launchpad Bug Tracker, 2019-04-21