yahoo-eng-team team mailing list archive

[Scott Moser <smoser@xxxxxxxxxx>]

Public bug reported:

The fix for bug 1325128 [1] included changes to the metadata service
seen at:
   trunk    [2]: 4a60c6a655006b2882331844664fac5cf67c5f34
   icehouse [3]: 9f59ca751f1a392ef24d8ab73a7bf5ce9655017e

The new code is around 100x slower.  That slow down causes
excessive load on the metadata server if an instance crawls the metadata
service (which generates dozens of http requests).

Both cloud-init and cirros's boot code crawl that meta-data service.  The
end result is linux instances boot time is dramatically affected.  A
typical Ubuntu boot time will be < 10 seconds to executing user code, but
after this regression, I'm seeing boots in the range of 30 to 45 seconds.

--
[1] http://pad.lv/1325128
[2] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34
[3] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34

** Affects: cloud-archive
     Importance: Medium
         Status: Confirmed

** Affects: cloud-archive/icehouse
     Importance: Medium
         Status: Confirmed

** Affects: cloud-archive/juno
     Importance: Undecided
         Status: Confirmed

** Affects: nova
     Importance: Undecided
         Status: New

** Affects: nova (Ubuntu)
     Importance: Medium
         Status: New

** Affects: nova (Ubuntu Trusty)
     Importance: Medium
         Status: Confirmed

** Affects: nova (Ubuntu Utopic)
     Importance: Medium
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1361357

Title:
  metadata service performance regression ~100x

Status in Ubuntu Cloud Archive:
  Confirmed
Status in ubuntu-cloud-archive icehouse series:
  Confirmed
Status in ubuntu-cloud-archive juno series:
  Confirmed
Status in OpenStack Compute (Nova):
  New
Status in “nova” package in Ubuntu:
  New
Status in “nova” source package in Trusty:
  Confirmed
Status in “nova” source package in Utopic:
  New

Bug description:
  The fix for bug 1325128 [1] included changes to the metadata service
  seen at:
     trunk    [2]: 4a60c6a655006b2882331844664fac5cf67c5f34
     icehouse [3]: 9f59ca751f1a392ef24d8ab73a7bf5ce9655017e

  The new code is around 100x slower.  That slow down causes
  excessive load on the metadata server if an instance crawls the metadata
  service (which generates dozens of http requests).

  Both cloud-init and cirros's boot code crawl that meta-data service.  The
  end result is linux instances boot time is dramatically affected.  A
  typical Ubuntu boot time will be < 10 seconds to executing user code, but
  after this regression, I'm seeing boots in the range of 30 to 45 seconds.

  --
  [1] http://pad.lv/1325128
  [2] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34
  [3] https://git.openstack.org/cgit/openstack/nova/commit/?id=4a60c6a655006b2882331844664fac5cf67c5f34

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1361357/+subscriptions