canonical-ubuntu-qa team mailing list archive

[Jeremy Bícha <2035101@xxxxxxxxxxxxxxxxxx>]

I believe this used to work correctly in previous years.

I believe it has been failing for several weeks or more but it took me
until now to be alert enough tosee it happen live with screenshots for
my first example and still happening while we wait for webkit2gtk to be
eligible for migration.

(We are fixing the devhelp regression regardless.)

-- 
You received this bug notification because you are a member of
Canonical's Ubuntu QA, which is subscribed to Auto Package Testing.
https://bugs.launchpad.net/bugs/2035101

Title:
  autopkgtest failures are ignored, apparently for packages with only
  superficial tests

Status in Auto Package Testing:
  New

Bug description:
  Example 1
  =========
  Yesterday, I noticed that gnome-metronome 1.3.0-0ubuntu2 was allowed to migrate from mantic-proposed to mantic despite its own autopkgtest failing on every architecture. This migration happened after an automatic migration-reference run happened which returned the result "neutral". "neutral" is expected for superficial autopkgtests like the one in gnome-metronome. Before that migration-reference run, the failures were correctly shown on the excuses page.

  Screenshots attached.

  https://autopkgtest.ubuntu.com/packages/gnome-metronome/mantic/amd64

  (I then uploaded 1.3.0-0ubuntu3 which fixed the autopkgtest
  regression)

  Here's the gnome-metronome autopkgtest code:
  https://salsa.debian.org/a-wai/gnome-metronome/-/blob/debian/master/debian/tests/control

  Example 2
  =========
  https://ubuntu-archive-team.ubuntu.com/proposed-migration/update_excuses.html#webkit2gtk

  does not show that the 2.41 series of webkit2gtk triggered an
  autopkgtest failure for devhelp

  https://autopkgtest.ubuntu.com/packages/devhelp/mantic/amd64

  However, Debian's britney is showing the failure:
  https://release.debian.org/britney/pseudo-excuses-experimental.html#webkit2gtk

  Here's the devhelp autopkgetst code:
  https://salsa.debian.org/gnome-team/devhelp/-/blob/debian/latest/debian/tests/control

  Theory
  ======
  My theory is that failures are being ignored for packages which only have superficial autopkgtests, like for devhelp and gnome-metronome.

  Possibly, this issue has been fixed in Debian's copy of britney
  already

To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/2035101/+subscriptions