canonical-ubuntu-qa team mailing list archive
-
canonical-ubuntu-qa team
-
Mailing list archive
-
Message #01310
[Bug 2035101] Re: autopkgtest failures are ignored, apparently for packages with only superficial tests
Example 2 could happen in the event that the autopkgtest.db files were
out of sync on the autopkgtest-web units and britney used the one with
old results. However, querying the database we can see that there are
results for webkit2gtk and devhelp in both databases.
ubuntu@juju-4d1272-prod-proposed-migration-11:~$ sqlite3 autopkgtest.db "SELECT DISTINCT test.arch, test.package, result.triggers, result.run_id, result.exitcode FROM RESULT INNER JOIN test on result.test_id=test.id WHERE test.arch = 'amd64' AND test.package = 'devhelp' AND result.run_id LIKE '%202309%'"
amd64|devhelp|glib2.0/2.77.3-1|20230904_021459_84fbc@|8
amd64|devhelp|webkit2gtk/2.41.91-2|20230907_075337_8d55b@|4
amd64|devhelp|gsettings-desktop-schemas/45~rc-1ubuntu1|20230907_195316_59de4@|8
amd64|devhelp|webkit2gtk/2.41.92-1|20230909_052611_fd604@|4
amd64|devhelp|glib2.0/2.78.0-1|20230909_105044_9533a@|8
ubuntu@juju-4d1272-prod-proposed-migration-10:~/public$ sqlite3 autopkgtest.db "SELECT DISTINCT test.arch, test.package, result.triggers, result.run_id, result.exitcode FROM RESULT INNER JOIN test on result.test_id=test.id WHERE test.arch = 'amd64' AND test.package = 'devhelp' AND result.run_id LIKE '%202309%'"
amd64|devhelp|glib2.0/2.77.3-1|20230904_021459_84fbc@|8
amd64|devhelp|webkit2gtk/2.41.91-2|20230907_075337_8d55b@|4
amd64|devhelp|gsettings-desktop-schemas/45~rc-1ubuntu1|20230907_195316_59de4@|8
amd64|devhelp|webkit2gtk/2.41.92-1|20230909_052611_fd604@|4
amd64|devhelp|glib2.0/2.78.0-1|20230909_105044_9533a@|8
--
You received this bug notification because you are a member of
Canonical's Ubuntu QA, which is subscribed to Auto Package Testing.
https://bugs.launchpad.net/bugs/2035101
Title:
autopkgtest failures are ignored, apparently for packages with only
superficial tests
Status in Auto Package Testing:
New
Bug description:
Example 1
=========
Yesterday, I noticed that gnome-metronome 1.3.0-0ubuntu2 was allowed to migrate from mantic-proposed to mantic despite its own autopkgtest failing on every architecture. This migration happened after an automatic migration-reference run happened which returned the result "neutral". "neutral" is expected for superficial autopkgtests like the one in gnome-metronome. Before that migration-reference run, the failures were correctly shown on the excuses page.
Screenshots attached.
https://autopkgtest.ubuntu.com/packages/gnome-metronome/mantic/amd64
(I then uploaded 1.3.0-0ubuntu3 which fixed the autopkgtest
regression)
Here's the gnome-metronome autopkgtest code:
https://salsa.debian.org/a-wai/gnome-metronome/-/blob/debian/master/debian/tests/control
Example 2
=========
https://ubuntu-archive-team.ubuntu.com/proposed-migration/update_excuses.html#webkit2gtk
does not show that the 2.41 series of webkit2gtk triggered an
autopkgtest failure for devhelp
https://autopkgtest.ubuntu.com/packages/devhelp/mantic/amd64
However, Debian's britney is showing the failure:
https://release.debian.org/britney/pseudo-excuses-experimental.html#webkit2gtk
Here's the devhelp autopkgetst code:
https://salsa.debian.org/gnome-team/devhelp/-/blob/debian/latest/debian/tests/control
Theory
======
My theory is that failures are being ignored for packages which only have superficial autopkgtests, like for devhelp and gnome-metronome.
Possibly, this issue has been fixed in Debian's copy of britney
already
To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/2035101/+subscriptions
References