canonical-ubuntu-qa team mailing list archive

[Skia <mp+478927@xxxxxxxxxxxxxxxxxx>]

Skia has proposed merging ~hyask/autopkgtest-cloud/+git/autopkgtest-package-configs:skia/use_more_big_packages into autopkgtest-cloud:master.

Requested reviews:
  Canonical's Ubuntu QA (canonical-ubuntu-qa)

For more details, see:
https://code.launchpad.net/~hyask/autopkgtest-cloud/+git/autopkgtest-package-configs/+merge/478927

Clean up `big_packages` and use more `all` to save dev time.
-- 
Your team Canonical's Ubuntu QA is requested to review the proposed merge of ~hyask/autopkgtest-cloud/+git/autopkgtest-package-configs:skia/use_more_big_packages into autopkgtest-cloud:master.

diff --git a/README.md b/README.md
index 75a195d..a516447 100644
--- a/README.md
+++ b/README.md
@@ -1,3 +1,4 @@
+<<<<<<< README.md
 autopkgtest-cloud
 =================
 
@@ -9,3 +10,49 @@ delivering their results.
 
 See docs/ or [our readthedocs page](https://autopkgtest-cloud.readthedocs.io)
 for the complete documentation for developers and admins of autopkgtest-cloud.
+=======
+# autopkgtest-cloud per-package overrides
+
+## Intro
+
+This repository contains three files which control how tests for specific
+packages are run. It is consumed by autopkgtest-cloud automatically. After
+adding a package to big_packages or long_tests and submitting a request to
+rerun the test for one release you should also consider rerunning tests
+(with a migration-reference/0 trigger) for other releases.
+
+## Syntax
+
+The syntax of all files is the same: `sourcepackage/arch/release`.
+`sourcepackage` is mandatory. The other two can be omitted or be the special
+string `all`, which means apply to all architectures/releases.
+
+Lines beginning with a `#` are treated as comments and ignored.
+
+## big_packages
+
+Entries here run on the `package_size_big` Openstack flavour (which has more
+memory and a larger disk) as opposed to the `package_size_default` one. That
+means this is only meaningful for packages which run on Openstack (not `lxd`).
+Entries here also use a longer `--timeout-test`.
+
+## long_tests
+
+Entries here use a longer `--timeout-test`, `--timeout-copy` and
+`--timeout-build`. This is currently defined in the code of
+`autopkgtest-cloud`.
+
+## never_run
+
+Entries here are never run. A worker which encounters one of these will
+acknowledge the job and upload a log file which says that the job was
+skipped.
+
+## esm_specials
+
+Entries here will run even though the arch may not be supported for that
+release any more i.e. for trusty and xenial we should only be running amd64 and
+i386 tests as only those arches are supported via ESM. However, there are some
+packages which still follow the regular SRU process despite the release having
+reached end of standard support.
+>>>>>>> README.md
diff --git a/big_packages b/big_packages
new file mode 100644
index 0000000..47dd6b9
--- /dev/null
+++ b/big_packages
@@ -0,0 +1,244 @@
+# As soon as a package requires an entry here for more than only one
+# architecture, just set it to `all`, and don't waste time on it.
+abyss
+aevol
+akonadi
+androguard
+apt/ppc64el
+armci-mpi
+asmjit/arm64
+assimp/i386
+asymptote
+bbmap
+benchmark
+binutils
+botch
+camitk
+cargo
+celery
+chromium-browser
+cimg/ppc64el
+cloudkitty/ppc64el
+cl-ironclad
+cod-tools/ppc64el
+cppcheck/ppc64el
+cppimport
+cross-toolchain-base-mipsen/i386
+cross-toolchain-base
+curtin/amd64
+cwltool
+cython-legacy
+cython
+dask.distributed
+dask
+ddnet
+deal.ii
+delve/arm64
+dials
+diffoscope/ppc64el
+dipy/ppc64el
+dolfinx
+dolfin
+dotnet6
+dotnet7
+dotnet8
+dotnet9
+dpdk
+dracut
+dvisvgm
+einsteinpy/ppc64el
+fastp/ppc64el
+fenics-dolfinx
+finalcif/arm64
+firefox
+freecad
+gammapy
+ganeti
+ghdl
+gjs/ppc64el
+glibc
+gnudatalanguage/arm64
+golang-github-aws-aws-sdk-go-v2/amd64
+golang-github-hillu-go-yara/ppc64el
+golang-github-klauspost-compress
+golang-github-protonmail-go-crypto
+golang-github-valyala-gozstd
+gscan2pdf/arm64
+heat-dashboard/armhf
+heudiconv
+hilive/arm64
+hugo/ppc64el
+igraph
+ipyparallel
+joblib
+jsurf-alggeo/arm64
+juce
+julia
+jupyter-client/arm64
+khmer/amd64
+kineticstools
+kmc/ppc64el
+libaio/ppc64el
+libflame
+libmedia-convert-perl
+libreoffice
+libsis-jhdf5-java
+libtext-bidi-perl
+link-grammar
+lintian/arm64
+linux-*
+linux
+livecd-rootfs/amd64
+lmfit-py
+loguru/ppc64el
+lttng-modules
+makedumpfile/ppc64el
+mariadb-10.3/i386
+mariadb-10.5/i386
+mariadb-10.6/amd64
+mathicgb
+mdanalysis
+mercurial
+meson
+mkl-dnn/i386
+multipath-tools
+mysql-8.0
+mysql-connector-c++/s390x
+netgen/ppc64el
+nodejs
+node-foreground-child
+node-get-stream
+node-immutable-tuple/arm64
+node-package-json
+node-redis/arm64
+nova
+numcodecs/s390x
+numpy
+nvidia-cuda-samples
+nvidia-cuda-toolkit/amd64
+nwchem
+ocrmypdf
+octave-image
+octave-parallel
+onetbb
+openjdk-8
+openjdk-13
+openjdk-14
+openjdk-22
+openjdk-lts
+openmm/ppc64el
+openmolcas
+openmsx
+opensaml/arm64
+openvswitch
+ovn
+pandas
+petsc4py
+puma
+pybind11
+pyfai
+pygrib
+pymatgen
+pyresample
+pyside2/arm64
+pytango
+pytest-qt
+python2.7/i386
+python3.6/i386
+python3.7/i386
+python3.8/i386
+python3.9/ppc64el
+python3.10/ppc64el
+python3.12/ppc64el
+python-aiortc
+python-bumps
+python-cffi
+python-cogent
+python-cryptography
+python-django-celery-results
+python-dmsh
+python-hypothesis
+python-molotov
+python-pymbar
+python-refurb/ppc64el
+python-ruffus
+python-scipy/i386
+pythran
+pytorch/amd64
+q2-feature-classifier
+reproject
+rocs
+rsass
+ruby-minitest
+ruby-parallel
+rustc
+rust-ahash
+rust-axum/ppc64el
+rust-cargo-c/ppc64el
+rust-etherparse/s390x
+rust-gdk-pixbuf
+rust-gtk3-macros
+rust-gtk4-macros/s390x
+rust-gtk4
+rust-loom/arm64
+rust-png
+rust-proptest/s390x
+rust-rayon
+rust-sequoia-openpgp
+rust-sequoia-wot/ppc64el
+rust-smartstring/s390x
+rust-tinyvec/ppc64el
+rust-tokio/s390x
+rust-uom
+rust-x11rb-protocol/arm64
+rust-x11rb
+r-bioc-beachmat
+r-bioc-biocsingular
+r-bioc-cummerbund/ppc64el
+r-bioc-metagenomeseq
+r-bioc-netsam
+r-bioc-rgsepd/ppc64el
+r-bioc-scuttle
+r-bioc-sva
+r-bioc-variantannotation
+r-cran-bayesm/ppc64el
+r-cran-datawizard
+r-cran-epi
+r-cran-future
+r-cran-igraph
+r-cran-insight
+r-cran-mertools/ppc64el
+r-cran-parameters
+r-cran-prophet
+r-cran-rpact
+r-cran-rstanarm
+sagemath/arm64
+samba/ppc64el
+samtools
+sarsen
+satpy
+sbcl/arm64
+scapy
+scikit-learn
+scipy
+seaborn/s390x
+senlin/s390x
+seqan-raptor
+seqan-raptor/arm64
+seqan-raptor/ppc64el
+silx
+skimage
+spaln
+specutils/ppc64el
+spyder/arm64
+statsmodels
+svgpp
+systemd-upstream/ppc64el
+systemd
+tdb
+tgt
+toil
+umap-learn/amd64
+vedo/s390x
+xtensor
+yt
diff --git a/esm_specials b/esm_specials
new file mode 100644
index 0000000..82c110e
--- /dev/null
+++ b/esm_specials
@@ -0,0 +1,8 @@
+ubuntu-advantage-tools/arm64
+ubuntu-advantage-tools/armhf
+ubuntu-advantage-tools/ppc64el
+ubuntu-advantage-tools/s390x
+update-notifier/arm64
+update-notifier/armhf
+update-notifier/ppc64el
+update-notifier/s390x
diff --git a/long_tests b/long_tests
new file mode 100644
index 0000000..6778dd7
--- /dev/null
+++ b/long_tests
@@ -0,0 +1,78 @@
+automake-1.16/arm64
+automake-1.16/armhf
+cross-toolchain-base/amd64
+cross-toolchain-base/arm64
+cross-toolchain-base/armhf
+cross-toolchain-base/i386
+cross-toolchain-base/ppc64el
+cross-toolchain-base/s390x
+curtin/amd64
+diffoscope/amd64
+diffoscope/arm64
+diffoscope/armhf
+diffoscope/i386
+diffoscope/ppc64el
+diffoscope/s390x
+epson-inkjet-printer-escpr/arm64
+epson-inkjet-printer-escpr/armhf
+glibc/arm64
+glibc/armhf
+gmp-ecm/amd64
+gmp-ecm/arm64
+gmp-ecm/armhf
+gmp-ecm/i386
+gmp-ecm/ppc64el
+gmp-ecm/s390x
+gutenprint/amd64
+gutenprint/arm64
+gutenprint/armhf
+gutenprint/i386
+gutenprint/ppc64el
+gutenprint/s390x
+haveged/arm64
+haveged/armhf
+libmceliece/amd64
+lintian/arm64
+linux-*/arm64
+linux-*/armhf
+linux/arm64
+linux/armhf
+macaulay2/arm64
+mercurial/amd64
+mercurial/armhf
+mercurial/i386
+open-iscsi/amd64
+open-iscsi/arm64
+open-iscsi/armhf
+open-iscsi/i386
+open-iscsi/ppc64el
+open-iscsi/s390x
+openjdk-22/armhf
+openjdk-8/armhf
+pandas/armhf
+pytorch/arm64
+pytorch/ppc64el
+rustc/arm64
+rustc/armhf
+sagemath/amd64
+salt/arm64
+salt/armhf
+simde/armhf
+snapcraft/amd64
+snapcraft/arm64
+snapcraft/armhf
+snapcraft/i386
+snapcraft/ppc64el
+snapcraft/s390x
+snapd/arm64
+snapd/armhf
+snapd/ppc64el
+snapd/s390x
+sshuttle/amd64
+sshuttle/arm64
+sshuttle/armhf
+sshuttle/i386
+sshuttle/ppc64el
+sshuttle/s390x
+systemd/ppc64el
+systemd-upstream/ppc64el
diff --git a/never_run b/never_run
new file mode 100644
index 0000000..c2ed6ea
--- /dev/null
+++ b/never_run
@@ -0,0 +1,240 @@
+libnih/amd64/bionic
+libnih/arm64/bionic
+libnih/armhf/bionic
+libnih/armhf/xenial
+libnih/i386/bionic
+libnih/ppc64el/bionic
+libnih/s390x/bionic
+openjdk-13/arm64/focal
+openjdk-13/armhf/focal
+openjdk-14/arm64/focal
+openjdk-14/armhf/focal
+openjdk-lts/arm64/bionic
+openjdk-lts/arm64/focal
+openjdk-lts/armhf/bionic
+openjdk-lts/i386/bionic
+openjdk-lts/ppc64el/bionic
+openjdk-lts/s390x/bionic
+r-cran-vioplot/amd64/bionic
+r-cran-vioplot/arm64/bionic
+r-cran-vioplot/armhf/bionic
+r-cran-vioplot/i386/bionic
+r-cran-vioplot/ppc64el/bionic
+r-cran-vioplot/s390x/bionic
+stress-ng/amd64/bionic
+stress-ng/arm64/bionic
+stress-ng/i386/bionic
+stress-ng/ppc64el/bionic
+stress-ng/s390x/bionic
+upstart/amd64/bionic
+upstart/arm64/bionic
+upstart/i386/bionic
+upstart/ppc64el/bionic
+upstart/s390x/bionic
+virtualbox-ext-pack/amd64/bionic
+virtualbox-ext-pack/amd64/xenial
+virtualbox-ext-pack/arm64/bionic
+virtualbox-ext-pack/arm64/xenial
+virtualbox-ext-pack/armhf/bionic
+virtualbox-ext-pack/armhf/xenial
+virtualbox-ext-pack/i386/bionic
+virtualbox-ext-pack/i386/xenial
+virtualbox-ext-pack/ppc64el/bionic
+virtualbox-ext-pack/ppc64el/xenial
+virtualbox-ext-pack/s390x/bionic
+virtualbox-ext-pack/s390x/xenial
+# times out regularly and has never passed
+altree/armhf/focal
+altree/armhf/jammy
+altree/ppc64el/focal
+altree/ppc64el/jammy
+# times out https://bugs.debian.org/973359
+booth/armhf/bionic
+booth/armhf/focal
+booth/i386/bionic
+# times out regularly and armhf isn't great about clean ups
+gfan/armhf/focal
+# temporary additions for jammy
+# this hasn't passed for multiple releases of Ubuntu
+debci/amd64/jammy
+debci/arm64/jammy
+debci/armhf/jammy
+debci/i386/jammy
+debci/ppc64el/jammy
+debci/s390x/jammy
+
+# times out regularly and armhf isn't great about clean ups
+pglogical/armhf/bionic
+pglogical/armhf/focal
+python-ase/armhf/jammy
+sabnzbdplus/armhf/jammy
+
+# assimp fails on 32 bit arches https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=995859
+assimp/armhf/jammy
+# it dumps core and we can't add more memory on armhf
+assimp/armhf/focal
+
+# tests timing out because the package is incompatible with firefox shipped as
+# a snap. see https://launchpad.net/bugs/1987959
+libfirefox-marionette-perl/amd64/jammy
+libfirefox-marionette-perl/arm64/jammy
+libfirefox-marionette-perl/armhf/jammy
+libfirefox-marionette-perl/i386/jammy
+libfirefox-marionette-perl/ppc64el/jammy
+libfirefox-marionette-perl/s390x/jammy
+
+# the tests time out after calling `setup_apt` which is tailored to Debian and
+# fails on Ubuntu. LP: #1983522
+cryptsetup/amd64/jammy
+cryptsetup/arm64/jammy
+cryptsetup/i386/jammy
+cryptsetup/ppc64el/jammy
+cryptsetup/s390x/jammy
+
+# times out on s390x https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1016937
+atop/s390x/jammy
+
+# times out on non-amd64 arches
+auto-multiple-choice/arm64/bionic
+auto-multiple-choice/armhf/bionic
+auto-multiple-choice/ppc64el/bionic
+auto-multiple-choice/s390x/bionic
+
+# times out https://bugs.debian.org/953939
+bamtools/arm64/bionic
+bamtools/arm64/focal
+# times out https://bugs.debian.org/987023
+bamtools/armhf/bionic
+bamtools/armhf/focal
+bamtools/ppc64el/bionic
+# times out https://bugs.debian.org/987023
+bamtools/s390x/bionic
+bamtools/s390x/focal
+
+# started timing out in 2022 per Debian
+# confirmed via a local test on amd64
+astroplan/amd64/bionic
+
+# running raspi kernel tests in OpenStack is pointless since the relevant
+# kernel code is never exercised. LP: #1930082
+linux-raspi/all/all
+linux-raspi2/all/all
+linux-raspi-5.4/all/all
+# 2024-03-30 the above might be true with linux-meta-raspi which depends
+# on linux-raspi
+linux-meta-raspi/all/all
+
+# linux-starfive is for riscv64 and nothing else
+linux-starfive/all/mantic
+linux-starfive/all/noble
+
+# Never run EOL kernels ADT-165
+# generated with kteam-tools/stable/swm-autopkgtest-config
+# update approximately every 6 months
+#
+linux-ibm/all/mantic
+linux-allwinner-5.17/all/jammy
+linux-allwinner-5.19/all/jammy
+linux-aws-5.19/all/jammy
+linux-aws-6.2/all/jammy
+linux-azure-5.19/all/jammy
+linux-azure-6.2/all/jammy
+linux-azure-fde-5.19/all/jammy
+linux-azure-fde-6.2/all/jammy
+linux-gcp-5.19/all/jammy
+linux-gcp-6.2/all/jammy
+linux-hwe-5.17/all/jammy
+linux-hwe-5.19/all/jammy
+linux-hwe-6.2/all/jammy
+linux-lowlatency-hwe-5.19/all/jammy
+linux-lowlatency-hwe-6.2/all/jammy
+linux-oem-5.17/all/jammy
+linux-oem-6.0/all/jammy
+linux-oem-6.1/all/jammy
+linux-oracle-5.19/all/jammy
+linux-oracle-6.2/all/jammy
+linux-riscv/all/jammy
+linux-riscv-5.19/all/jammy
+linux-starfive-5.17/all/jammy
+linux-starfive-5.19/all/jammy
+linux-starfive-6.2/all/jammy
+linux-uc22-lowlatency/all/jammy
+linux-adv-uno420/all/focal
+linux-adv-uno420-uc20-efi/all/focal
+linux-aws-5.11/all/focal
+linux-aws-5.13/all/focal
+linux-aws-5.8/all/focal
+linux-azure-5.11/all/focal
+linux-azure-5.13/all/focal
+linux-azure-5.8/all/focal
+linux-azure-cvm/all/focal
+linux-azure-fde/all/focal
+linux-gcp-5.11/all/focal
+linux-gcp-5.13/all/focal
+linux-gcp-5.8/all/focal
+linux-gke/all/focal
+linux-gke-5.15/all/focal
+linux-hwe-5.11/all/focal
+linux-hwe-5.13/all/focal
+linux-hwe-5.8/all/focal
+linux-intel/all/focal
+linux-intel-5.13/all/focal
+linux-oem-5.10/all/focal
+linux-oem-5.13/all/focal
+linux-oem-5.14/all/focal
+linux-oem-5.6/all/focal
+linux-oracle-5.11/all/focal
+linux-oracle-5.13/all/focal
+linux-oracle-5.8/all/focal
+linux-qcomm/all/focal
+linux-raspi2/all/focal
+linux-riscv/all/focal
+linux-riscv-5.11/all/focal
+linux-riscv-5.13/all/focal
+linux-riscv-5.8/all/focal
+linux-uc20-intel/all/focal
+linux-uc20-qcomm/all/focal
+# 2024-03-28 swm-autopkgtest-config wanted
+# to drop these but bdmurray is conservative
+linux-aws-5.0/all/bionic
+linux-aws-5.3/all/bionic
+linux-aws-edge/all/bionic
+linux-azure/all/bionic
+linux-azure-5.3/all/bionic
+linux-azure-edge/all/bionic
+linux-bluefield/all/bionic
+linux-denver/all/bionic
+linux-gcp/all/bionic
+linux-gcp-5.3/all/bionic
+linux-gcp-edge/all/bionic
+linux-gke-4.15/all/bionic
+linux-gke-5.0/all/bionic
+linux-gke-5.3/all/bionic
+linux-gke-5.4/all/bionic
+linux-gkeop-5.4/all/bionic
+linux-hwe/all/bionic
+linux-hwe-5.0/all/bionic
+linux-mt8516/all/bionic
+linux-oem/all/bionic
+linux-oracle-5.0/all/bionic
+linux-oracle-5.3/all/bionic
+linux-raspi2-5.3/all/bionic
+
+# it's deps aren't available anyway
+libreoffice/i386/focal
+libreoffice/i386/jammy
+#libreoffice/i386/mantic
+
+# it's deps aren't available anyway
+ubuntu-release-upgrader/i386/focal
+ubuntu-release-upgrader/i386/jammy
+ubuntu-release-upgrader/i386/mantic
+ubuntu-release-upgrader/i386/noble
+
+# something keeps queuing up migration-reference/0 tests
+linux-nvidia-5.19/amd64/jammy
+linux-nvidia-5.19/arm64/jammy
+
+# something keeps queuing up migration-reference/0 tests which fail
+# ERROR: erroneous package: rules extract failed with exit code 1
+firefox/s390x/focal