canonical-ubuntu-qa team mailing list archive

[Adrien Nader <2071448@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Test results are currently accessible in two (three?) ways:

- sqlite, a 1.6GB file with random updates and accessible only through HTTP: not syncable
- web page, scrappable
- something internal?

I'd like to access all tests "currently" relevant for migrations. At the
moment, I can scrap the webpages but I have doubts that it will be
considered friendly to the web server if I do that several thousands of
times every 20 minutes. This is why I am looking for something bulk,
that can be synced/updated/fetched frequently.

I can think of at least two approaches but don't know the constraints
that exist.

- atomically-updated file (JSON or any other format) with the date in its name: size should be small enough that fully downloading each time is fine, and there should be no concern about per-day cutoff since it will be required to keep past days locally anyway
- same as above but with a different granularity: week, month, or even one for the every series?
- append-only file

Thanks

** Affects: auto-package-testing
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of
Canonical's Ubuntu QA, which is subscribed to Auto Package Testing.
https://bugs.launchpad.net/bugs/2071448

Title:
  Please provide bulk test results in a remote-friendly medium

Status in Auto Package Testing:
  New

Bug description:
  Test results are currently accessible in two (three?) ways:

  - sqlite, a 1.6GB file with random updates and accessible only through HTTP: not syncable
  - web page, scrappable
  - something internal?

  I'd like to access all tests "currently" relevant for migrations. At
  the moment, I can scrap the webpages but I have doubts that it will be
  considered friendly to the web server if I do that several thousands
  of times every 20 minutes. This is why I am looking for something
  bulk, that can be synced/updated/fetched frequently.

  I can think of at least two approaches but don't know the constraints
  that exist.

  - atomically-updated file (JSON or any other format) with the date in its name: size should be small enough that fully downloading each time is fine, and there should be no concern about per-day cutoff since it will be required to keep past days locally anyway
  - same as above but with a different granularity: week, month, or even one for the every series?
  - append-only file

  Thanks

To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/2071448/+subscriptions