← Back to team overview

lubuntu-qa team mailing list archive

Re: ISO Testing Cadence Week

 

Lance, these bugs are perfect to bring up. I will ask the release team directly both about there plans for abiword, and that installer bug. It was slated to be fixed as you can see, but clearly was not fixed as part of alpha 3.
I would echo phillw here; don't ever sit on a bug that isn't getting 
good attention! I have raised attention to several bugs this cycle 
brought up by folks like yourself and gotten resolution. We can't always 
fix everything, but I don't like bugs sitting without comment. If we 
can't fix it, let's talk about why and workarounds. If we can, let's 
communicate the timing.Things are very easy to slip through the cracks, 
and part of our job as a community QA team is to point out things like 
this that slip through. I should have an answer on Friday -- I'll push 
to have follow-up comments on both bugs, so you'll see the response.
On the cadence testing, this is something the greater community asked us 
to do. I think it's time we all talked about how it's working out, and 
in general, how ISO testing, communication, respins, etc are working 
out. We all know the importance of iso testing, but we also know that it 
has issues because of so many teams and people involved. You guys should 
be proud of your work in testing, and it's my goal to see your work 
valued not only by me, but by the rest of the community. After alpha 3 
we said we would meet and talk. It's been a week and a half, plenty of 
time to reflect. Time now to talk and see what we can do to make beta 1 
better. Expect to see an invite from me soon :-) Thanks,
Nicholas

On 08/08/2012 12:13 PM, Phill Whiteside wrote:
Hi Lance,

Bug #987418 is still active. On the defence of the release team, I include a note from their meeting today:
(16:51:05) slangasek: I know 12.04.1 has pulled a lot of effort away 
from quantal development for this first part of the cycle, but please 
make it a focus for the next couple of weeks to get these back on track
The Abiword bug is also still very much alive and kicking.

@Nicholas could you check as to if any progress has been made to put the 'stable' version of Abiword into precise & quantal, the note from the abiword people about frustration at ubuntu shipping an unstable is quite evident.
Lance, with regard to cadence testing, it is accepted that the current 
set up does not make the reporting of such tests easily available. It 
is being worked upon.
(15:48:25) phillw: balloons: has any progress been made so that the 
daily builds do not wipe out what has been tested on 
http://iso.qa.ubuntu.com/qatracker/milestones/219/builds
(15:52:06) balloons: phillw, you mean in the same way as during a 
milestone?
(15:52:24) balloons: this week, although it's harder for you to see 
the previous results, they are not lost or wiped
(15:52:41) balloons: I am counting and attempting to track them.
(15:52:42) phillw: balloons: yes. otherwise no one knows what has been tested :) (15:53:08) balloons: phillw, yes, I know.. that is definitely an issue.. But we don't have a good tech solution atm to the problem (15:53:16) phillw: the only way I can track is by turning on the history which makes for a very long list! (15:53:23) balloons: if we did a traditional milestone, we'd lose results on the new iso releases
Honest, my good friend, these things are not being ignored! Please do 
not feel down hearted.
If anyone has points that they wish raising at the weekly QA meeting, 
please feel free to email me and I'll add them to the agenda at 
https://wiki.ubuntu.com/QATeam/Meetings It is important that we know 
of frustrations. I do try to keep myself updated by the tracker and 
this mailing list as to any issues that I perceive as needing a 'kick 
up the bum', but stuff can sneak in under my radar and I rely on you 
fantastic people to poke me to ensure that we do not have people 
thinking there are serious bugs that are felt to be unloved. Having 
had personally an un-loved bug, I do fully appreciate just how 
frustrating it is!
Regards,

Phill.

On 8 August 2012 14:36, Lance <lbsolost@xxxxxxxxx <mailto:lbsolost@xxxxxxxxx>> wrote:
    Before I even get started please remember that I suffer from a
    brain injury and my analysis may be extremely flawed ;^)

    I rather think "cadence" should be changed to "early"! Are we
    ready for iso-testing? This should be a point where we see if
    we're even close to being ready. If we're not ready how do we
    report that?

Regarding re-spins I don't know how we can possibly improve that. If a serious bug is recognized by one of the devs there will be a
    respin. But this is a serious bug:

    https://bugs.launchpad.net/ubuntu/+source/ubiquity/+bug/987418

    It effects both Precise and Quantal but it seems to get no love :^(

    Another is making a decision on Abiword:

    https://bugs.launchpad.net/ubuntu/+source/abiword/+bug/1019621

    There comes a point where testers wonder if their testing even
    matters. I've been testing since Hardy and I've never had less
    confidence in the effect of my effort :^(

    When testers feel they're no longer being listened to they will
    stop testing.

    Lance


    --- On *Tue, 8/7/12, Phill Whiteside /<PhillW@xxxxxxxxxx>/* wrote:


        From: Phill Whiteside <PhillW@xxxxxxxxxx>
        Subject: Re: [Lubuntu-qa] ISO Testing Cadence Week
        To: "Nicholas Skaggs" <nicholas.skaggs@xxxxxxxxxxxxx
        <mailto:nicholas.skaggs@xxxxxxxxxxxxx>>
        Cc: lubuntu-qa@xxxxxxxxxxxxxxxxxxx
        <mailto:lubuntu-qa@xxxxxxxxxxxxxxxxxxx>
        Date: Tuesday, August 7, 2012, 8:16 PM


        Hi Nicholas,

        in the past, the question has been raised about testers dong
        tests, only for them to be deleted the next day as a respin
        comes up. Are tests / bugs now being carried over?

        what is the difference between cadence and the qa-testing
        milestones?

        I will ensure our wiki area is updated with your reply.

        Regards,

        Phill.

        On 7 August 2012 21:36, Nicholas Skaggs
        <nicholas.skaggs@xxxxxxxxxxxxx
        <http://mc/compose?to=nicholas.skaggs@xxxxxxxxxxxxx>> wrote:

            Cheers everyone. This week is a cadence week for iso
            testing. What that means for us is to test all of our
            ubuntu isos mandatory testcases at least once over the
            course of the week. A big thank you to those who are
            already leading the way on this with testing:

            gregfaith, michael-kroll, fabiomarconi, and doak-jackson

            These 4 have already reported results to the isotracker.
            Thanks! You may have noticed that the i386 ubuntu images
            had issues building, but by the time you read this those
            should be resolved. If you need help, check out the
            walkthrough page on the wiki and/or email the list. We're
            happy to help anyone through there first tests case.

            https://wiki.ubuntu.com/Testing/ISO/Walkthrough

            Happy Testing everyone!

            Nicholas

            --
            Ubuntu-qa mailing list
            Ubuntu-qa@xxxxxxxxxxxxxxxx
            <http://mc/compose?to=Ubuntu-qa@xxxxxxxxxxxxxxxx>
            Modify settings or unsubscribe at:
            https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa

-- https://wiki.ubuntu.com/phillw

        -----Inline Attachment Follows-----

-- Mailing list: https://launchpad.net/~lubuntu-qa
        <https://launchpad.net/%7Elubuntu-qa>
        Post to     : lubuntu-qa@xxxxxxxxxxxxxxxxxxx
        <http://mc/compose?to=lubuntu-qa@xxxxxxxxxxxxxxxxxxx>
        Unsubscribe : https://launchpad.net/~lubuntu-qa
        <https://launchpad.net/%7Elubuntu-qa>
        More help   : https://help.launchpad.net/ListHelp




--
https://wiki.ubuntu.com/phillw





Follow ups

References