checkbox-dev team mailing list archive

[Jeffrey Lane <jeffrey.lane@xxxxxxxxxxxxx>]

On Fri, Feb 20, 2015 at 3:22 AM, Ara Pulido <ara.pulido@xxxxxxxxxxxxx> wrote:
>
>
> On 19/02/15 21:24, Jeffrey Lane wrote:
>> I was reading the other bits of this and while I don't quite
>> understand it ( wouldn't it be great if "cough cough" I could be at
>> one of your sprints to sync with dev plans "cough cough" especially in
>> Taipei) ;-P
>>
>> Seriously, what I do at least somewhat grok so far is the changes to
>> remove whitelists and define those in Units.
>>
>> I looked over Sylvain's MP to do that for the client cert whitelist.
>> I took the liberty of going ahead and adding a story card to do
>> likewise for server, so I thought I'd ask if that is something we
>> should look at soon, or put off for a bit?
>
> Where did you add the story?

Hahha, sorry, on The server cert board.  I've just gotten used to
calling it "the board" and referring to it generically.  Not on
yours...

> Also, taking into account that this change won't break whitelists, maybe
> it would be better for your team to transform the whitelist into a
> testplan if interested? For the sake of learning :)

Thats one of the reasons, yes.  The other is that from looking at the
update emails from zyga and reading Sylvain's MR (before finally
reading in detail the CEP-8 file), I had a sense as to what it was
about and wanted to be sure we could take advantage of it...

> The idea of the change is that, in the reports (i.e. the HTML report)
> you will have a break down of what tests that are certification blockers
> fail, v.s. greylist.

Yes, after reading the proposal in detail, I'm glad my imagination
wasn't really running away with me.  I also think having this sort of
data in results would be great for outside testers too.  I constantly
have to re-assure testers in certain companies that "Yes, test Foo
that failed is OK, because it's not a blocker, you don't have to spend
a week debugging why it failed".

Cheers,

Jeff


>
> Cheers,
> Ara.
>
>>
>> Cheers
>> Jeff
>>
>> P.S. Really, the sidebar above was meant mostly as a joke, but I am
>> interested in keeping up with the dev roadmap and progress for
>> plainbox/checkbox since we are a direct consumer of / contributor to
>> that effort.
>>
>> On Thu, Feb 19, 2015 at 2:38 PM, Zygmunt Krynicki
>> <zygmunt.krynicki@xxxxxxxxxxxxx> wrote:
>>> Hey. It's time for another CEP-8 update:
>>>
>>> - All of the parser related work is now finished. There's one unmerged
>>> revision [1] but it was already past the initial review and I expect
>>> it to land
>>> - I've proposed a set of new APIs for working with data from test plan
>>> units. I've specifically changed it from what I had earlier so that
>>> working with multiple test plans is possible. This is the CDTS
>>> use-case but I think it's okay to do it in general. The code is fairly
>>> tested and readable [2] though I haven't tried using it for real
>>> - I've started rebasing my earlier bulk and unitary method on top of
>>> that, so that it is possible to work with multiple test plans.
>>> - We now have test plans for CDTS and Certification [3], [4] that have
>>> been reviewed by Ara and are both ready to land as soon as [2] lands.
>>>
>>> Next week I'll focus on gluing this to plainbox run so that we can
>>> verify the test report format and contents and I'll work towards
>>> making it possible to use in checkbox-gui. The one risk there is we
>>> need to remember (know) which test plans were pre-selected but this
>>> knowledge, AFAIK, so far only exists in checkbox-gui (ironically). It
>>> can be re-constructed in plainbox so I'm not worried at all, it's just
>>> a matter of getting that done.
>>>
>>> Thanks
>>> ZK
>>>
>>> [1] http://bazaar.launchpad.net/~zkrynicki/checkbox/cep-8/revision/3587
>>> [2] https://code.launchpad.net/~zkrynicki/checkbox/cep-8/+merge/250288
>>> [3] https://code.launchpad.net/~sylvain-pineau/checkbox/14.04-client-testplan/+merge/249272
>>> [4] https://code.launchpad.net/~sylvain-pineau/cdts/cdts_testplans/+merge/250293
>>>
>>> --
>>> Mailing list: https://launchpad.net/~checkbox-dev
>>> Post to     : checkbox-dev@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~checkbox-dev
>>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>>
>
> --
> Mailing list: https://launchpad.net/~checkbox-dev
> Post to     : checkbox-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~checkbox-dev
> More help   : https://help.launchpad.net/ListHelp



-- 
"Entropy isn't what it used to be."

Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior
Poet, Lover of Pie
Phone: 919-442-8649
Ubuntu Ham: W4KDH                          Freenode IRC: bladernr or bladernr_
gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417  C466 4ABD 3635 3A14 B2DD