fuel-dev team mailing list archive

[Yuriy Yekovenko <yyekovenko@xxxxxxxxxxxx>]

Mike,

At the moment sanity suite contains one basic verification for heat (it was
implemented in release 3.2). So, I'm actually fine with keeping all more
complicated heat tests on Platform group.
The main question I'd want to clarify is: will heat tests be discovered by
OSTF engine in platform_tests directory if the user deploys OpenStack
without any additional components (e.g., Murano, Savanna)?
For now I'm not able to check it by myself so decided to ask you.

Regarding " it must explicitly show that there is no required image and not
to fail in random unknown state" - yes, of course. I've added this
verification as the 1st step in the test-case.


Best regards,
Yuriy Yekovenko


On Mon, Dec 2, 2013 at 12:13 PM, Mike Scherbakov
<mscherbakov@xxxxxxxxxxxx>wrote:

> Yuriy,
> I wish to keep Sanity checks as fast as possible, and smoke is Ok to run a
> bit longer, let's say around 5 min.
> If we add any other tests which requires at least 5 min - I would consider
> this to move to Platform or even create another test run.
>
> In this particular case I would move basic Heat checks to Sanity (or Smoke
> if takes more than 15-30 sec), and add another test to Platform, which
> takes 5 min. Also, if there is no image in Glance and test depends on it,
> it must explicitly show that there is no required image and not to fail in
> random unknown state.
>
> Would this work for you?
>
> Thanks,
>
>
> On Fri, Nov 29, 2013 at 3:02 PM, Yuriy Yekovenko <yyekovenko@xxxxxxxxxxxx>wrote:
>
>> Hi All,
>>
>> I'd want to raise a question about "location" of Heat OSTF tests in Fuel
>> 4.0.
>>
>> Heat tests were added to Fuel Health Check starting from 3.2 release. In
>> that release Heat was just a dependency for Murano, so Heat tests were
>> placed in "platform_tests" directory (but not in "smoke" one). Accordingly,
>> Heat tests were displayed in Health Check tab only of Murano option was
>> selected when OpenStack was deployed.
>>
>> In Fuel 4.0 Heat is provided as independent component and is installed
>> every time OpenStack is deployed. So, Heat OSTF tests should be present on
>> Health Check tab always, not depending on Murano option.
>> I suppose it will require to move Heat tests from "platform_tests" to
>> "smoke" or some other directory (or maybe to change some other settings of
>> tests visibility).
>>
>> Also, I'd like to mention that additional Heat tests that I'm going to
>> commit take more than 5 minutes to run and one of tests (test of
>> autoscaling) requires Fedora image to be imported to Glance manually. If
>> it's not desirable to make Smoke tests so long-running, we should decide
>> where to put Heat tests and maybe to implement option for running/skipping
>> these tests.
>>
>> Please let me know what you think about it or if something is unclear in
>> my message.
>>
>> Best regards,
>> Yuriy Yekovenko
>>
>> --
>> Mailing list: https://launchpad.net/~fuel-dev
>> Post to     : fuel-dev@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~fuel-dev
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Mike Scherbakov
> #mihgen
>