fuel-dev team mailing list archive

[Tatyanka <tleontovich@xxxxxxxxxxxx>]

Hi All
Yuriy,
If you leave tests without deployment tag - they will be discovered all time 


Tanya
Отправлено с iPhone

> 2 дек. 2013, в 13:22, Yuriy Yekovenko <yyekovenko@xxxxxxxxxxxx> написал(а):
> 
> Mike,
> 
> At the moment sanity suite contains one basic verification for heat (it was implemented in release 3.2). So, I'm actually fine with keeping all more complicated heat tests on Platform group.
> The main question I'd want to clarify is: will heat tests be discovered by OSTF engine in platform_tests directory if the user deploys OpenStack without any additional components (e.g., Murano, Savanna)?
> For now I'm not able to check it by myself so decided to ask you.
> 
> Regarding " it must explicitly show that there is no required image and not to fail in random unknown state" - yes, of course. I've added this verification as the 1st step in the test-case.
> 
> 
> Best regards,
> Yuriy Yekovenko
> 
> 
>> On Mon, Dec 2, 2013 at 12:13 PM, Mike Scherbakov <mscherbakov@xxxxxxxxxxxx> wrote:
>> Yuriy,
>> I wish to keep Sanity checks as fast as possible, and smoke is Ok to run a bit longer, let's say around 5 min.
>> If we add any other tests which requires at least 5 min - I would consider this to move to Platform or even create another test run.
>> 
>> In this particular case I would move basic Heat checks to Sanity (or Smoke if takes more than 15-30 sec), and add another test to Platform, which takes 5 min. Also, if there is no image in Glance and test depends on it, it must explicitly show that there is no required image and not to fail in random unknown state.
>> 
>> Would this work for you?
>> 
>> Thanks,
>> 
>> 
>>> On Fri, Nov 29, 2013 at 3:02 PM, Yuriy Yekovenko <yyekovenko@xxxxxxxxxxxx> wrote:
>>> Hi All,
>>> 
>>> I'd want to raise a question about "location" of Heat OSTF tests in Fuel 4.0.
>>> 
>>> Heat tests were added to Fuel Health Check starting from 3.2 release. In that release Heat was just a dependency for Murano, so Heat tests were placed in "platform_tests" directory (but not in "smoke" one). Accordingly, Heat tests were displayed in Health Check tab only of Murano option was selected when OpenStack was deployed.
>>> 
>>> In Fuel 4.0 Heat is provided as independent component and is installed every time OpenStack is deployed. So, Heat OSTF tests should be present on Health Check tab always, not depending on Murano option.
>>> I suppose it will require to move Heat tests from "platform_tests" to "smoke" or some other directory (or maybe to change some other settings of tests visibility).
>>> 
>>> Also, I'd like to mention that additional Heat tests that I'm going to commit take more than 5 minutes to run and one of tests (test of autoscaling) requires Fedora image to be imported to Glance manually. If it's not desirable to make Smoke tests so long-running, we should decide where to put Heat tests and maybe to implement option for running/skipping these tests.
>>> 
>>> Please let me know what you think about it or if something is unclear in my message.
>>> 
>>> Best regards,
>>> Yuriy Yekovenko
>>> 
>>> --
>>> Mailing list: https://launchpad.net/~fuel-dev
>>> Post to     : fuel-dev@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~fuel-dev
>>> More help   : https://help.launchpad.net/ListHelp
>> 
>> 
>> 
>> -- 
>> Mike Scherbakov
>> #mihgen
>