yahoo-eng-team team mailing list archive

[Elena Ezhova <eezhova@xxxxxxxxxxxx>]

Public bug reported:

LBaaS API v2 tests don't add cleanup right after resources are created
they attempt to remove them at the end of the tests. In light of heavy
usage of class-level resources failure of any test leads to an
avalanche.

For example, breaking test_create_listener in test_listeners_non_admin,
which is the first one to be executed, makes all subsequent tests to
fail with assertion errors:

Traceback (most recent call last):
      File "neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 462, in test_update_listener_missing_name
        listener_ids=[self.listener_id])
      File "neutron_lbaas/tests/tempest/v2/api/base.py", line 299, in _check_status_tree
        load_balancer['listeners'])
      File "neutron_lbaas/tests/tempest/v2/api/base.py", line 317, in _check_status_tree_thing
        assert len(actual_thing_ids) == len(status_tree_things)
    AssertionError

It makes analyzing test failures more complicated.

** Affects: neutron
     Importance: Undecided
     Assignee: Elena Ezhova (eezhova)
         Status: New


** Tags: lbaas

** Changed in: neutron
     Assignee: (unassigned) => Elena Ezhova (eezhova)

** Tags added: lbaas

** Summary changed:

- [LBaaS v2] Improve resource cleanup in API tests
+ [LBaaS v2] Lacking resource cleanup in API tests

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1498447

Title:
  [LBaaS v2] Lacking resource cleanup in API tests

Status in neutron:
  New

Bug description:
  LBaaS API v2 tests don't add cleanup right after resources are created
  they attempt to remove them at the end of the tests. In light of heavy
  usage of class-level resources failure of any test leads to an
  avalanche.

  For example, breaking test_create_listener in
  test_listeners_non_admin, which is the first one to be executed, makes
  all subsequent tests to fail with assertion errors:

  Traceback (most recent call last):
        File "neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 462, in test_update_listener_missing_name
          listener_ids=[self.listener_id])
        File "neutron_lbaas/tests/tempest/v2/api/base.py", line 299, in _check_status_tree
          load_balancer['listeners'])
        File "neutron_lbaas/tests/tempest/v2/api/base.py", line 317, in _check_status_tree_thing
          assert len(actual_thing_ids) == len(status_tree_things)
      AssertionError

  It makes analyzing test failures more complicated.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1498447/+subscriptions