yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2121125] [NEW] non-deterministic test

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Thomas Goirand <2121125@xxxxxxxxxxxxxxxxxx>
Date: Thu, 21 Aug 2025 07:55:12 -0000
Reply-to: Bug 2121125 <2121125@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

Hi,

Rebuilding Nova under Debian Sid, I get this unit test having flacky
results:

nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at

It failed on my once with this output (see below), and then a 2nd
rebuild made it pass. I'm therefore blacklisting this unit test in my
Debian package to avoid failures.

Cheers,

Thomas

FAIL: nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at
nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at
----------------------------------------------------------------------
testtools.testresult.real._StringException: pythonlogging:'': {{{
2025-08-21 07:46:57,202 WARNING [oslo_policy.policy] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
2025-08-21 07:46:57,202 WARNING [oslo_policy.policy] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
2025-08-21 07:46:57,203 WARNING [oslo_policy.policy] Policy Rules ['os_compute_api:extensions', 'os_compute_api:os-floating-ip-pools', 'os_compute_api:os-quota-sets:defaults', 'os_compute_api:os-availability-zone:list', 'os_compute_api:limits', 'project_member_api', 'project_reader_api', 'project_member_or_admin', 'project_reader_or_admin', 'os_compute_api:limits:other_project', 'os_compute_api:os-lock-server:unlock:unlock_override',
 'os_compute_api:servers:create:zero_disk_flavor', 'compute:servers:resize:cross_cell', 'os_compute_api:os-shelve:unshelve_to_host'] specified in policy files are the same as the defaults provided by the service. You can remove these rules from policy files which will make maintenance easier. You can detect these redundant rules by ``oslopolicy-list-redundant`` tool also.
2025-08-21 07:46:57,207 INFO [nova.virt.driver] Loading compute driver 'fake.SmallFakeDriver'
2025-08-21 07:46:57,207 INFO [nova.compute.provider_config] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
2025-08-21 07:46:57,209 INFO [nova.compute.provider_config] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
2025-08-21 07:46:57,210 WARNING [nova.compute.manager] Found orphan compute node 2 hypervisor host is fake_phyp1, nodes are {'fakenode1', 'fakenode2'}. We are not deleting this as the driver says this node has not been deleted.
2025-08-21 07:46:57,213 WARNING [nova.compute.resource_tracker] No compute node record for fake-mini:4eb71eba-9838-469c-8c50-388d20871d22
2025-08-21 07:46:57,215 INFO [nova.compute.resource_tracker] Compute node record created for fake-mini:fakenode1 with uuid: 4eb71eba-9838-469c-8c50-388d20871d22
2025-08-21 07:46:57,232 WARNING [nova.compute.resource_tracker] No compute node record for fake-mini:6579dfd8-2ca4-4bc7-9e41-9a76db4b2839
2025-08-21 07:46:57,233 INFO [nova.compute.resource_tracker] Compute node record created for fake-mini:fakenode2 with uuid: 6579dfd8-2ca4-4bc7-9e41-9a76db4b2839
}}}

Traceback (most recent call last):
  File "/build/reproducible-path/nova-31.0.0/nova/tests/unit/compute/test_compute.py", line 8466, in test_add_remove_fixed_ip_updates_instance_updated_at
    self.assertEqual(len(updated_ats), len(set(updated_ats)))
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 419, in assertEqual
    self.assertThat(observed, matcher, message)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 509, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: 3 != 2

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2121125

Title:
  non-deterministic test

Status in OpenStack Compute (nova):
  New

Bug description:
  Hi,

  Rebuilding Nova under Debian Sid, I get this unit test having flacky
  results:

  nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at

  It failed on my once with this output (see below), and then a 2nd
  rebuild made it pass. I'm therefore blacklisting this unit test in my
  Debian package to avoid failures.

  Cheers,

  Thomas

  FAIL: nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at
  nova.tests.unit.compute.test_compute.ComputeTestCase.test_add_remove_fixed_ip_updates_instance_updated_at
  ----------------------------------------------------------------------
  testtools.testresult.real._StringException: pythonlogging:'': {{{
  2025-08-21 07:46:57,202 WARNING [oslo_policy.policy] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
  2025-08-21 07:46:57,202 WARNING [oslo_policy.policy] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
  2025-08-21 07:46:57,203 WARNING [oslo_policy.policy] Policy Rules ['os_compute_api:extensions', 'os_compute_api:os-floating-ip-pools', 'os_compute_api:os-quota-sets:defaults', 'os_compute_api:os-availability-zone:list', 'os_compute_api:limits', 'project_member_api', 'project_reader_api', 'project_member_or_admin', 'project_reader_or_admin', 'os_compute_api:limits:other_project', 'os_compute_api:os-lock-server:unlock:unlock_override',
   'os_compute_api:servers:create:zero_disk_flavor', 'compute:servers:resize:cross_cell', 'os_compute_api:os-shelve:unshelve_to_host'] specified in policy files are the same as the defaults provided by the service. You can remove these rules from policy files which will make maintenance easier. You can detect these redundant rules by ``oslopolicy-list-redundant`` tool also.
  2025-08-21 07:46:57,207 INFO [nova.virt.driver] Loading compute driver 'fake.SmallFakeDriver'
  2025-08-21 07:46:57,207 INFO [nova.compute.provider_config] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
  2025-08-21 07:46:57,209 INFO [nova.compute.provider_config] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
  2025-08-21 07:46:57,210 WARNING [nova.compute.manager] Found orphan compute node 2 hypervisor host is fake_phyp1, nodes are {'fakenode1', 'fakenode2'}. We are not deleting this as the driver says this node has not been deleted.
  2025-08-21 07:46:57,213 WARNING [nova.compute.resource_tracker] No compute node record for fake-mini:4eb71eba-9838-469c-8c50-388d20871d22
  2025-08-21 07:46:57,215 INFO [nova.compute.resource_tracker] Compute node record created for fake-mini:fakenode1 with uuid: 4eb71eba-9838-469c-8c50-388d20871d22
  2025-08-21 07:46:57,232 WARNING [nova.compute.resource_tracker] No compute node record for fake-mini:6579dfd8-2ca4-4bc7-9e41-9a76db4b2839
  2025-08-21 07:46:57,233 INFO [nova.compute.resource_tracker] Compute node record created for fake-mini:fakenode2 with uuid: 6579dfd8-2ca4-4bc7-9e41-9a76db4b2839
  }}}

  Traceback (most recent call last):
    File "/build/reproducible-path/nova-31.0.0/nova/tests/unit/compute/test_compute.py", line 8466, in test_add_remove_fixed_ip_updates_instance_updated_at
      self.assertEqual(len(updated_ats), len(set(updated_ats)))
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 419, in assertEqual
      self.assertThat(observed, matcher, message)
      ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 509, in assertThat
      raise mismatch_error
  testtools.matchers._impl.MismatchError: 3 != 2

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/2121125/+subscriptions