yahoo-eng-team team mailing list archive

[Daniel Berrange <1350287@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

When runing the test suite with a random hash seed, eg

PYTHONHASHSEED=666  ./run_tests.sh

many tests will fail as iterators over hash keys/values change their
ordering. For example there are many failures in libvirt like

======================================================================
FAIL: nova.tests.virt.libvirt.test_driver.LibvirtConnTestCase.test_xml_and_uri_rescue_no_ramdisk
----------------------------------------------------------------------
Traceback (most recent call last):
_StringException: Empty attachments:
  stderr
  stdout

pythonlogging:'': {{{
INFO [nova.network.driver] Loading network driver 'nova.network.linux_net'
WARNING [nova.virt.libvirt.firewall] Libvirt module could not be loaded. NWFilterFirewall will not work correctly.
INFO [nova.network.driver] Loading network driver 'nova.network.linux_net'
WARNING [nova.virt.libvirt.driver] Cannot update service status on host: fake-mini,since it is not registered.
}}}

Traceback (most recent call last):
  File "/home/berrange/src/cloud/nova/nova/tests/virt/libvirt/test_driver.py", line 2580, in test_xml_and_uri_rescue_no_ramdisk
    expect_ramdisk=False, rescue=instance_data)
  File "/home/berrange/src/cloud/nova/nova/tests/virt/libvirt/test_driver.py", line 4028, in _check_xml_and_uri
    (check(tree), expected_result, i))
  File "/home/berrange/src/cloud/nova/.venv/lib/python2.7/site-packages/testtools/testcase.py", line 321, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/home/berrange/src/cloud/nova/.venv/lib/python2.7/site-packages/testtools/testcase.py", line 406, in assertThat
    raise mismatch_error
MismatchError: '8388608' != '2097152': 8388608 != 2097152 failed common check 1


As well as failures across many other tests suites.

This bug is to track resolution of all problems in Nova seen when
setting PYTHONHASHSEED to a non-zero value.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1350287

Title:
  Many tests fail when run with random hash seed value

Status in OpenStack Compute (Nova):
  New

Bug description:
  When runing the test suite with a random hash seed, eg

  PYTHONHASHSEED=666  ./run_tests.sh

  many tests will fail as iterators over hash keys/values change their
  ordering. For example there are many failures in libvirt like

  ======================================================================
  FAIL: nova.tests.virt.libvirt.test_driver.LibvirtConnTestCase.test_xml_and_uri_rescue_no_ramdisk
  ----------------------------------------------------------------------
  Traceback (most recent call last):
  _StringException: Empty attachments:
    stderr
    stdout

  pythonlogging:'': {{{
  INFO [nova.network.driver] Loading network driver 'nova.network.linux_net'
  WARNING [nova.virt.libvirt.firewall] Libvirt module could not be loaded. NWFilterFirewall will not work correctly.
  INFO [nova.network.driver] Loading network driver 'nova.network.linux_net'
  WARNING [nova.virt.libvirt.driver] Cannot update service status on host: fake-mini,since it is not registered.
  }}}

  Traceback (most recent call last):
    File "/home/berrange/src/cloud/nova/nova/tests/virt/libvirt/test_driver.py", line 2580, in test_xml_and_uri_rescue_no_ramdisk
      expect_ramdisk=False, rescue=instance_data)
    File "/home/berrange/src/cloud/nova/nova/tests/virt/libvirt/test_driver.py", line 4028, in _check_xml_and_uri
      (check(tree), expected_result, i))
    File "/home/berrange/src/cloud/nova/.venv/lib/python2.7/site-packages/testtools/testcase.py", line 321, in assertEqual
      self.assertThat(observed, matcher, message)
    File "/home/berrange/src/cloud/nova/.venv/lib/python2.7/site-packages/testtools/testcase.py", line 406, in assertThat
      raise mismatch_error
  MismatchError: '8388608' != '2097152': 8388608 != 2097152 failed common check 1

  
  As well as failures across many other tests suites.

  This bug is to track resolution of all problems in Nova seen when
  setting PYTHONHASHSEED to a non-zero value.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1350287/+subscriptions