yahoo-eng-team team mailing list archive

[Boris Bobrov <bbobrov@xxxxxxxxxxxx>]

Public bug reported:

Some db migration tests succeed, while the same migrations, applied by
db_sync fail. A good example of this is bug #1405673: migration 44 seems
to be tested, but failes when applied in real life.

To illustrate the issue, http://paste.openstack.org/show/155081/ can be
applied. The tests will be very slow, but reliable (because the db will
be in file, not in memory) and will fail. Here's the output:

(.venv)breton@bbobrov-pc ~/src/keystone (bug/1405673*) $ ./run_tests.sh SqlUpgradeTests
tools/with_venv.sh
keystone.tests.test_sql_upgrade.SqlUpgradeTests
    test_blank_db_to_start                                            OK  0.50
    test_downgrade_endpoint_enabled_cols                              FAIL
    test_downgrade_service_enabled_cols                               OK  20.78
    test_add_actor_id_index                                           OK  25.44
    test_endpoint_region_downgrade_columns                            OK  27.31
    test_downgrade_endpoint_enabled_data                              FAIL
    test_id_mapping                                                   OK  21.70
    test_assignment_table_migration                                   OK  25.05
    test_limited_trusts_upgrade                                       OK  18.93
    test_downgrade_service_enabled_data                               OK  24.67
    test_downgrade_to_db_init_version                                 FAIL
    test_project_parent_id_downgrade                                  OK  39.04
    test_endpoint_region_migration                                    OK  46.27
    test_endpoint_region_upgrade_columns                              OK  36.07
    test_region_url_downgrade                                         OK  36.40
    test_limited_trusts_downgrade                                     OK  31.71
    test_limited_trusts_downgrade_trusts_cleanup                      OK  33.84
    test_region_url_upgrade                                           OK  38.80
    test_project_parent_id_upgrade                                    OK  49.62
    test_project_parent_id_cleanup                                    OK  52.02
    test_two_steps_forward_one_step_back                              FAIL
    test_region_migration                                             OK  34.42
    test_remove_actor_id_index                                        OK  48.16
    test_start_version_db_init_version                                OK  0.95
    test_upgrade_endpoint_enabled_cols                                OK  29.47
    test_region_url_cleanup                                           OK  42.90
    test_token_user_id_and_trust_id_index_downgrade                   OK  96.98
    test_upgrade_endpoint_enabled_data                                OK  101.70
    test_token_user_id_and_trust_id_index_upgrade                     OK  125.88
    test_upgrade_region_unique_description                            FAIL
    test_upgrade_region_non_unique_description                        OK  91.90
    test_upgrade_add_initial_tables                                   OK  65.13
    test_upgrade_service_enabled_data                                 OK  97.24
    test_upgrade_service_enabled_cols                                 OK  80.83
[...]
Ran 34 tests in 557.405s

FAILED (failures=5)

** Affects: keystone
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1406314

Title:
  db migration tests falsely succeed

Status in OpenStack Identity (Keystone):
  New

Bug description:
  Some db migration tests succeed, while the same migrations, applied by
  db_sync fail. A good example of this is bug #1405673: migration 44
  seems to be tested, but failes when applied in real life.

  To illustrate the issue, http://paste.openstack.org/show/155081/ can
  be applied. The tests will be very slow, but reliable (because the db
  will be in file, not in memory) and will fail. Here's the output:

  (.venv)breton@bbobrov-pc ~/src/keystone (bug/1405673*) $ ./run_tests.sh SqlUpgradeTests
  tools/with_venv.sh
  keystone.tests.test_sql_upgrade.SqlUpgradeTests
      test_blank_db_to_start                                            OK  0.50
      test_downgrade_endpoint_enabled_cols                              FAIL
      test_downgrade_service_enabled_cols                               OK  20.78
      test_add_actor_id_index                                           OK  25.44
      test_endpoint_region_downgrade_columns                            OK  27.31
      test_downgrade_endpoint_enabled_data                              FAIL
      test_id_mapping                                                   OK  21.70
      test_assignment_table_migration                                   OK  25.05
      test_limited_trusts_upgrade                                       OK  18.93
      test_downgrade_service_enabled_data                               OK  24.67
      test_downgrade_to_db_init_version                                 FAIL
      test_project_parent_id_downgrade                                  OK  39.04
      test_endpoint_region_migration                                    OK  46.27
      test_endpoint_region_upgrade_columns                              OK  36.07
      test_region_url_downgrade                                         OK  36.40
      test_limited_trusts_downgrade                                     OK  31.71
      test_limited_trusts_downgrade_trusts_cleanup                      OK  33.84
      test_region_url_upgrade                                           OK  38.80
      test_project_parent_id_upgrade                                    OK  49.62
      test_project_parent_id_cleanup                                    OK  52.02
      test_two_steps_forward_one_step_back                              FAIL
      test_region_migration                                             OK  34.42
      test_remove_actor_id_index                                        OK  48.16
      test_start_version_db_init_version                                OK  0.95
      test_upgrade_endpoint_enabled_cols                                OK  29.47
      test_region_url_cleanup                                           OK  42.90
      test_token_user_id_and_trust_id_index_downgrade                   OK  96.98
      test_upgrade_endpoint_enabled_data                                OK  101.70
      test_token_user_id_and_trust_id_index_upgrade                     OK  125.88
      test_upgrade_region_unique_description                            FAIL
      test_upgrade_region_non_unique_description                        OK  91.90
      test_upgrade_add_initial_tables                                   OK  65.13
      test_upgrade_service_enabled_data                                 OK  97.24
      test_upgrade_service_enabled_cols                                 OK  80.83
  [...]
  Ran 34 tests in 557.405s

  FAILED (failures=5)

To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1406314/+subscriptions