yahoo-eng-team team mailing list archive

[Tomasz Głuch <1502191@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

During an instance deletion entries in related tables are not marked as 'deleted'. It causes silent integrity error invisible in nova-* logs, however it brokes db cleaning mechanism used by 'nova-manage db archive_deleted_rows' which relies on deleted flag only.
It may cause slow down of entire system, because data are not moved to shadow_* tables, so main tables are growing more and more.

I observed this issue for:
instance_actions
instance_actions_events
instance_system_metadata
reservations
block_device_mapping
instance_faults

Steps to reproduce:
1) create instance, attach volume
2) delete instance
3) there are entries in tables above, not marked as deleted
4) delete from instances where uuid='UUID' will throw error:
mysql [nova]>delete from instance_actions where instance_uuid='516300c9-f32f-44bc-acff-20d9959964fc';
ERROR 1451 (23000): Cannot delete or update a parent row: a foreign key constraint fails (`nova`.`instance_actions_events`, CONSTRAINT `instance_actions_events_ibfk_1` FOREIGN KEY (`action_id`) REFERENCES `instance_actions` (`id`))
4a) the same error returns "nova-manage db archive_deleted_rows 1000" if it starts cleaning "instance_actions" table

This bug affects Kilo and Icehouse releases.

** Affects: nova
     Importance: Undecided
         Status: New

** Project changed: glance => nova

** Description changed:

  During an instance deletion entries in related tables are not marked as 'deleted'. It causes silent integrity error invisible in nova-* logs, however it brokes db cleaning mechanism used by 'nova-manage db archive_deleted_rows' which relies on deleted flag only.
  It may cause slow down of entire system, because data are not moved to shadow_* tables, so main tables are growing more and more.
  
- I observed this issue for: 
+ I observed this issue for:
  instance_actions
  instance_actions_events
  instance_system_metadata
  reservations
  block_device_mapping
  instance_faults
  
  Steps to reproduce:
  1) create instance, attach volume
  2) delete instance
  3) there are entries in tables above, not marked as deleted
  4) delete from instances where uuid='UUID' will throw error:
  mysql [nova]>delete from instance_actions where instance_uuid='516300c9-f32f-44bc-acff-20d9959964fc';
  ERROR 1451 (23000): Cannot delete or update a parent row: a foreign key constraint fails (`nova`.`instance_actions_events`, CONSTRAINT `instance_actions_events_ibfk_1` FOREIGN KEY (`action_id`) REFERENCES `instance_actions` (`id`))
  4a) the same error returns "nova-manage db archive_deleted_rows 1000" if it starts cleaning "instance_actions" table
+ 
+ This bug affects Kilo and Icehouse releases.

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1502191

Title:
  Instance-related db entries are not marked deleted on instance
  deletion

Status in OpenStack Compute (nova):
  New

Bug description:
  During an instance deletion entries in related tables are not marked as 'deleted'. It causes silent integrity error invisible in nova-* logs, however it brokes db cleaning mechanism used by 'nova-manage db archive_deleted_rows' which relies on deleted flag only.
  It may cause slow down of entire system, because data are not moved to shadow_* tables, so main tables are growing more and more.

  I observed this issue for:
  instance_actions
  instance_actions_events
  instance_system_metadata
  reservations
  block_device_mapping
  instance_faults

  Steps to reproduce:
  1) create instance, attach volume
  2) delete instance
  3) there are entries in tables above, not marked as deleted
  4) delete from instances where uuid='UUID' will throw error:
  mysql [nova]>delete from instance_actions where instance_uuid='516300c9-f32f-44bc-acff-20d9959964fc';
  ERROR 1451 (23000): Cannot delete or update a parent row: a foreign key constraint fails (`nova`.`instance_actions_events`, CONSTRAINT `instance_actions_events_ibfk_1` FOREIGN KEY (`action_id`) REFERENCES `instance_actions` (`id`))
  4a) the same error returns "nova-manage db archive_deleted_rows 1000" if it starts cleaning "instance_actions" table

  This bug affects Kilo and Icehouse releases.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1502191/+subscriptions