yahoo-eng-team team mailing list archive

[Sam Morrison <1501556@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

In our nova-compute logs we get a ton of these messages over and over

2015-10-01 11:01:54.781 30811 WARNING nova.compute.manager [req-
f61f4f85-72e7-481b-a8a3-90551bdc4b58 - - - - -] [instance: 75f733b5
-842e-4bde-9570-efa2735e6f12] Instance build timed out. Set to error
state.

Upon looking in the DB they are all deleted

select deleted_at, deleted, vm_state, task_state from instances where uuid = '75f733b5-842e-4bde-9570-efa2735e6f12';
+---------------------+---------+----------+------------+
| deleted_at          | deleted | vm_state | task_state |
+---------------------+---------+----------+------------+
| 2015-08-17 00:47:18 |   12283 | building | deleting   |
+---------------------+---------+----------+------------+

We have instance_build_timeout = 3600

I think _check_instance_build_time in compute.manager needs to filter on
deleted instances but there may be a reason it checks deleted instances
too.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1501556

Title:
  periodic task for erroring build timeouts tries to set error state on
  deleted instances

Status in OpenStack Compute (nova):
  New

Bug description:
  In our nova-compute logs we get a ton of these messages over and over

  2015-10-01 11:01:54.781 30811 WARNING nova.compute.manager [req-
  f61f4f85-72e7-481b-a8a3-90551bdc4b58 - - - - -] [instance: 75f733b5
  -842e-4bde-9570-efa2735e6f12] Instance build timed out. Set to error
  state.

  Upon looking in the DB they are all deleted

  select deleted_at, deleted, vm_state, task_state from instances where uuid = '75f733b5-842e-4bde-9570-efa2735e6f12';
  +---------------------+---------+----------+------------+
  | deleted_at          | deleted | vm_state | task_state |
  +---------------------+---------+----------+------------+
  | 2015-08-17 00:47:18 |   12283 | building | deleting   |
  +---------------------+---------+----------+------------+

  We have instance_build_timeout = 3600

  I think _check_instance_build_time in compute.manager needs to filter
  on deleted instances but there may be a reason it checks deleted
  instances too.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1501556/+subscriptions