yahoo-eng-team team mailing list archive

[Bob Ball <1535616@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

http://dd6b71949550285df7dc-
dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/22/267822/1/2904/index.html
failed with a race condition getting the guest console logs:

VM started:
Jan 14 22:03:58 localhost xapi: [debug|localhost.localdomain|1158 INET 0.0.0.0:80|VM.start_on R:98346b008094|audit] VM.start_on: VM = '9bbcbe52-ca94-37df-2791-e49d8dfae4c7 (instance-00000042)'; host 'd77c538b-afe9-4e0c-b5f1-223fed0f9728 (localhost.localdomain)'

Cron job kicks in, identifies that domain 88 isn't "valid" and deletes the log file
Jan 14 22:04:01 localhost rotate_xen_guest_logs: Valid dom IDs: 81 87 2 85 86 83 0 82
Jan 14 22:04:01 localhost rotate_xen_guest_logs: Deleting: /var/log/xen/guest/console.88

VM start completed (XAPI returns):
Jan 14 22:04:03 localhost xapi: [debug|localhost.localdomain|1158 INET 0.0.0.0:80|VM.start_on R:98346b008094|xapi] Message.create VM_STARTED 5 VM 9bbcbe52-ca94-37df-2791-e49d8dfae4c7

Attempt to preserve the log file for domain 88 made:
Jan 14 22:05:01 localhost xapi: [ info|localhost.localdomain|55940 UNIX /var/xapi/xapi||cli] xe vm-param-set uuid=9bbcbe52-ca94-37df-2791-e49d8dfae4c7 other-config:last_dom_id=88 username=root password=(omitted)

The console log exists _before_ XAPI has completed starting the domain,
so we can't preserve the log file using the last_dom_id flag.

** Affects: nova
     Importance: Medium
         Status: Confirmed

** Changed in: nova
   Importance: Undecided => Medium

** Changed in: nova
       Status: New => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1535616

Title:
  XenAPI: Console logging race condition

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  http://dd6b71949550285df7dc-
  dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/22/267822/1/2904/index.html
  failed with a race condition getting the guest console logs:

  VM started:
  Jan 14 22:03:58 localhost xapi: [debug|localhost.localdomain|1158 INET 0.0.0.0:80|VM.start_on R:98346b008094|audit] VM.start_on: VM = '9bbcbe52-ca94-37df-2791-e49d8dfae4c7 (instance-00000042)'; host 'd77c538b-afe9-4e0c-b5f1-223fed0f9728 (localhost.localdomain)'

  Cron job kicks in, identifies that domain 88 isn't "valid" and deletes the log file
  Jan 14 22:04:01 localhost rotate_xen_guest_logs: Valid dom IDs: 81 87 2 85 86 83 0 82
  Jan 14 22:04:01 localhost rotate_xen_guest_logs: Deleting: /var/log/xen/guest/console.88

  VM start completed (XAPI returns):
  Jan 14 22:04:03 localhost xapi: [debug|localhost.localdomain|1158 INET 0.0.0.0:80|VM.start_on R:98346b008094|xapi] Message.create VM_STARTED 5 VM 9bbcbe52-ca94-37df-2791-e49d8dfae4c7

  Attempt to preserve the log file for domain 88 made:
  Jan 14 22:05:01 localhost xapi: [ info|localhost.localdomain|55940 UNIX /var/xapi/xapi||cli] xe vm-param-set uuid=9bbcbe52-ca94-37df-2791-e49d8dfae4c7 other-config:last_dom_id=88 username=root password=(omitted)

  The console log exists _before_ XAPI has completed starting the
  domain, so we can't preserve the log file using the last_dom_id flag.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1535616/+subscriptions