← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1664793] Re: test_stamp_pattern timing out waiting for attached device to show up in guest

 

Reviewed:  https://review.opendev.org/615434
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=ba18426fd990fad19f429e0aa1673f549f2c77e8
Submitter: Zuul
Branch:    master

commit ba18426fd990fad19f429e0aa1673f549f2c77e8
Author: Attila Fazekas <afazekas@xxxxxxxxxx>
Date:   Sun Nov 4 13:54:30 2018 +0100

    Unskip test_stamp_pattern
    
    test_stamp_pattern had issues before because the test attached volumes
    in VM state when it does not detects hotplug events.
    
    This change have the test to ssh the machine first,
    alternativly a pci rescan could be forced.
    
    Notes:
    https://docs.google.com/presentation/d/1Im-iYVzroKwXKP23p12Q5vsUGdk2V26SPpLWF3I5dbA/edit#slide=id.p
    
    Closes-bug: #1664793
    Change-Id: Iaff1e01dd7ffab238ec73668ae4eee0683f70ffd


** Changed in: tempest
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1664793

Title:
  test_stamp_pattern timing out waiting for attached device to show up
  in guest

Status in OpenStack Compute (nova):
  Confirmed
Status in tempest:
  Fix Released

Bug description:
  The Tempest scenario test TestStampPattern was unskipped on 2/13:

  https://review.openstack.org/#/c/431800/

  Since then the ceph jobs have been failing, e.g.:

  http://logs.openstack.org/25/433825/1/check/gate-tempest-dsvm-full-
  devstack-plugin-ceph-ubuntu-
  trusty/4a58a2e/console.html#_2017-02-14_23_40_42_737153

  2017-02-14 23:40:42.736898 | tempest.scenario.test_stamp_pattern.TestStampPattern.test_stamp_pattern[compute,id-10fd234a-515c-41e5-b092-8323060598c5,image,network,volume]
  2017-02-14 23:40:42.736948 | ---------------------------------------------------------------------------------------------------------------------------------------------
  2017-02-14 23:40:42.736959 | 
  2017-02-14 23:40:42.736975 | Captured traceback:
  2017-02-14 23:40:42.736992 | ~~~~~~~~~~~~~~~~~~~
  2017-02-14 23:40:42.737013 |     Traceback (most recent call last):
  2017-02-14 23:40:42.737037 |       File "tempest/test.py", line 103, in wrapper
  2017-02-14 23:40:42.737061 |         return f(self, *func_args, **func_kwargs)
  2017-02-14 23:40:42.737094 |       File "tempest/scenario/test_stamp_pattern.py", line 112, in test_stamp_pattern
  2017-02-14 23:40:42.737115 |         keypair['private_key'])
  2017-02-14 23:40:42.737153 |       File "tempest/scenario/test_stamp_pattern.py", line 89, in _wait_for_volume_available_on_the_system
  2017-02-14 23:40:42.737176 |         raise lib_exc.TimeoutException
  2017-02-14 23:40:42.737203 |     tempest.lib.exceptions.TimeoutException: Request timed out
  2017-02-14 23:40:42.737218 |     Details: None

  
  They fail while waiting for the attached volume to show up on the guest, and it never does.

  http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22_wait_for_volume_available_on_the_system%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20build_name%3A*ceph*&from=7d

  There are only 11 hits in the ceph jobs in the last 24 hours but
  that's still pretty high. The ceph xenial job which runs on newton,
  ocata and master is non-voting so people probably aren't noticing, but
  the ceph trusty job runs on stable/mitaka and is voting and is
  failing.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1664793/+subscriptions


References