yahoo-eng-team team mailing list archive

[yatin <2101166@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Fails as:-
2025-02-26 03:50:28.030 | + /opt/stack/new/grenade/functions:ping_check_public:65 :   timeout 60 sh -c 'while ! ping -c1 -w1 172.24.5.242; do sleep 1; done'
2025-02-26 03:50:29.034 | PING 172.24.5.242 (172.24.5.242) 56(84) bytes of data.
2025-02-26 03:50:29.034 | 
2025-02-26 03:50:29.034 | --- 172.24.5.242 ping statistics ---
2025-02-26 03:50:29.034 | 1 packets transmitted, 0 received, 100% packet loss, time 0ms
...
2025-02-26 03:51:27.130 | 1 packets transmitted, 0 received, 100% packet loss, time 0ms
2025-02-26 03:51:27.130 | 
2025-02-26 03:51:28.033 | + /opt/stack/new/grenade/functions:ping_check_public:66 :
...
2025-02-26 03:51:35.347 | + /opt/stack/new/grenade/functions:ping_check_public:71 :   die 71 '[Fail] Couldn'\''t ping server'
2025-02-26 03:51:35.349 | + /opt/stack/new/devstack/functions-common:die:285 :   local exitcode=0
2025-02-26 03:51:35.351 | [Call Trace]
2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:225:verify
2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:161:verify_noapi
2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:196:ping_check_public
2025-02-26 03:51:35.351 | /opt/stack/new/grenade/functions:71:die
2025-02-26 03:51:35.355 | [ERROR] /opt/stack/new/grenade/functions:71 [Fail] Couldn't ping server
2025-02-26 03:51:36.357 | 1 die /opt/stack/new/devstack/functions-common
2025-02-26 03:51:36.357 | 71 ping_check_public /opt/stack/new/grenade/functions
2025-02-26 03:51:36.357 | 196 verify_noapi /opt/stack/new/grenade/projects/60_nova/resources.sh
2025-02-26 03:51:36.357 | 161 verify /opt/stack/new/grenade/projects/60_nova/resources.sh
2025-02-26 03:51:36.357 | 225 main /opt/stack/new/grenade/projects/60_nova/resources.sh
2025-02-26 03:51:36.357 | Exit code: 1
2025-02-26 03:51:39.583 | + inc/plugin:resources:123                 :   die 123 'Failed to run /opt/stack/new/grenade/projects/60_nova/resources.sh verify post-upgrade'
2025-02-26 03:51:39.585 | + /opt/stack/new/devstack/functions-common:die:285 :   local exitcode=1
2025-02-26 03:51:39.588 | [Call Trace]
2025-02-26 03:51:39.588 | ./grenade.sh:361:resources
2025-02-26 03:51:39.588 | /opt/stack/new/grenade/inc/plugin:123:die
2025-02-26 03:51:39.592 | [ERROR] /opt/stack/new/grenade/inc/plugin:123 Failed to run /opt/stack/new/grenade/projects/60_nova/resources.sh verify post-upgrade
2025-02-26 03:51:40.594 | 1 die /opt/stack/new/devstack/functions-common
2025-02-26 03:51:40.594 | 123 resources /opt/stack/new/grenade/inc/plugin
2025-02-26 03:51:40.594 | 361 main ./grenade.sh
2025-02-26 03:51:40.594 | Exit code: 1


Example failures:-
https://619f8ab8e7929f66bd5b-cf1861da2efffc8db9fe7bd2fe123be5.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-ovs-grenade-dvr-multinode/ab5df5a/controller/logs/grenade.sh_log.txt
https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_914/periodic/opendev.org/openstack/neutron/master/neutron-ovs-grenade-dvr-multinode/914deea/controller/logs/grenade.sh_log.txt
https://f8c238545ee7a638c895-914597cbea50e6376f6c7f9a6f01859b.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/stable/2024.2/neutron-ovs-grenade-dvr-multinode/0fc1e0f/controller/logs/grenade.sh_log.txt

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2101166

Title:
  Random failure in dvr ovs grenade jobs to ping vm post upgrade

Status in neutron:
  New

Bug description:
  Fails as:-
  2025-02-26 03:50:28.030 | + /opt/stack/new/grenade/functions:ping_check_public:65 :   timeout 60 sh -c 'while ! ping -c1 -w1 172.24.5.242; do sleep 1; done'
  2025-02-26 03:50:29.034 | PING 172.24.5.242 (172.24.5.242) 56(84) bytes of data.
  2025-02-26 03:50:29.034 | 
  2025-02-26 03:50:29.034 | --- 172.24.5.242 ping statistics ---
  2025-02-26 03:50:29.034 | 1 packets transmitted, 0 received, 100% packet loss, time 0ms
  ...
  2025-02-26 03:51:27.130 | 1 packets transmitted, 0 received, 100% packet loss, time 0ms
  2025-02-26 03:51:27.130 | 
  2025-02-26 03:51:28.033 | + /opt/stack/new/grenade/functions:ping_check_public:66 :
  ...
  2025-02-26 03:51:35.347 | + /opt/stack/new/grenade/functions:ping_check_public:71 :   die 71 '[Fail] Couldn'\''t ping server'
  2025-02-26 03:51:35.349 | + /opt/stack/new/devstack/functions-common:die:285 :   local exitcode=0
  2025-02-26 03:51:35.351 | [Call Trace]
  2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:225:verify
  2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:161:verify_noapi
  2025-02-26 03:51:35.351 | /opt/stack/new/grenade/projects/60_nova/resources.sh:196:ping_check_public
  2025-02-26 03:51:35.351 | /opt/stack/new/grenade/functions:71:die
  2025-02-26 03:51:35.355 | [ERROR] /opt/stack/new/grenade/functions:71 [Fail] Couldn't ping server
  2025-02-26 03:51:36.357 | 1 die /opt/stack/new/devstack/functions-common
  2025-02-26 03:51:36.357 | 71 ping_check_public /opt/stack/new/grenade/functions
  2025-02-26 03:51:36.357 | 196 verify_noapi /opt/stack/new/grenade/projects/60_nova/resources.sh
  2025-02-26 03:51:36.357 | 161 verify /opt/stack/new/grenade/projects/60_nova/resources.sh
  2025-02-26 03:51:36.357 | 225 main /opt/stack/new/grenade/projects/60_nova/resources.sh
  2025-02-26 03:51:36.357 | Exit code: 1
  2025-02-26 03:51:39.583 | + inc/plugin:resources:123                 :   die 123 'Failed to run /opt/stack/new/grenade/projects/60_nova/resources.sh verify post-upgrade'
  2025-02-26 03:51:39.585 | + /opt/stack/new/devstack/functions-common:die:285 :   local exitcode=1
  2025-02-26 03:51:39.588 | [Call Trace]
  2025-02-26 03:51:39.588 | ./grenade.sh:361:resources
  2025-02-26 03:51:39.588 | /opt/stack/new/grenade/inc/plugin:123:die
  2025-02-26 03:51:39.592 | [ERROR] /opt/stack/new/grenade/inc/plugin:123 Failed to run /opt/stack/new/grenade/projects/60_nova/resources.sh verify post-upgrade
  2025-02-26 03:51:40.594 | 1 die /opt/stack/new/devstack/functions-common
  2025-02-26 03:51:40.594 | 123 resources /opt/stack/new/grenade/inc/plugin
  2025-02-26 03:51:40.594 | 361 main ./grenade.sh
  2025-02-26 03:51:40.594 | Exit code: 1

  
  Example failures:-
  https://619f8ab8e7929f66bd5b-cf1861da2efffc8db9fe7bd2fe123be5.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-ovs-grenade-dvr-multinode/ab5df5a/controller/logs/grenade.sh_log.txt
  https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_914/periodic/opendev.org/openstack/neutron/master/neutron-ovs-grenade-dvr-multinode/914deea/controller/logs/grenade.sh_log.txt
  https://f8c238545ee7a638c895-914597cbea50e6376f6c7f9a6f01859b.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/neutron/stable/2024.2/neutron-ovs-grenade-dvr-multinode/0fc1e0f/controller/logs/grenade.sh_log.txt

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2101166/+subscriptions