canonical-ubuntu-qa team mailing list archive

Thread
Date
[Bug 2023179] [NEW] net:cmsg_ipv6.sh from ubuntu_kernel_selftests flaky with J-aws-5.19 on c6g.8xlarge, i3.metal, r5.metal

To: canonical-ubuntu-qa@xxxxxxxxxxxxxxxxxxx
From: Po-Hsu Lin <2023179@xxxxxxxxxxxxxxxxxx>
Date: Wed, 07 Jun 2023 10:44:02 -0000
Reply-to: Bug 2023179 <2023179@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

We have bug 2019519 regarding the flakyness of this test already. This
bug report is dedicated to AWS.

On J-aws-5.19, it's only affecting c6g.8xlarge, i3.metal, r5.metal

And the result seems a bit flaky there as well
* 5.19.0-1021.22~22.04.1 
  - c6g.8xlarge
 #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
 #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
 #   Case TCLASS UDP diff - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
 #   Case HOPLIMIT ICMP diff - packet data returned 1, expected 0 
 # FAIL - 5/93 cases failed
  - i3.metal
 # selftests: net: cmsg_ipv6.sh
 #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
 #   Case TCLASS UDP both - packet data returned 1, expected 0
 #   Case TCLASS ICMP both - packet data returned 1, expected 0
 #   Case TCLASS RAW diff - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP both - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
 #   Case HOPLIMIT RAW diff - packet data returned 1, expected 0
 # FAIL - 9/93 cases failed
  - r5.metal
 #   Case TCLASS ICMP both - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP both - packet data returned 1, expected 0
 # FAIL - 2/93 cases failed

* 5.19.0-1025.26~22.04.1 
  - c6g.8xlarge
 #   Case TCLASS UDP setsock - packet data returned 1, expected 0 
 #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
 #   Case HOPLIMIT ICMP diff - packet data returned 1, expected 0 
 #   Case HOPLIMIT RAW diff - packet data returned 1, expected 0
 # FAIL - 4/93 cases failed
  - i3.metal
 #   Case TCLASS UDP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
 # FAIL - 3/93 cases failed
  - r5.metal
 #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
 #   Case TCLASS RAW setsock - packet data returned 1, expected 0 
 #   Case TCLASS RAW cmsg - packet data returned 1, expected 0
 #   Case TCLASS RAW both - packet data returned 1, expected 0
 #   Case TCLASS UDP diff - packet data returned 1, expected 0
 #   Case TCLASS RAW diff - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT ICMP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT RAW setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
 #   Case HOPLIMIT RAW cmsg - packet data returned 1, expected 0
 #   Case HOPLIMIT RAW both - packet data returned 1, expected 0
 # FAIL - 12/93 cases failed

* 5.19.0-1027.28~22.04.1 
  - c6g.8xlarge
 #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
 #   Case HOPLIMIT RAW cmsg - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
 # FAIL - 3/93 cases failed
  - i3.metal
 #   Case TCLASS UDP setsock - packet data returned 1, expected 0
 # FAIL - 1/93 cases failed
  - r5.metal
 #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
 #   Case TCLASS RAW setsock - packet data returned 1, expected 0 
 #   Case TCLASS ICMP both - packet data returned 1, expected 0
 #   Case TCLASS RAW both - packet data returned 1, expected 0
 #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
 # FAIL - 5/93 cases failed

** Affects: ubuntu-kernel-tests
     Importance: Undecided
         Status: New


** Tags: 5.19 amd64 arm64 aws jammy sru-20230417 sru-20230515 ubuntu-kernel-selftests

-- 
You received this bug notification because you are a member of Canonical
Platform QA Team, which is subscribed to ubuntu-kernel-tests.
https://bugs.launchpad.net/bugs/2023179

Title:
  net:cmsg_ipv6.sh from ubuntu_kernel_selftests flaky with J-aws-5.19 on
  c6g.8xlarge, i3.metal, r5.metal

Status in ubuntu-kernel-tests:
  New

Bug description:
  We have bug 2019519 regarding the flakyness of this test already. This
  bug report is dedicated to AWS.

  On J-aws-5.19, it's only affecting c6g.8xlarge, i3.metal, r5.metal

  And the result seems a bit flaky there as well
  * 5.19.0-1021.22~22.04.1 
    - c6g.8xlarge
   #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
   #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
   #   Case TCLASS UDP diff - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
   #   Case HOPLIMIT ICMP diff - packet data returned 1, expected 0 
   # FAIL - 5/93 cases failed
    - i3.metal
   # selftests: net: cmsg_ipv6.sh
   #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
   #   Case TCLASS UDP both - packet data returned 1, expected 0
   #   Case TCLASS ICMP both - packet data returned 1, expected 0
   #   Case TCLASS RAW diff - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP both - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
   #   Case HOPLIMIT RAW diff - packet data returned 1, expected 0
   # FAIL - 9/93 cases failed
    - r5.metal
   #   Case TCLASS ICMP both - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP both - packet data returned 1, expected 0
   # FAIL - 2/93 cases failed

  * 5.19.0-1025.26~22.04.1 
    - c6g.8xlarge
   #   Case TCLASS UDP setsock - packet data returned 1, expected 0 
   #   Case TCLASS UDP cmsg - packet data returned 1, expected 0
   #   Case HOPLIMIT ICMP diff - packet data returned 1, expected 0 
   #   Case HOPLIMIT RAW diff - packet data returned 1, expected 0
   # FAIL - 4/93 cases failed
    - i3.metal
   #   Case TCLASS UDP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
   # FAIL - 3/93 cases failed
    - r5.metal
   #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
   #   Case TCLASS RAW setsock - packet data returned 1, expected 0 
   #   Case TCLASS RAW cmsg - packet data returned 1, expected 0
   #   Case TCLASS RAW both - packet data returned 1, expected 0
   #   Case TCLASS UDP diff - packet data returned 1, expected 0
   #   Case TCLASS RAW diff - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT ICMP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT RAW setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP cmsg - packet data returned 1, expected 0
   #   Case HOPLIMIT RAW cmsg - packet data returned 1, expected 0
   #   Case HOPLIMIT RAW both - packet data returned 1, expected 0
   # FAIL - 12/93 cases failed

  * 5.19.0-1027.28~22.04.1 
    - c6g.8xlarge
   #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
   #   Case HOPLIMIT RAW cmsg - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP diff - packet data returned 1, expected 0
   # FAIL - 3/93 cases failed
    - i3.metal
   #   Case TCLASS UDP setsock - packet data returned 1, expected 0
   # FAIL - 1/93 cases failed
    - r5.metal
   #   Case TCLASS ICMP setsock - packet data returned 1, expected 0
   #   Case TCLASS RAW setsock - packet data returned 1, expected 0 
   #   Case TCLASS ICMP both - packet data returned 1, expected 0
   #   Case TCLASS RAW both - packet data returned 1, expected 0
   #   Case HOPLIMIT UDP setsock - packet data returned 1, expected 0
   # FAIL - 5/93 cases failed

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/2023179/+subscriptions
Follow ups

[Bug 2023179] Re: net:cmsg_ipv6.sh from ubuntu_kernel_selftests flaky with J-aws-5.19 on c6g.8xlarge, i3.metal, r5.metal
From: Po-Hsu Lin, 2024-12-26