← Back to team overview

canonical-ubuntu-qa team mailing list archive

[Bug 2125933] [NEW] ubuntu_stress_smoke_test:dev-shm flaky on n2d-standard-4.sev_snp running jammy:linux-gcp-tcpx

 

Public bug reported:

dev-shm fails sometimes on a SEV-SNP instance running our GCP TCPX
kernel, so there are several factors that could be affecting a memory
stress test. Because this is flaky and very specific, and the failures
have been present for many cycles, this is a low priority for now.

Test output:
21:47:52 DEBUG| Running '/home/ubuntu/autotest/client/tests/ubuntu_stress_smoke_test/ubuntu_stress_single_smoke_test.sh dev-shm'
21:47:52 DEBUG| [stdout] Free memory: 12920 MB
21:47:52 DEBUG| [stdout] Memory used: 11628 MB
21:47:52 DEBUG| [stdout] Using cgroup version 2
21:47:52 DEBUG| [stdout]
21:47:52 DEBUG| [stdout] Machine Configuration
21:47:52 DEBUG| [stdout] Physical Pages: 3844915
21:47:52 DEBUG| [stdout] Pages available: 3307558
21:47:53 DEBUG| [stdout] Page Size: 4096
21:47:53 DEBUG| [stdout] Zswap enabled: Y
21:47:53 DEBUG| [stdout]
21:47:53 DEBUG| [stdout] Free memory:
21:47:53 DEBUG| [stdout] total used free shared buff/cache available
21:47:53 DEBUG| [stdout] Mem: 15379660 375532 13230232 1016 1773896 14693448
21:47:53 DEBUG| [stdout] Swap: 1048572 1280 1047292
21:47:53 DEBUG| [stdout]
21:47:53 DEBUG| [stdout] Number of CPUs: 4
21:47:53 DEBUG| [stdout] Number of CPUs Online: 4
21:47:53 DEBUG| [stdout]
21:47:53 DEBUG| [stdout] Maximum bogo ops: 3000
21:47:53 DEBUG| [stdout]
21:47:53 DEBUG| [stdout] dev-shm STARTING
scp: /tmp/ubuntu_stress_smoke_test.sentinel: No such file or directory

TEST SYSTEM FAILURE DETECTED
A failure of the system under test has been detected.
Please review log files for a potential panic, hang or unexpected reboot 

Serial output:
Sep 26 21:46:08 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  466.513657] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.097336] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.583604] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.587866] bdi 259:0: the stable_pages_required attribute has been removed. Use the stable_writes queue attribute instead.
Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.615832] Non-volatile memory driver v1.3
Sep 26 21:46:13 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.741306] autofs4:pid:26340:validate_dev_ioctl: invalid path supplied for cmd(0xc018937e)
Sep 26 21:46:13 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  471.051142] NET: Registered PF_VSOCK protocol family
[  472.802961] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.803287] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.814247] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.814250] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.814261] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.815032] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.815043] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.819997] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.820008] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.825953] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.828148] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.828166] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.835824] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.845284] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.853125] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.865514] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.866092] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.872390] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.882711] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.882721] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.883631] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.891099] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.891109] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  472.962349] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  472.977251] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  473.007862] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  473.019176] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
[  473.020242] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  473.027303] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
[  473.085869] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295

The system then reboots.

** Affects: ubuntu-kernel-tests
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Canonical
Platform QA Team, which is subscribed to ubuntu-kernel-tests.
https://bugs.launchpad.net/bugs/2125933

Title:
  ubuntu_stress_smoke_test:dev-shm flaky on n2d-standard-4.sev_snp
  running jammy:linux-gcp-tcpx

Status in ubuntu-kernel-tests:
  New

Bug description:
  dev-shm fails sometimes on a SEV-SNP instance running our GCP TCPX
  kernel, so there are several factors that could be affecting a memory
  stress test. Because this is flaky and very specific, and the failures
  have been present for many cycles, this is a low priority for now.

  Test output:
  21:47:52 DEBUG| Running '/home/ubuntu/autotest/client/tests/ubuntu_stress_smoke_test/ubuntu_stress_single_smoke_test.sh dev-shm'
  21:47:52 DEBUG| [stdout] Free memory: 12920 MB
  21:47:52 DEBUG| [stdout] Memory used: 11628 MB
  21:47:52 DEBUG| [stdout] Using cgroup version 2
  21:47:52 DEBUG| [stdout]
  21:47:52 DEBUG| [stdout] Machine Configuration
  21:47:52 DEBUG| [stdout] Physical Pages: 3844915
  21:47:52 DEBUG| [stdout] Pages available: 3307558
  21:47:53 DEBUG| [stdout] Page Size: 4096
  21:47:53 DEBUG| [stdout] Zswap enabled: Y
  21:47:53 DEBUG| [stdout]
  21:47:53 DEBUG| [stdout] Free memory:
  21:47:53 DEBUG| [stdout] total used free shared buff/cache available
  21:47:53 DEBUG| [stdout] Mem: 15379660 375532 13230232 1016 1773896 14693448
  21:47:53 DEBUG| [stdout] Swap: 1048572 1280 1047292
  21:47:53 DEBUG| [stdout]
  21:47:53 DEBUG| [stdout] Number of CPUs: 4
  21:47:53 DEBUG| [stdout] Number of CPUs Online: 4
  21:47:53 DEBUG| [stdout]
  21:47:53 DEBUG| [stdout] Maximum bogo ops: 3000
  21:47:53 DEBUG| [stdout]
  21:47:53 DEBUG| [stdout] dev-shm STARTING
  scp: /tmp/ubuntu_stress_smoke_test.sentinel: No such file or directory

  TEST SYSTEM FAILURE DETECTED
  A failure of the system under test has been detected.
  Please review log files for a potential panic, hang or unexpected reboot 

  Serial output:
  Sep 26 21:46:08 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  466.513657] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
  Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.097336] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
  Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.583604] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
  Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.587866] bdi 259:0: the stable_pages_required attribute has been removed. Use the stable_writes queue attribute instead.
  Sep 26 21:46:12 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.615832] Non-volatile memory driver v1.3
  Sep 26 21:46:13 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  470.741306] autofs4:pid:26340:validate_dev_ioctl: invalid path supplied for cmd(0xc018937e)
  Sep 26 21:46:13 j-lgcptcpx-gcptcpx-s2-n2dstd4-sev-snp-u-stress-smk-test kernel: [  471.051142] NET: Registered PF_VSOCK protocol family
  [  472.802961] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.803287] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.814247] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.814250] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.814261] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.815032] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.815043] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.819997] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.820008] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.825953] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.828148] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.828166] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.835824] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.845284] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.853125] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.865514] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.866092] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.872390] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.882711] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.882721] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.883631] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.891099] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.891109] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  472.962349] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  472.977251] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  473.007862] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  473.019176] device-mapper: ioctl: ioctl interface mismatch: kernel(4.48.0), user(4294967291.4294967250.4294967295), cmd(0)
  [  473.020242] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  473.027303] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295
  [  473.085869] device-mapper: ioctl: Invalid data size in the ioctl structure: 4294967295

  The system then reboots.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/2125933/+subscriptions