canonical-ubuntu-qa team mailing list archive

Thread
Date
[Bug 2078790] Re: jammy qemu x86 int3: 0000 [#1] SMP NOPTI

To: canonical-ubuntu-qa@xxxxxxxxxxxxxxxxxxx
From: Mehmet Basaran <2078790@xxxxxxxxxxxxxxxxxx>
Date: Tue, 03 Sep 2024 09:23:53 -0000
Reply-to: Bug 2078790 <2078790@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
jammy:ibm-6.8 6.8.0-1012.12~22.04.1 qemu-x86 QEMU Standard PC (i440FX +
PIIX, 1996) -> ADT:systemd:upstream-1

3055s TEST-13-NSPAWN-SMOKE RUN: systemd-nspawn smoke test
3055s + /bin/qemu-system-x86_64 -smp 4 -net none -m 512M -nographic -vga none -kernel /boot/vmlinuz-6.8.0-1008-ibm -drive format=raw,cache=unsafe,file=/var/tmp/systemd-test.rYHUnh/nspawn.img -initrd /boot/initrd.img-6.8.0-1008-ibm -append 'root=/dev/sda1 rw raid=noautodetect rd.luks=0 loglevel=2 init=/lib/systemd/systemd console=ttyS0 selinux=0 SYSTEMD_UNIT_PATH=/usr/lib/systemd/tests/testdata/testsuite-13.units:/usr/lib/systemd/tests/testdata/units: systemd.unit=testsuite.target systemd.wants=testsuite-13.service systemd.wants=end.service'
3055s c[?7l[2J[0mSeaBIOS (version 1.15.0-1)
3066s Booting from ROM..c[?7l[2JLoading, please wait...
3067s Starting version 249.11-0ubuntu3.12
3068s Begin: Loading essential drivers ... done.
3068s Begin: Running /scripts/init-premount ... done.
3068s Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
3069s Begin: Running /scripts/local-premount ... Scanning for Btrfs filesystems
3070s done.
3070s Begin: Will now check root file system ... fsck from util-linux 2.37.2
3070s [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1
3070s systemd: clean, 2418/115200 files, 47699/115200 blocks
3070s done.
3070s done.
3070s Begin: Running /scripts/local-bottom ... done.
3070s Begin: Running /scripts/init-bottom ... done.
3072s
3072s Welcome to [1mUbuntu 22.04.4 LTS[0m!
3072s
3073s [[0;32m  OK  [0m] Created slice [0;1;39mSlice /system/modprobe[0m.
3073s [[0;32m  OK  [0m] Created slice [0;1;39mSlice /system/serial-getty[0m.
3073s [[0;32m  OK  [0m] Created slice [0;1;39mUser and Session Slice[0m.
3073s [[0;32m  OK  [0m] Started [0;1;39mDispatch Password …ts to Console Directory Watch[0m.
3073s [[0;32m  OK  [0m] Started [0;1;39mForward Password R…uests to Wall Directory Watch[0m.
3073s [[0;1;38;5;185mUNSUPP[0m] Starting of [0;1;39mArbitrary Exec…m Automount Point[0m unsupported.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mLocal Encrypted Volumes[0m.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mPath Units[0m.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mSlice Units[0m.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mSwaps[0m.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mLocal Verity Protected Volumes[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mProcess Core Dump Socket[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39minitctl Compatibility Named Pipe[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mJournal Audit Socket[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mJournal Socket (/dev/log)[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mJournal Socket[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mudev Control Socket[0m.
3073s [[0;32m  OK  [0m] Listening on [0;1;39mudev Kernel Socket[0m.
3073s [[0;32m  OK  [0m] Reached target [0;1;39mSockets[0m.
3073s          Mounting [0;1;39mHuge Pages File System[0m...
3073s          Mounting [0;1;39mPOSIX Message Queue File System[0m...
3073s          Mounting [0;1;39mKernel Debug File System[0m...
3073s          Mounting [0;1;39mKernel Trace File System[0m...
3073s          Starting [0;1;39mJournal Service[0m...
3073s          Starting [0;1;39mLoad Kernel Module configfs[0m...
3073s          Starting [0;1;39mLoad Kernel Module drm[0m...
3073s          Starting [0;1;39mLoad Kernel Module fuse[0m...
3073s          Starting [0;1;39mLoad Kernel Modules[0m...
3073s          Starting [0;1;39mRemount Root and Kernel File Systems[0m...
3073s          Starting [0;1;39mColdplug All udev Devices[0m...
3073s [[0;32m  OK  [0m] Mounted [0;1;39mHuge Pages File System[0m.
3073s [[0;32m  OK  [0m] Mounted [0;1;39mPOSIX Message Queue File System[0m.
3073s [[0;32m  OK  [0m] Mounted [0;1;39mKernel Debug File System[0m.
3073s [[0;32m  OK  [0m] Mounted [0;1;39mKernel Trace File System[0m.
3073s [[0;32m  OK  [0m] Finished [0;1;39mLoad Kernel Module configfs[0m.
3073s [[0;32m  OK  [0m] Finished [0;1;39mLoad Kernel Module drm[0m.
3073s [[0;32m  OK  [0m] Finished [0;1;39mLoad Kernel Module fuse[0m.
3073s [[0;32m  OK  [0m] Finished [0;1;39mLoad Kernel Modules[0m.
3073s [[0;32m  OK  [0m] Finished [0;1;39mRemount Root and Kernel File Systems[0m.
3073s          Mounting [0;1;39mFUSE Control File System[0m...
3073s          Mounting [0;1;39mKernel Configuration File System[0m...
3073s          Starting [0;1;39mLoad/Save Random Seed[0m...
3073s          Starting [0;1;39mApply Kernel Variables[0m...
3074s          Starting [0;1;39mCreate System Users[0m...
3074s [[0;32m  OK  [0m] Started [0;1;39mJournal Service[0m.
3074s [[0;32m  OK  [0m] Mounted [0;1;39mFUSE Control File System[0m.
3074s [[0;32m  OK  [0m] Mounted [0;1;39mKernel Configuration File System[0m.
3074s [[0;32m  OK  [0m] Finished [0;1;39mLoad/Save Random Seed[0m.
3074s          Starting [0;1;39mFlush Journal to Persistent Storage[0m...
3074s [[0;32m  OK  [0m] Finished [0;1;39mApply Kernel Variables[0m.
3074s [[0;32m  OK  [0m] Finished [0;1;39mCreate System Users[0m.
3074s          Starting [0;1;39mCreate Static Device Nodes in /dev[0m...
3074s [[0;32m  OK  [0m] Finished [0;1;39mCreate Static Device Nodes in /dev[0m.
3074s [[0;32m  OK  [0m] Finished [0;1;39mFlush Journal to Persistent Storage[0m.
3074s [[0;32m  OK  [0m] Reached target [0;1;39mPreparation for Local File Systems[0m.
3074s [[0;32m  OK  [0m] Reached target [0;1;39mLocal File Systems[0m.
3074s          Starting [0;1;39mCreate Volatile Files and Directories[0m...
3074s          Starting [0;1;39mRule-based Manage…for Device Events and Files[0m...
3074s [[0;32m  OK  [0m] Finished [0;1;39mColdplug All udev Devices[0m.
3074s [[0;32m  OK  [0m] Finished [0;1;39mCreate Volatile Files and Directories[0m.
3074s          Starting [0;1;39mRecord System Boot/Shutdown in UTMP[0m...
3074s [[0;32m  OK  [0m] Finished [0;1;39mRecord System Boot/Shutdown in UTMP[0m.
3075s [[0;32m  OK  [0m] Started [0;1;39mRule-based Manager for Device Events and Files[0m.
3075s [[0;32m  OK  [0m] Reached target [0;1;39mSystem Initialization[0m.
3075s [[0;32m  OK  [0m] Started [0;1;39mDaily Cleanup of Temporary Directories[0m.
3075s [[0;32m  OK  [0m] Reached target [0;1;39mBasic System[0m.
3075s [[0;32m  OK  [0m] Reached target [0;1;39mTimers[0m.
3075s [[0;32m  OK  [0m] Listening on [0;1;39mD-Bus System Message Bus Socket[0m.
3075s          Starting [0;1;39m/etc/rc.local Compatibility[0m...
3075s          Starting [0;1;39mUser Login Management[0m...
3075s [   17.418607] rc.local[251]: /etc/rc.local: 2: iptables: not found
3075s          Starting [0;1;39mPermit User Sessions[0m...
3075s          Starting [0;1;39mTEST-13-NSPAWN-SMOKE[0m...
3075s [[0;32m  OK  [0m] Started [0;1;39m/etc/rc.local Compatibility[0m.
3075s [[0;32m  OK  [0m] Finished [0;1;39mPermit User Sessions[0m.
3076s [[0;32m  OK  [0m] Started [0;1;39mD-Bus System Message Bus[0m.
3076s [[0;32m  OK  [0m] Started [0;1;39mUser Login Management[0m.
3077s [[0;32m  OK  [0m] Found device [0;1;39m/dev/ttyS0[0m.
3078s [[0;32m  OK  [0m] Created slice [0;1;39mVirtual Machine and Container Slice[0m.
3078s [[0;32m  OK  [0m] Started [0;1;39mContainer testsuite-13.bind-tmp-path[0m.
3078s [[0;32m  OK  [0m] Listening on [0;1;39mLoad/Save RF …itch Status /dev/rfkill Watch[0m.
3078s [[0;32m  OK  [0m] Started [0;1;39mSerial Getty on ttyS0[0m.
3078s [[0;32m  OK  [0m] Reached target [0;1;39mLogin Prompts[0m.
3078s [[0;32m  OK  [0m] Reached target [0;1;39mMulti-User System[0m.
3078s          Starting [0;1;39mRecord Runlevel Change in UTMP[0m...
3078s [[0;32m  OK  [0m] Finished [0;1;39mRecord Runlevel Change in UTMP[0m.
3078s          Starting [0;1;39mVirtual Machine a…tainer Registration Service[0m...
3079s [[0;32m  OK  [0m] Started [0;1;39mVirtual Machine an…ontainer Registration Service[0m.
3080s [[0;32m  OK  [0m] Started [0;1;39mContainer testsuite-13.norbind-path[0m.
3081s [[0;32m  OK  [0m] Started [0;1;39mContainer testsuite-13.nc-container[0m.
3084s

3113s H login: [   55.539526] int3: 0000 [#1] SMP NOPTI
3113s [   55.539526] CPU: 3 PID: 685 Comm: ip Not tainted 6.8.0-1008-ibm #8~22.04.1-Ubuntu
3113s [   55.539526] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.15.0-1 04/01/2014
3113s [   55.539526] RIP: 0010:__alloc_pages+0xe0/0x330
3113s [   55.539526] Code: 10 40 01 00 48 8d 84 02 00 1e 00 00 48 89 45 a8 8b 05 44 65 40 02 85 c0 0f 85 03 02 00 00 89 d8 c1 e8 03 83 e0 03 89 45 c0 66 <90> 41 89 df 41 be 01 00 00 00 f6 c7 04 75 71 44 89 e6 89 df e8 f7
3113s [   55.539526] RSP: 0000:ffffb834c112bc30 EFLAGS: 00000202
3113s [   55.539526] RAX: 0000000000000001 RBX: 0000000000140dca RCX: 0000000000000014
3113s [   55.539526] RDX: ffff8d6cdba51000 RSI: 0000000000000000 RDI: 0000000000140dca
3113s [   55.539526] RBP: ffffb834c112bc88 R08: 0000000000000000 R09: 0000000000000000
3113s [   55.539526] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
3113s [   55.539526] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
3113s [   55.539526] FS:  0000000000000000(0000) GS:ffff8d6cdb180000(0000) knlGS:0000000000000000
3113s [   55.539526] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
3113s [   55.539526] CR2: 000074ea73257538 CR3: 00000000031e0000 CR4: 00000000000006f0
3113s [   55.539526] Call Trace:
3113s [   55.539526]  <TASK>
3113s [   55.539526]  ? show_regs+0x6d/0x80
3113s [   55.539526]  ? die+0x37/0xa0
3113s [   55.539526]  ? exc_int3+0xe2/0xf0
3113s [   55.539526]  ? asm_exc_int3+0x3a/0x40
3113s [   55.539526]  ? __alloc_pages+0xe0/0x330
3113s [   55.539526]  ? __alloc_pages+0xe0/0x330
3113s [   55.539526]  alloc_pages_mpol+0x91/0x200
3113s [   55.539526]  vma_alloc_folio+0x64/0xe0
3113s [   55.539526]  alloc_anon_folio+0x2c5/0x340
3113s [   55.539526]  do_anonymous_page+0x6c/0x420
3113s [   55.539526]  handle_pte_fault+0x1ba/0x1c0
3113s [   55.539526]  __handle_mm_fault+0x659/0x7a0
3113s [   55.539526]  handle_mm_fault+0x17f/0x380
3113s [   55.539526]  do_user_addr_fault+0x158/0x6a0
3113s [   55.539526]  exc_page_fault+0x83/0x190
3113s [   55.539526]  asm_exc_page_fault+0x27/0x30
3113s [   55.539526] RIP: 0033:0x74ea7333346a
3113s [   55.539526] Code: 8d 44 20 ff be 10 00 00 00 49 f7 f4 49 0f af c4 4c 8d a4 03 40 f6 ff ff 31 c0 49 8d 7c 24 08 4c 89 e1 49 c7 04 24 00 00 00 00 <49> c7 84 24 b8 09 00 00 00 00 00 00 48 83 e7 f8 48 29 f9 81 c1 c0
3113s [   55.539526] RSP: 002b:00007fff10d6e800 EFLAGS: 00000246
3113s [   55.539526] RAX: 0000000000000000 RBX: 0000000000001100 RCX: 000074ea73256b80
3113s [   55.539526] RDX: 000000000000001f RSI: 0000000000000010 RDI: 000074ea73256b88
3113s [   55.539526] RBP: 000074ea73256420 R08: 0000000000000000 R09: 0000000000000094
3113s [   55.539526] R10: 0000000000000002 R11: 0000000000000090 R12: 000074ea73256b80
3113s [   55.539526] R13: 0000000000000000 R14: 0000000000000000 R15: 000074ea7335a2e0
3113s [   55.539526]  </TASK>
3113s [   55.539526] Modules linked in: btrfs blake2b_generic xor raid6_pq libcrc32c psmouse i2c_piix4 pata_acpi floppy
3113s [   55.539526] ---[ end trace 0000000000000000 ]---
3113s [   55.539526] RIP: 0010:__alloc_pages+0xe0/0x330
3113s [   55.539526] Code: 10 40 01 00 48 8d 84 02 00 1e 00 00 48 89 45 a8 8b 05 44 65 40 02 85 c0 0f 85 03 02 00 00 89 d8 c1 e8 03 83 e0 03 89 45 c0 66 <90> 41 89 df 41 be 01 00 00 00 f6 c7 04 75 71 44 89 e6 89 df e8 f7
3113s [   55.539526] RSP: 0000:ffffb834c112bc30 EFLAGS: 00000202
3113s [   55.539526] RAX: 0000000000000001 RBX: 0000000000140dca RCX: 0000000000000014
3113s [   55.539526] RDX: ffff8d6cdba51000 RSI: 0000000000000000 RDI: 0000000000140dca
3113s [   55.539526] RBP: ffffb834c112bc88 R08: 0000000000000000 R09: 0000000000000000
3113s [   55.539526] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
3113s [   55.539526] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
3113s [   55.539526] FS:  0000000000000000(0000) GS:ffff8d6cdb180000(0000) knlGS:0000000000000000
3113s [   55.539526] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
3113s [   55.539526] CR2: 000074ea73257538 CR3: 00000000031e0000 CR4: 00000000000006f0
3113s [   55.539526] Kernel panic - not syncing: Fatal exception in interrupt
3113s [   55.539526] Kernel Offset: 0x2ee00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
3113s [   55.539526] ---[ end Kernel panic - not syncing: Fatal exception in interrupt ]---
22800s autopkgtest [02:55:43]: ERROR: timed out on command "su -s /bin/bash root -c set -e; exec /tmp/autopkgtest.vOfxo6/wrapper.sh --artifacts=/tmp/autopkgtest.vOfxo6/upstream-1-artifacts --chdir=/tmp/autopkgtest.vOfxo6/build.1l5/src --env=AUTOPKGTEST_TESTBED_ARCH=amd64 --env=AUTOPKGTEST_TEST_ARCH=amd64 --env=DEB_BUILD_OPTIONS=parallel=4 --env=DEBIAN_FRONTEND=noninteractive --env=LANG=C.UTF-8 --unset-env=LANGUAGE --unset-env=LC_ADDRESS --unset-env=LC_ALL --unset-env=LC_COLLATE --unset-env=LC_CTYPE --unset-env=LC_IDENTIFICATION --unset-env=LC_MEASUREMENT --unset-env=LC_MESSAGES --unset-env=LC_MONETARY --unset-env=LC_NAME --unset-env=LC_NUMERIC --unset-env=LC_PAPER --unset-env=LC_TELEPHONE --unset-env=LC_TIME --script-pid-file=/tmp/autopkgtest_script_pid --source-profile --stderr=/tmp/autopkgtest.vOfxo6/upstream-1-stderr --stdout=/tmp/autopkgtest.vOfxo6/upstream-1-stdout --tmp=/tmp/autopkgtest.vOfxo6/autopkgtest_tmp --env=AUTOPKGTEST_NORMAL_USER=ubuntu --env=ADT_NORMAL_USER=ubuntu '--env=ADT_TEST_TRIGGERS=linux-meta-ibm-6.8/6.8.0-1008.8~22.04.1 systemd/249.11-0ubuntu3.12' --make-executable=/tmp/autopkgtest.vOfxo6/build.1l5/src/debian/tests/upstream-1 -- /tmp/autopkgtest.vOfxo6/build.1l5/src/debian/tests/upstream-1" (kind: test)
22800s autopkgtest [02:55:43]: test upstream-1: -----------------------]
22801s autopkgtest [02:55:44]: test upstream-1:  - - - - - - - - - - results - - - - - - - - - -
22801s upstream-1           FAIL timed out
22804s autopkgtest [02:55:47]: test upstream-2: preparing testbed
22805s Reading package lists...
22805s Building dependency tree...
22805s Reading state information...
22806s Starting pkgProblemResolver with broken count: 0
22806s Starting 2 pkgProblemResolver with broken count: 0
22806s Done
22806s The following NEW packages will be installed:
22806s   autopkgtest-satdep
22806s 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
22806s Need to get 0 B/996 B of archives.
22806s After this operation, 0 B of additional disk space will be used.
22806s Get:1 /tmp/autopkgtest.vOfxo6/15-autopkgtest-satdep.deb autopkgtest-satdep amd64 0 [996 B]
22807s Selecting previously unselected package autopkgtest-satdep.
22807s (Reading database ...
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 109759 files and directories currently installed.)
22807s Preparing to unpack .../15-autopkgtest-satdep.deb ...
22807s Unpacking autopkgtest-satdep (0) ...
22807s Setting up autopkgtest-satdep (0) ...
22810s (Reading database ... 109759 files and directories currently installed.)
22810s Removing autopkgtest-satdep (0) ...
22810s autopkgtest [02:55:53]: test upstream-2: [-----------------------
22810s

-- 
You received this bug notification because you are a member of Canonical
Platform QA Team, which is subscribed to ubuntu-kernel-tests.
https://bugs.launchpad.net/bugs/2078790

Title:
  jammy qemu x86 int3: 0000 [#1] SMP NOPTI

Status in linux-lowlatency-hwe-6.8 package in Ubuntu:
  New
Status in qemu package in Ubuntu:
  New

Bug description:
  jammy:linux-lowlatency-hwe-6.8 6.8.0-44.44.1~22.04.1 qemu-x86 QEMU
  Standard PC (i440FX + PIIX, 1996)

  
  Recently (2024.08.05), I have been seeing this issue with ADT:systemd:upstream-1/2 test in which kernel panics/prints a stack. I have seen this with jammy:linux-lowlatency-hwe-6.8 and jammy:linux-ibm-6.8. Stack trace is different everytime because kernel receives an interrupt, drop what it is doing, and crash when handling the interrupt.

  I think this is an issue with qemu and not kernel. For jammy, we are
  using qemu 6.2 and there are some fixes related to x86 interrupt
  handling in 8.x
  (https://lore.kernel.org/lkml/20230705215008.GD17440@xxxxxxxxxx/T/). I
  propose we create a launchpad bug and trace the issue. If I am
  correct, we shouldn't see this in noble. And we should occasionally
  see this in 5.15 jammy kernels (and more frequently with lowlantecy
  kernels).

  
  Meanwhile see comments below for some stack traces;

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux-lowlatency-hwe-6.8/+bug/2078790/+subscriptions
References

[Bug 2078790] [NEW] jammy qemu x86 int3: 0000 [#1] SMP NOPTI
From: Mehmet Basaran, 2024-09-03