← Back to team overview

canonical-ubuntu-qa team mailing list archive

[Merge] ~xypron/ubuntu-manual-tests:risc-v_updates into ubuntu-manual-tests:main

 

Heinrich Schuchardt has proposed merging ~xypron/ubuntu-manual-tests:risc-v_updates into ubuntu-manual-tests:main.

Requested reviews:
  Ubuntu Testcase Admins (ubuntu-testcase)

For more details, see:
https://code.launchpad.net/~xypron/ubuntu-manual-tests/+git/ubuntu-manual-tests/+merge/485010

During Plucky testing some issues with RISC-V test cases came up which are resolved by this merge request.
-- 
Your team Canonical's Ubuntu QA is subscribed to branch ubuntu-manual-tests:main.
diff --git a/testcases/image/1753_QEMU_riscv64_install b/testcases/image/1753_QEMU_riscv64_install
index 3c99200..b845111 100644
--- a/testcases/image/1753_QEMU_riscv64_install
+++ b/testcases/image/1753_QEMU_riscv64_install
@@ -6,31 +6,21 @@ On your installed Ubuntu machine.
 <dl>
     <dt>sudo apt install -y opensbi qemu-system-misc u-boot-qemu</dt>
     <dt>rm -f disk</dt>
-    <dt>dd if=/dev/zero bs=1M of=disk count=1 seek=16383</dt>
+    <dt>truncate -s 16G disk</dt>
     <dt>Start the installer with:
 <pre>
 /usr/bin/qemu-system-riscv64 -machine virt -m 4G -smp cpus=2 -nographic \
     -kernel /usr/lib/u-boot/qemu-riscv64_smode/u-boot.bin \
     -netdev user,id=net0 \
     -device virtio-net-device,netdev=net0 \
-    -drive file=&lt;release&gt;-live-server-riscv64.iso,format=raw,if=virtio \
+    -drive file=disk,format=raw,if=virtio \
+    -drive file=&lt;release&gt;-live-server-riscv64.iso,format=raw,if=virtio,readonly=on \
     -drive file=disk,format=raw,if=virtio \
     -device virtio-rng-pci
 </pre></dt>
     <dt>Install on the 16 GiB drive.</dt>
         <dd>The installation finishes without reporting failures.</dd>
-    <dt>During the reboot press the Enter key to access U-Boot's command line.</dt>
-    <dt>Execute the poweroff command</dt>
-        <dd>QEMU terminates</dd>
-    <dt>Run the installed system with:
-<pre>
-/usr/bin/qemu-system-riscv64 -machine virt -m 4G -smp cpus=2 -nographic \
-    -kernel /usr/lib/u-boot/qemu-riscv64_smode/u-boot.bin \
-    -netdev user,id=net0 \
-    -device virtio-net-device,netdev=net0 \
-    -drive file=disk,format=raw,if=virtio \
-    -device virtio-rng-pci
-</pre></dt>
+    <dt>Reboot<dt>
         <dd>The system boots via GRUB.</dd>
     <dt>Login in with the username and password defined during the installation</dt>
     <dt>Run any command that is not installed, e.g. hello.</dt>
@@ -39,6 +29,11 @@ On your installed Ubuntu machine.
         <dd>Check that the package performs correctly.</dd>
     <dt>Install a snap, e.g. hello.</dt>
         <dd>check that the snap works correctly.</dd>
+    <dt>Check grub.cfg</dt>
+        <dd>If installing to real hardware using a device-tree,
+	/boot/dtb-<kernel-version> should exists and
+	/boot/grub/grub.cfg should contain a devicetree command loading
+	the this device-tree.</dd>
     <dt>Poweroff</dt>
         <dd>Console messages should reach the poweroff target</dd>
         <dd>There should be final message 'reboot: Power down'</dd>
diff --git a/testcases/image/1756_Install LicheeRV b/testcases/image/1756_Install LicheeRV
index 0323bee..a6ba6a2 100755
--- a/testcases/image/1756_Install LicheeRV
+++ b/testcases/image/1756_Install LicheeRV
@@ -1,91 +1,94 @@
-The scope of this test is to ensure that riscv64+licheerv image boots from SD card on LicheeRV board
-
-<dl>
-    <dt>Flash downloaded image onto SD card</dt>
-        <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
-        <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
-    <dt>Connect serial console to the board</dt>
-        <dd>FTDI adapter for serial console (pinout available here: https://popolon.org/depots/RISC-V/D1/LicheeRV/dl.sipeed.com/Lichee_RV_Dock/1_Datasheet/Sipeed%20Lichee%20RV%20DOCK%20Datasheet%20V1.0.pdf)</dd>
-    <dt>Connect to the serial console</dt>
-        <dd>sudo screen /dev/ttyUSB0 115200</dd>
-    <dt>Power on the board</dt>
-        <dd>You should see U-BOOT menu</dd>
-        <dd>It should then boot GRUB after a delay</dd>
-        <dd>You should see GRUB menu</dd>
-        <dd>It should then boot the default kernel after a delay</dd>
-        <dd>After a while cloud-init will run</dd>
-        <dd>Then one will be able to login</dd>
-    <dt>Login and change password</dt>
-        <dd>Login using ubuntu for both username and password</dd>
-        <dd>Reenter ubuntu password again</dd>
-        <dd>Set new password</dd>
-        <dd>Confirm the new password</dd>
-    <dt>Install Wifi kernel module</dt>
-        <dd><b>This step is only needed when testing releases with Linux kernel up to v6.5.</b></dd>
-        <dd>Make sure licheerv-rtl8723ds-dkms is installed, otherwise, install it: </dd>
-        <dd>$ sudo apt install licheerv-rtl8723ds-dkms </dd>
-        <dd>It will take quite some time to build, the output of the above command should look like this:.</dd>
-        <dd>Preparing to unpack licheerv-rtl8723ds-dkms </dd>
-        <dd>Module licheerv-rtl8723ds-1.0 for kernel 5.17.0-1003-allwinner </dd>
-        <dd>Unpacking licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
-        <dd>Setting up licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
-        <dd>Loading new licheerv-rtl8723ds-1.0 DKMS files... </dd>
-        <dd>Building for 5.17.0-1003-allwinner </dd>
-        <dd>Building initial module for 5.17.0-1003-allwinner </dd>
-        <dd>Done.</dd>
-        <dd>8723ds.ko:</dd>
-        <dd>Running module version sanity check.</dd>
-        <dd> - Original module</dd>
-        <dd>   - No original module exists within this kernel</dd>
-        <dd> - Installation</dd>
-        <dd>   - Installing to /lib/modules/5.17.0-1003-allwinner/updates/dkms/</dd>
-        <dd>depmod........................</dd>
-        <dd>Load the kernel module with:</dd>
-        <dd>$ sudo modprobe 8723ds</dd>
-    <dt>Perform Wifi testing</dt>
-        <dd>You should see a wlan0 interface by typing:</dd>
-        <dd>$ ip a </dd>
-        <dd>1: lo: &lt;LOOPBACK,UP,LOWER_UP&gt; mtu 65536 qdisc noqueue state UNKNOWN group defaul0</dd>
-        <dd>    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</dd>
-        <dd>    inet 127.0.0.1/8 scope host lo</dd>
-        <dd>       valid_lft forever preferred_lft forever</dd>
-        <dd>    inet6 ::1/128 scope host</dd>
-        <dd>       valid_lft forever preferred_lft forever</dd>
-        <dd>2: usb0: &lt;NO-CARRIER,BROADCAST,MULTICAST,UP&gt; mtu 1500 qdisc pfifo_fast state DOW0</dd>
-        <dd>    link/ether ae:12:05:64:8e:2c brd ff:ff:ff:ff:ff:ff</dd>
-        <dd>3: wlan0: &lt;BROADCAST,MULTICAST&gt; mtu 1500 qdisc mq state DOWN group default qlen 1000</dd>
-        <dd>    link/ether 34:20:03:2a:0d:0c brd ff:ff:ff:ff:ff:ff</dd>
-        <dd>Try to connect to local network by using the following netplan configuration file saved at /etc/netplan/wifi.yaml</dd>
-        <dd> network:</dd>
-        <dd>  version: 2</dd>
-        <dd>  renderer: networkd</dd>
-        <dd>  wifis:</dd>
-        <dd>    wlan0:</dd>
-        <dd>      dhcp4: yes</dd>
-        <dd>      dhcp6: yes</dd>
-        <dd>      access-points:</dd>
-        <dd>        "YOUR_SSID":</dd>
-        <dd>          password: "YOUR_PASSWORD"</dd>
-        <dd>And then type:</dd>
-        <dd>$ sudo netplan apply </dd>
-        <dd>You should connect successfully to your local network in a few seconds</dd>
-    <dt>Perform generic testing</dt>
-        <dd>Check that apt update works</dd>
-        <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
-        <dd>e.g. hello</dd>
-        <dd>Install a package and check that it works, e.g. hello</dd>
-    <dt>Perform snap testing</dt>
-        <dd>Install a snap and check that it works, e.g. hello</dd>
-    <dt>Perform HDMI testing</dt>
-        <dd>Plug an HDMI cable and make sure a prompt asking for login appears on the screen</dd>
-    <dt>Perform USB test</dt>
-        <dd>Plug a keyboard in and enter the login/password</dd>
-    <dt>Reboot</dt>
-        <dd>The board should reboot normally</dd>
-    <dt>Poweroff</dt>
-        <dd>Console messages should reach poweroff target</dd>
-        <dd>There should be final kernel dmsg powering off</dd>
-        <dd>Manually turn power-off from the board</dd>
-</dl>
-<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
-    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
+The scope of this test is to ensure that riscv64+licheerv image boots from SD card on LicheeRV board
+
+<dl>
+    <dt>Flash downloaded image onto SD card</dt>
+        <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
+        <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
+    <dt>Connect serial console to the board</dt>
+        <dd>FTDI adapter for serial console (pinout available here: https://popolon.org/depots/RISC-V/D1/LicheeRV/dl.sipeed.com/Lichee_RV_Dock/1_Datasheet/Sipeed%20Lichee%20RV%20DOCK%20Datasheet%20V1.0.pdf)</dd>
+    <dt>Connect to the serial console</dt>
+        <dd>sudo screen /dev/ttyUSB0 115200</dd>
+    <dt>Power on the board</dt>
+        <dd>You should see U-BOOT menu</dd>
+        <dd>It should then boot GRUB after a delay</dd>
+        <dd>You should see GRUB menu</dd>
+        <dd>It should then boot the default kernel after a delay</dd>
+        <dd>After a while cloud-init will run</dd>
+        <dd>Then one will be able to login</dd>
+    <dt>Login and change password</dt>
+        <dd>Login using ubuntu for both username and password</dd>
+        <dd>Reenter ubuntu password again</dd>
+        <dd>Set new password</dd>
+        <dd>Confirm the new password</dd>
+    <dt>Install Wifi kernel module</dt>
+        <dd><b>This step is only needed when testing releases with Linux kernel up to v6.5.</b></dd>
+        <dd>Make sure licheerv-rtl8723ds-dkms is installed, otherwise, install it: </dd>
+        <dd>$ sudo apt install licheerv-rtl8723ds-dkms </dd>
+        <dd>It will take quite some time to build, the output of the above command should look like this:.</dd>
+        <dd>Preparing to unpack licheerv-rtl8723ds-dkms </dd>
+        <dd>Module licheerv-rtl8723ds-1.0 for kernel 5.17.0-1003-allwinner </dd>
+        <dd>Unpacking licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
+        <dd>Setting up licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
+        <dd>Loading new licheerv-rtl8723ds-1.0 DKMS files... </dd>
+        <dd>Building for 5.17.0-1003-allwinner </dd>
+        <dd>Building initial module for 5.17.0-1003-allwinner </dd>
+        <dd>Done.</dd>
+        <dd>8723ds.ko:</dd>
+        <dd>Running module version sanity check.</dd>
+        <dd> - Original module</dd>
+        <dd>   - No original module exists within this kernel</dd>
+        <dd> - Installation</dd>
+        <dd>   - Installing to /lib/modules/5.17.0-1003-allwinner/updates/dkms/</dd>
+        <dd>depmod........................</dd>
+        <dd>Load the kernel module with:</dd>
+        <dd>$ sudo modprobe 8723ds</dd>
+    <dt>Perform Wifi testing</dt>
+        <dd>You should see a wlan0 interface by typing:</dd>
+        <dd>$ ip a </dd>
+        <dd>1: lo: &lt;LOOPBACK,UP,LOWER_UP&gt; mtu 65536 qdisc noqueue state UNKNOWN group defaul0</dd>
+        <dd>    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</dd>
+        <dd>    inet 127.0.0.1/8 scope host lo</dd>
+        <dd>       valid_lft forever preferred_lft forever</dd>
+        <dd>    inet6 ::1/128 scope host</dd>
+        <dd>       valid_lft forever preferred_lft forever</dd>
+        <dd>2: usb0: &lt;NO-CARRIER,BROADCAST,MULTICAST,UP&gt; mtu 1500 qdisc pfifo_fast state DOW0</dd>
+        <dd>    link/ether ae:12:05:64:8e:2c brd ff:ff:ff:ff:ff:ff</dd>
+        <dd>3: wlan0: &lt;BROADCAST,MULTICAST&gt; mtu 1500 qdisc mq state DOWN group default qlen 1000</dd>
+        <dd>    link/ether 34:20:03:2a:0d:0c brd ff:ff:ff:ff:ff:ff</dd>
+        <dd>Try to connect to local network by using the following netplan configuration file saved at /etc/netplan/wifi.yaml<br />
+<pre>
+network:
+  version: 2
+  renderer: networkd
+  wifis:
+    wlan0:
+      dhcp4: yes
+      dhcp6: yes
+      access-points:
+        "YOUR_SSID":
+          password: "YOUR_PASSWORD"
+</pre>
+        </dd>
+        <dd>And then type:</dd>
+        <dd>$ sudo netplan apply </dd>
+        <dd>You should connect successfully to your local network in a few seconds</dd>
+    <dt>Perform generic testing</dt>
+        <dd>Check that apt update works</dd>
+        <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
+        <dd>e.g. hello</dd>
+        <dd>Install a package and check that it works, e.g. hello</dd>
+    <dt>Perform snap testing</dt>
+        <dd>Install a snap and check that it works, e.g. hello</dd>
+    <dt>Perform HDMI testing</dt>
+        <dd>Plug an HDMI cable and make sure a prompt asking for login appears on the screen</dd>
+    <dt>Perform USB test</dt>
+        <dd>Plug a keyboard in and enter the login/password</dd>
+    <dt>Reboot</dt>
+        <dd>The board should reboot normally</dd>
+    <dt>Poweroff</dt>
+        <dd>Console messages should reach poweroff target</dd>
+        <dd>There should be final kernel dmsg powering off</dd>
+        <dd>Manually turn power-off from the board</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
diff --git a/testcases/image/1757_Install MPFS b/testcases/image/1757_Install MPFS
index 8069c8c..cba0022 100755
--- a/testcases/image/1757_Install MPFS
+++ b/testcases/image/1757_Install MPFS
@@ -1,41 +1,42 @@
-The scope of this test is to ensure that riscv64+icicle image boots from SD card on Microchip Polarfire Icicle board
-
-<dl>
-    <dt>Flash downloaded image onto SD card</dt>
-        <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
-        <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
-    <dt>Connect networking, serial console to the board</dt>
-        <dd>Ethernet cable for networking (both Ethernet connectors work)</dd>
-        <dd>USB cable for serial console (board layout here: https://www.microchip.com/content/dam/mchp/documents/FPGA/ProductDocuments/UserGuides/microchip_polarfire_soc_fpga_icicle_kit_user_guide_vb.pdf page 6)</dd>
-    <dt>Connect to the 'firmware' serial console</dt>
-        <dd>sudo screen /dev/ttyUSB0 115200</dd>
-    <dt>Connect to the 'kernel' serial console</dt>
-        <dd>sudo screen /dev/ttyUSB1 115200</dd>
-    <dt>Power on the board</dt>
-        <dd>You should see U-BOOT menu on the firmware console</dd>
-        <dd>It should then boot GRUB after a delay</dd>
-        <dd>You should see GRUB menu</dd>
-        <dd>It should then boot the default kernel after a delay on the kernel serial console</dd>
-        <dd>After a while cloud-init will run</dd>
-        <dd>Then one will be able to login</dd>
-    <dt>Login and change password</dt>
-        <dd>Login using ubuntu for both username and password</dd>
-        <dd>Reenter ubuntu password again</dd>
-        <dd>Set new password</dd>
-        <dd>Confirm the new password</dd>
-    <dt>Perform generic testing</dt>
-        <dd>Check that apt update works</dd>
-        <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
-        <dd>e.g. hello</dd>
-        <dd>Install a package and check that it works, e.g. hello</dd>
-    <dt>Perform snap testing</dt>
-        <dd>Install a snap and check that it works, e.g. hello</dd>
-    <dt>Reboot</dt>
-        <dd>The board should reboot normally</dt>
-    <dt>Poweroff</dt>
-        <dd>Console messages should reach poweroff target</dd>
-        <dd>There should be final kernel dmsg powering off</dd>
-        <dd>Manually turn power-off from the board</dd>
-</dl>
-<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
-    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
+The scope of this test is to ensure that riscv64+icicle image boots from SD card on Microchip Polarfire Icicle board
+
+<dl>
+    <dt>Flash downloaded image onto SD card</dt>
+        <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
+        <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
+    <dt>Connect networking, serial console to the board</dt>
+        <dd>Ethernet cable for networking (both Ethernet connectors work)</dd>
+        <dd>USB cable for serial console (board layout here: https://www.microchip.com/content/dam/mchp/documents/FPGA/ProductDocuments/UserGuides/microchip_polarfire_soc_fpga_icicle_kit_user_guide_vb.pdf page 6)</dd>
+    <dt>Connect to the 'firmware' serial console</dt>
+        <dd>sudo screen /dev/ttyUSB0 115200</dd>
+    <dt>Connect to the 'kernel' serial console</dt>
+        <dd>sudo screen /dev/ttyUSB1 115200</dd>
+    <dt>Power on the board</dt>
+        <dd>Power cycling is required here. Pressing the reset button while running the preinstalled SDK does return the board into a bootable state</dd>
+        <dd>You should see U-BOOT menu on the firmware console</dd>
+        <dd>It should then boot GRUB after a delay</dd>
+        <dd>You should see GRUB menu</dd>
+        <dd>It should then boot the default kernel after a delay on the kernel serial console</dd>
+        <dd>After a while cloud-init will run</dd>
+        <dd>Then one will be able to login</dd>
+    <dt>Login and change password</dt>
+        <dd>Login using ubuntu for both username and password</dd>
+        <dd>Reenter ubuntu password again</dd>
+        <dd>Set new password</dd>
+        <dd>Confirm the new password</dd>
+    <dt>Perform generic testing</dt>
+        <dd>Check that apt update works</dd>
+        <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
+        <dd>e.g. hello</dd>
+        <dd>Install a package and check that it works, e.g. hello</dd>
+    <dt>Perform snap testing</dt>
+        <dd>Install a snap and check that it works, e.g. hello</dd>
+    <dt>Reboot</dt>
+        <dd>The board should reboot normally</dt>
+    <dt>Poweroff</dt>
+        <dd>Console messages should reach poweroff target</dd>
+        <dd>There should be final kernel dmsg powering off</dd>
+        <dd>Manually turn power-off from the board</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>

Follow ups