canonical-ubuntu-qa team mailing list archive
-
canonical-ubuntu-qa team
-
Mailing list archive
-
Message #07444
[Merge] ~xypron/ubuntu-manual-tests:risc-v_updates into ubuntu-manual-tests:main
Heinrich Schuchardt has proposed merging ~xypron/ubuntu-manual-tests:risc-v_updates into ubuntu-manual-tests:main.
Requested reviews:
Ubuntu Testcase Admins (ubuntu-testcase)
For more details, see:
https://code.launchpad.net/~xypron/ubuntu-manual-tests/+git/ubuntu-manual-tests/+merge/485010
During Plucky testing some issues with RISC-V test cases came up which are resolved by this merge request.
--
Your team Canonical's Ubuntu QA is subscribed to branch ubuntu-manual-tests:main.
diff --git a/testcases/image/1753_QEMU_riscv64_install b/testcases/image/1753_QEMU_riscv64_install
index 3c99200..b845111 100644
--- a/testcases/image/1753_QEMU_riscv64_install
+++ b/testcases/image/1753_QEMU_riscv64_install
@@ -6,31 +6,21 @@ On your installed Ubuntu machine.
<dl>
<dt>sudo apt install -y opensbi qemu-system-misc u-boot-qemu</dt>
<dt>rm -f disk</dt>
- <dt>dd if=/dev/zero bs=1M of=disk count=1 seek=16383</dt>
+ <dt>truncate -s 16G disk</dt>
<dt>Start the installer with:
<pre>
/usr/bin/qemu-system-riscv64 -machine virt -m 4G -smp cpus=2 -nographic \
-kernel /usr/lib/u-boot/qemu-riscv64_smode/u-boot.bin \
-netdev user,id=net0 \
-device virtio-net-device,netdev=net0 \
- -drive file=<release>-live-server-riscv64.iso,format=raw,if=virtio \
+ -drive file=disk,format=raw,if=virtio \
+ -drive file=<release>-live-server-riscv64.iso,format=raw,if=virtio,readonly=on \
-drive file=disk,format=raw,if=virtio \
-device virtio-rng-pci
</pre></dt>
<dt>Install on the 16 GiB drive.</dt>
<dd>The installation finishes without reporting failures.</dd>
- <dt>During the reboot press the Enter key to access U-Boot's command line.</dt>
- <dt>Execute the poweroff command</dt>
- <dd>QEMU terminates</dd>
- <dt>Run the installed system with:
-<pre>
-/usr/bin/qemu-system-riscv64 -machine virt -m 4G -smp cpus=2 -nographic \
- -kernel /usr/lib/u-boot/qemu-riscv64_smode/u-boot.bin \
- -netdev user,id=net0 \
- -device virtio-net-device,netdev=net0 \
- -drive file=disk,format=raw,if=virtio \
- -device virtio-rng-pci
-</pre></dt>
+ <dt>Reboot<dt>
<dd>The system boots via GRUB.</dd>
<dt>Login in with the username and password defined during the installation</dt>
<dt>Run any command that is not installed, e.g. hello.</dt>
@@ -39,6 +29,11 @@ On your installed Ubuntu machine.
<dd>Check that the package performs correctly.</dd>
<dt>Install a snap, e.g. hello.</dt>
<dd>check that the snap works correctly.</dd>
+ <dt>Check grub.cfg</dt>
+ <dd>If installing to real hardware using a device-tree,
+ /boot/dtb-<kernel-version> should exists and
+ /boot/grub/grub.cfg should contain a devicetree command loading
+ the this device-tree.</dd>
<dt>Poweroff</dt>
<dd>Console messages should reach the poweroff target</dd>
<dd>There should be final message 'reboot: Power down'</dd>
diff --git a/testcases/image/1756_Install LicheeRV b/testcases/image/1756_Install LicheeRV
index 0323bee..a6ba6a2 100755
--- a/testcases/image/1756_Install LicheeRV
+++ b/testcases/image/1756_Install LicheeRV
@@ -1,91 +1,94 @@
-The scope of this test is to ensure that riscv64+licheerv image boots from SD card on LicheeRV board
-
-<dl>
- <dt>Flash downloaded image onto SD card</dt>
- <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
- <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
- <dt>Connect serial console to the board</dt>
- <dd>FTDI adapter for serial console (pinout available here: https://popolon.org/depots/RISC-V/D1/LicheeRV/dl.sipeed.com/Lichee_RV_Dock/1_Datasheet/Sipeed%20Lichee%20RV%20DOCK%20Datasheet%20V1.0.pdf)</dd>
- <dt>Connect to the serial console</dt>
- <dd>sudo screen /dev/ttyUSB0 115200</dd>
- <dt>Power on the board</dt>
- <dd>You should see U-BOOT menu</dd>
- <dd>It should then boot GRUB after a delay</dd>
- <dd>You should see GRUB menu</dd>
- <dd>It should then boot the default kernel after a delay</dd>
- <dd>After a while cloud-init will run</dd>
- <dd>Then one will be able to login</dd>
- <dt>Login and change password</dt>
- <dd>Login using ubuntu for both username and password</dd>
- <dd>Reenter ubuntu password again</dd>
- <dd>Set new password</dd>
- <dd>Confirm the new password</dd>
- <dt>Install Wifi kernel module</dt>
- <dd><b>This step is only needed when testing releases with Linux kernel up to v6.5.</b></dd>
- <dd>Make sure licheerv-rtl8723ds-dkms is installed, otherwise, install it: </dd>
- <dd>$ sudo apt install licheerv-rtl8723ds-dkms </dd>
- <dd>It will take quite some time to build, the output of the above command should look like this:.</dd>
- <dd>Preparing to unpack licheerv-rtl8723ds-dkms </dd>
- <dd>Module licheerv-rtl8723ds-1.0 for kernel 5.17.0-1003-allwinner </dd>
- <dd>Unpacking licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
- <dd>Setting up licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
- <dd>Loading new licheerv-rtl8723ds-1.0 DKMS files... </dd>
- <dd>Building for 5.17.0-1003-allwinner </dd>
- <dd>Building initial module for 5.17.0-1003-allwinner </dd>
- <dd>Done.</dd>
- <dd>8723ds.ko:</dd>
- <dd>Running module version sanity check.</dd>
- <dd> - Original module</dd>
- <dd> - No original module exists within this kernel</dd>
- <dd> - Installation</dd>
- <dd> - Installing to /lib/modules/5.17.0-1003-allwinner/updates/dkms/</dd>
- <dd>depmod........................</dd>
- <dd>Load the kernel module with:</dd>
- <dd>$ sudo modprobe 8723ds</dd>
- <dt>Perform Wifi testing</dt>
- <dd>You should see a wlan0 interface by typing:</dd>
- <dd>$ ip a </dd>
- <dd>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group defaul0</dd>
- <dd> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</dd>
- <dd> inet 127.0.0.1/8 scope host lo</dd>
- <dd> valid_lft forever preferred_lft forever</dd>
- <dd> inet6 ::1/128 scope host</dd>
- <dd> valid_lft forever preferred_lft forever</dd>
- <dd>2: usb0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOW0</dd>
- <dd> link/ether ae:12:05:64:8e:2c brd ff:ff:ff:ff:ff:ff</dd>
- <dd>3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</dd>
- <dd> link/ether 34:20:03:2a:0d:0c brd ff:ff:ff:ff:ff:ff</dd>
- <dd>Try to connect to local network by using the following netplan configuration file saved at /etc/netplan/wifi.yaml</dd>
- <dd> network:</dd>
- <dd> version: 2</dd>
- <dd> renderer: networkd</dd>
- <dd> wifis:</dd>
- <dd> wlan0:</dd>
- <dd> dhcp4: yes</dd>
- <dd> dhcp6: yes</dd>
- <dd> access-points:</dd>
- <dd> "YOUR_SSID":</dd>
- <dd> password: "YOUR_PASSWORD"</dd>
- <dd>And then type:</dd>
- <dd>$ sudo netplan apply </dd>
- <dd>You should connect successfully to your local network in a few seconds</dd>
- <dt>Perform generic testing</dt>
- <dd>Check that apt update works</dd>
- <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
- <dd>e.g. hello</dd>
- <dd>Install a package and check that it works, e.g. hello</dd>
- <dt>Perform snap testing</dt>
- <dd>Install a snap and check that it works, e.g. hello</dd>
- <dt>Perform HDMI testing</dt>
- <dd>Plug an HDMI cable and make sure a prompt asking for login appears on the screen</dd>
- <dt>Perform USB test</dt>
- <dd>Plug a keyboard in and enter the login/password</dd>
- <dt>Reboot</dt>
- <dd>The board should reboot normally</dd>
- <dt>Poweroff</dt>
- <dd>Console messages should reach poweroff target</dd>
- <dd>There should be final kernel dmsg powering off</dd>
- <dd>Manually turn power-off from the board</dd>
-</dl>
-<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
- If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
+The scope of this test is to ensure that riscv64+licheerv image boots from SD card on LicheeRV board
+
+<dl>
+ <dt>Flash downloaded image onto SD card</dt>
+ <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
+ <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
+ <dt>Connect serial console to the board</dt>
+ <dd>FTDI adapter for serial console (pinout available here: https://popolon.org/depots/RISC-V/D1/LicheeRV/dl.sipeed.com/Lichee_RV_Dock/1_Datasheet/Sipeed%20Lichee%20RV%20DOCK%20Datasheet%20V1.0.pdf)</dd>
+ <dt>Connect to the serial console</dt>
+ <dd>sudo screen /dev/ttyUSB0 115200</dd>
+ <dt>Power on the board</dt>
+ <dd>You should see U-BOOT menu</dd>
+ <dd>It should then boot GRUB after a delay</dd>
+ <dd>You should see GRUB menu</dd>
+ <dd>It should then boot the default kernel after a delay</dd>
+ <dd>After a while cloud-init will run</dd>
+ <dd>Then one will be able to login</dd>
+ <dt>Login and change password</dt>
+ <dd>Login using ubuntu for both username and password</dd>
+ <dd>Reenter ubuntu password again</dd>
+ <dd>Set new password</dd>
+ <dd>Confirm the new password</dd>
+ <dt>Install Wifi kernel module</dt>
+ <dd><b>This step is only needed when testing releases with Linux kernel up to v6.5.</b></dd>
+ <dd>Make sure licheerv-rtl8723ds-dkms is installed, otherwise, install it: </dd>
+ <dd>$ sudo apt install licheerv-rtl8723ds-dkms </dd>
+ <dd>It will take quite some time to build, the output of the above command should look like this:.</dd>
+ <dd>Preparing to unpack licheerv-rtl8723ds-dkms </dd>
+ <dd>Module licheerv-rtl8723ds-1.0 for kernel 5.17.0-1003-allwinner </dd>
+ <dd>Unpacking licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
+ <dd>Setting up licheerv-rtl8723ds-dkms (1.0-0ubuntu1) ... </dd>
+ <dd>Loading new licheerv-rtl8723ds-1.0 DKMS files... </dd>
+ <dd>Building for 5.17.0-1003-allwinner </dd>
+ <dd>Building initial module for 5.17.0-1003-allwinner </dd>
+ <dd>Done.</dd>
+ <dd>8723ds.ko:</dd>
+ <dd>Running module version sanity check.</dd>
+ <dd> - Original module</dd>
+ <dd> - No original module exists within this kernel</dd>
+ <dd> - Installation</dd>
+ <dd> - Installing to /lib/modules/5.17.0-1003-allwinner/updates/dkms/</dd>
+ <dd>depmod........................</dd>
+ <dd>Load the kernel module with:</dd>
+ <dd>$ sudo modprobe 8723ds</dd>
+ <dt>Perform Wifi testing</dt>
+ <dd>You should see a wlan0 interface by typing:</dd>
+ <dd>$ ip a </dd>
+ <dd>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group defaul0</dd>
+ <dd> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</dd>
+ <dd> inet 127.0.0.1/8 scope host lo</dd>
+ <dd> valid_lft forever preferred_lft forever</dd>
+ <dd> inet6 ::1/128 scope host</dd>
+ <dd> valid_lft forever preferred_lft forever</dd>
+ <dd>2: usb0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOW0</dd>
+ <dd> link/ether ae:12:05:64:8e:2c brd ff:ff:ff:ff:ff:ff</dd>
+ <dd>3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</dd>
+ <dd> link/ether 34:20:03:2a:0d:0c brd ff:ff:ff:ff:ff:ff</dd>
+ <dd>Try to connect to local network by using the following netplan configuration file saved at /etc/netplan/wifi.yaml<br />
+<pre>
+network:
+ version: 2
+ renderer: networkd
+ wifis:
+ wlan0:
+ dhcp4: yes
+ dhcp6: yes
+ access-points:
+ "YOUR_SSID":
+ password: "YOUR_PASSWORD"
+</pre>
+ </dd>
+ <dd>And then type:</dd>
+ <dd>$ sudo netplan apply </dd>
+ <dd>You should connect successfully to your local network in a few seconds</dd>
+ <dt>Perform generic testing</dt>
+ <dd>Check that apt update works</dd>
+ <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
+ <dd>e.g. hello</dd>
+ <dd>Install a package and check that it works, e.g. hello</dd>
+ <dt>Perform snap testing</dt>
+ <dd>Install a snap and check that it works, e.g. hello</dd>
+ <dt>Perform HDMI testing</dt>
+ <dd>Plug an HDMI cable and make sure a prompt asking for login appears on the screen</dd>
+ <dt>Perform USB test</dt>
+ <dd>Plug a keyboard in and enter the login/password</dd>
+ <dt>Reboot</dt>
+ <dd>The board should reboot normally</dd>
+ <dt>Poweroff</dt>
+ <dd>Console messages should reach poweroff target</dd>
+ <dd>There should be final kernel dmsg powering off</dd>
+ <dd>Manually turn power-off from the board</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+ If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
diff --git a/testcases/image/1757_Install MPFS b/testcases/image/1757_Install MPFS
index 8069c8c..cba0022 100755
--- a/testcases/image/1757_Install MPFS
+++ b/testcases/image/1757_Install MPFS
@@ -1,41 +1,42 @@
-The scope of this test is to ensure that riscv64+icicle image boots from SD card on Microchip Polarfire Icicle board
-
-<dl>
- <dt>Flash downloaded image onto SD card</dt>
- <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
- <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
- <dt>Connect networking, serial console to the board</dt>
- <dd>Ethernet cable for networking (both Ethernet connectors work)</dd>
- <dd>USB cable for serial console (board layout here: https://www.microchip.com/content/dam/mchp/documents/FPGA/ProductDocuments/UserGuides/microchip_polarfire_soc_fpga_icicle_kit_user_guide_vb.pdf page 6)</dd>
- <dt>Connect to the 'firmware' serial console</dt>
- <dd>sudo screen /dev/ttyUSB0 115200</dd>
- <dt>Connect to the 'kernel' serial console</dt>
- <dd>sudo screen /dev/ttyUSB1 115200</dd>
- <dt>Power on the board</dt>
- <dd>You should see U-BOOT menu on the firmware console</dd>
- <dd>It should then boot GRUB after a delay</dd>
- <dd>You should see GRUB menu</dd>
- <dd>It should then boot the default kernel after a delay on the kernel serial console</dd>
- <dd>After a while cloud-init will run</dd>
- <dd>Then one will be able to login</dd>
- <dt>Login and change password</dt>
- <dd>Login using ubuntu for both username and password</dd>
- <dd>Reenter ubuntu password again</dd>
- <dd>Set new password</dd>
- <dd>Confirm the new password</dd>
- <dt>Perform generic testing</dt>
- <dd>Check that apt update works</dd>
- <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
- <dd>e.g. hello</dd>
- <dd>Install a package and check that it works, e.g. hello</dd>
- <dt>Perform snap testing</dt>
- <dd>Install a snap and check that it works, e.g. hello</dd>
- <dt>Reboot</dt>
- <dd>The board should reboot normally</dt>
- <dt>Poweroff</dt>
- <dd>Console messages should reach poweroff target</dd>
- <dd>There should be final kernel dmsg powering off</dd>
- <dd>Manually turn power-off from the board</dd>
-</dl>
-<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
- If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
+The scope of this test is to ensure that riscv64+icicle image boots from SD card on Microchip Polarfire Icicle board
+
+<dl>
+ <dt>Flash downloaded image onto SD card</dt>
+ <dd>You can use Gnome Disks app to restore img.xz onto the SD card</dd>
+ <dd> Alternatively you can use xz -d to decompress, and then dd to copy the image to the SD card</dd>
+ <dt>Connect networking, serial console to the board</dt>
+ <dd>Ethernet cable for networking (both Ethernet connectors work)</dd>
+ <dd>USB cable for serial console (board layout here: https://www.microchip.com/content/dam/mchp/documents/FPGA/ProductDocuments/UserGuides/microchip_polarfire_soc_fpga_icicle_kit_user_guide_vb.pdf page 6)</dd>
+ <dt>Connect to the 'firmware' serial console</dt>
+ <dd>sudo screen /dev/ttyUSB0 115200</dd>
+ <dt>Connect to the 'kernel' serial console</dt>
+ <dd>sudo screen /dev/ttyUSB1 115200</dd>
+ <dt>Power on the board</dt>
+ <dd>Power cycling is required here. Pressing the reset button while running the preinstalled SDK does return the board into a bootable state</dd>
+ <dd>You should see U-BOOT menu on the firmware console</dd>
+ <dd>It should then boot GRUB after a delay</dd>
+ <dd>You should see GRUB menu</dd>
+ <dd>It should then boot the default kernel after a delay on the kernel serial console</dd>
+ <dd>After a while cloud-init will run</dd>
+ <dd>Then one will be able to login</dd>
+ <dt>Login and change password</dt>
+ <dd>Login using ubuntu for both username and password</dd>
+ <dd>Reenter ubuntu password again</dd>
+ <dd>Set new password</dd>
+ <dd>Confirm the new password</dd>
+ <dt>Perform generic testing</dt>
+ <dd>Check that apt update works</dd>
+ <dd>Run any command that is not installed, check that command-not-found recommends things to install</dd>
+ <dd>e.g. hello</dd>
+ <dd>Install a package and check that it works, e.g. hello</dd>
+ <dt>Perform snap testing</dt>
+ <dd>Install a snap and check that it works, e.g. hello</dd>
+ <dt>Reboot</dt>
+ <dd>The board should reboot normally</dt>
+ <dt>Poweroff</dt>
+ <dd>Console messages should reach poweroff target</dd>
+ <dd>There should be final kernel dmsg powering off</dd>
+ <dd>Manually turn power-off from the board</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+ If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
Follow ups