qemu aarch64 hangs on linux while booting (`Synchronous Exception at 0x000000013C028000`)

[bahkauv]

Description

When starting a VM, e.g. docker, with aarch64 the vm throws an error immediately and the instance is not started. Using x86_64 with basically the same configuration works, though. The EFI of the vm emits an 'Synchronous Exception' and then hangs until timeout. However, cpu load of qemu is quite high (100% on the utilized core), but this may simply be a busy loop with qemu.

Start output:

➜  ~ limactl start --name=default --set '.arch="aarch64"' template://default                                                                                                                 
WARN[0000] `--set` is experimental                      
? Creating an instance "default" Proceed with the current configuration
INFO[0001] Attempting to download the image              arch=aarch64 digest="sha256:76a0fc791ed48ea8d0325463e2748e06aa3836292df1178ee4af8daf12a643bf" location="https://cloud-images.ubuntu.com/releases/23.04/release-20230502/ubuntu-23.04-server-cloudimg-arm64.img"
INFO[0002] Using cache "/home/xxxx/.cache/lima/download/by-url-sha256/582d7b99409ea6529a8da8f663e4ea2bf2dce82a47775dc8c12916632c76f406/data" 
INFO[0002] Attempting to download the nerdctl archive    arch=aarch64 digest="sha256:589dabd962d936b29fd377dcddbb49c07d1c4c27dd4b402bc4b6b20287fe9c37" location="https://github.com/containerd/nerdctl/releases/download/v1.4.0/nerdctl-full-1.4.0-linux-arm64.tar.gz"
INFO[0002] Using cache "/home/xxxx/.cache/lima/download/by-url-sha256/8704652b907393aea54c8d98b48efa0fe9bef4d120fbbf8799bb5264631da634/data" 
INFO[0002] [hostagent] Starting QEMU (hint: to watch the boot progress, see "/home/xxxx/.lima/default/serial.log") 
INFO[0002] SSH Local Port: 60022                        
INFO[0002] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0012] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0097] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0182] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0267] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0352] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0437] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0522] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
FATA[0602] did not receive an event with the "running" status 

Environment:

➜  ~ limactl --version                   
limactl version 0.16.0
➜  ~ qemu-system-aarch64 --version
QEMU emulator version 8.0.2
Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers
➜  ~ uname -a
Linux xxxx 6.1.35-1-lts #1 SMP PREEMPT_DYNAMIC Wed, 21 Jun 2023 15:54:02 +0000 x86_64 GNU/Linux
➜  ~ cat /etc/os-release 
NAME="Arch Linux"
PRETTY_NAME="Arch Linux"
ID=arch
BUILD_ID=rolling
ANSI_COLOR="38;2;23;147;209"
HOME_URL="https://archlinux.org/"
DOCUMENTATION_URL="https://wiki.archlinux.org/"
SUPPORT_URL="https://bbs.archlinux.org/"
BUG_REPORT_URL="https://bugs.archlinux.org/"
PRIVACY_POLICY_URL="https://terms.archlinux.org/docs/privacy-policy/"
LOGO=archlinux-logo

serial.log:

UEFI firmware (version  built at 20:57:50 on May 31 2023)
BdsDxe: failed to load Boot0001 "UEFI QEMU QEMU CD-ROM " from PciRoot(0x0)/Pci(0x1,0x0)/Scsi(0x0,0x0): Not Found
BdsDxe: loading Boot0002 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x5,0x0)
BdsDxe: starting Boot0002 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x5,0x0)


Synchronous Exception at 0x000000013C028000


Synchronous Exception at 0x000000013C028000

[AkihiroSuda]

template://default

Does it work with other templates?

QEMU emulator version 8.0.2

Was it working with QEMU 7?

[bahkauv]

Ok, tested with a different archlinux box that still had an older QEMU version installed (8.0.0): This version actually started. An ubuntu 22.04 LTS using QEMU 6.2.0 works as well. However, 8.0.2 does not work. So this seems to be an issue with the most current version of QEMU.
Interestingly. the alpine aarch64 image does work with qemu 8.0.2

[jwdevelab]

I had the same issue, try using this (https://releases.linaro.org/components/kernel/uefi-linaro/16.02/release/qemu64/QEMU_EFI.fd) QEMU_EFI.fd version for -bios.