microsoft/WSL#11946 (comment)
seems to state that commenting a line in /usr/lib/systemd/system/systemd-binfmt.service.d/wsl.conf allows binfmt to work, and it's apparently Ubuntu's fault? If so I'd like to track the issue here, or continue the discussion there.