Make sure FP16 is enabled in TVM and check its perf gain for Stable Diffusion (https://mlc.ai/web-stable-diffusion/).