This could be tricky, but if the onboarding was completely offline, this would solve potentially a few things:
- the user doesn't have to sign-in
- the user doesn't hit our servers, so there is zero cost to onboarding
- the offline mode is the hardest to set-up anyways, so if we can frontload it by having the user download a small but capable model, we can get them started.
- this would have to be for people with M1/M2 chips, since it'll be super slow on Intel CPUs.
idk if it's worth it