General LLM Inference

[Maclean-D]

Would like the "General LLM Inference" to use the OpenAI Schema so you could ideally drop it in as a replacement by just changing the url and model name. Also being able to schedule run apps/requests via the mac app would be a huge plus

[Maclean-D]

Also a speech model would be very useful, even just a stt service don't necessarily also need tts

[dylan-deepshard]

Thank you for the feedback! We are definitely looking into STT and scheduling!