-
Notifications
You must be signed in to change notification settings - Fork 392
Open
Labels
featureFeature RequestFeature Request
Description
Hello again!
I am building a coding team project, and wanted to mix multiple llm and decide what is the best fitting for each role.
My problem: i am using a combo of "generic" provider (z.ai coding plan paas endpoint, mistral.ai and local llama.cpp), but I can really define only one.
If I try to add my own keys to secrets I get the following error:
Model Configuration Error:
Unknown model or provider for: mistral.codestral-latest.high. Model name parsed as 'mistral.codestral-latest'
Any chance to have multiple generic providers or as alternative, treat any unsupported key in secrets as another separate instance of generic?
Thank you!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
featureFeature RequestFeature Request