Skip to content

feature request: multiple "generic" providers #640

@dgdevel

Description

@dgdevel

Hello again!
I am building a coding team project, and wanted to mix multiple llm and decide what is the best fitting for each role.
My problem: i am using a combo of "generic" provider (z.ai coding plan paas endpoint, mistral.ai and local llama.cpp), but I can really define only one.
If I try to add my own keys to secrets I get the following error:

Model Configuration Error:
Unknown model or provider for: mistral.codestral-latest.high. Model name parsed as 'mistral.codestral-latest'

Any chance to have multiple generic providers or as alternative, treat any unsupported key in secrets as another separate instance of generic?
Thank you!

Metadata

Metadata

Assignees

Labels

featureFeature Request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions