docs: global model provider feature #11231

mendonk · 2026-01-07T17:33:46Z

Preview build
The global model provider pane changes how Language models are selected for agents, the language model component, and embedding model components.

This pull request adds a partial for instructions on setting up and using the global provider pane, and adds the partial to tasks where needed.

Some changes to tasks based on this change too.

Added release note.

coderabbitai · 2026-01-07T17:33:53Z

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Post copyable unit tests in a comment
Commit unit tests in branch docs-global-model-provider

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

…low-ai/langflow into docs-global-model-provider

github-actions · 2026-01-07T18:34:52Z

Build successful! ✅
Deploying docs draft.
Deploy successful! View draft

deon-sanchez

im gonna approve so youre not blocked, but i need to confirm with design about the final implementation of this feature, as noted in the comments we will be making some minor updates (hopefully wont have too much impact on what weve already built).

deon-sanchez · 2026-01-07T19:56:42Z

docs/docs/_partial-global-model-providers.mdx

+
+To configure your model providers globally, do the following:
+
+1. To open the **Model providers** pane, click <Icon name="BrainCog" aria-hidden="true" /> **Models** in the Langflow header.


need to confirm with design, but i think we are removing the header model button and moving it back to the settings page.

deon-sanchez · 2026-01-07T19:58:42Z

docs/docs/Components/components-models.mdx

 For example, if you are using the **Language Model** core component, you could try an Anthropic model.

+    To switch models:
+    1. To open the **Model providers** pane, click <Icon name="BrainCog" aria-hidden="true" /> **Models** in the Langflow header.


need to talk to design but this might be moved to the settings page

deon-sanchez · 2026-01-07T19:59:24Z

docs/docs/Components/components-models.mdx

+
+    * **Connect other models**: Connect a custom language model component to use models that aren't available in the global model providers list.
+    * **Manage Model Providers** <Icon name="Settings" aria-hidden="true" />: Opens the **Model providers** pane where you can configure API keys and enable or disable models.
+    * **Refresh List**: Refreshes the current list of available models.


we will probably remove this, since we have dynamic refreshing after adding an api key.

aimurphy

Sorry this took a while. I think there are some opportunities to streamline the wording.

aimurphy · 2026-01-07T19:51:47Z

docs/docs/_partial-global-model-providers.mdx

+3. In the **API Key** field, add your provider's API key.
+4. Toggle on the specific models you want to enable from the list of available models for that provider.
+Models are grouped into **LLM Models** and **Embedding Models** sections.
+If a provider doesn't have any language models available, they aren't listed in the Agent component.


is this supposed to specify "Agent component"?

aimurphy · 2026-01-07T19:52:58Z

docs/docs/Agents/agents.mdx

-* Set **Model Provider** to **Connect other models**, and then connect any [language model component](/components-models).
-* Select your preferred provider, type the complete model name into the **Model Name** field, and then select your custom option from the **Model Name** menu.
-Make sure that the model is enabled/verified in your model provider account.
+To use a model with the **Agent** component, select the configured model from the **Agent** component's **Language Model** dropdown.


Suggested change

To use a model with the **Agent** component, select the configured model from the **Agent** component's **Language Model** dropdown.

To use a model with the **Agent** component, select the model in the **Agent** component's **Language Model** field.

aimurphy · 2026-01-07T19:54:08Z

docs/docs/Agents/agents.mdx

+To use a model with the **Agent** component, select the configured model from the **Agent** component's **Language Model** dropdown.

-If you need to generate embeddings in your flow, use an [embedding model component](/components-embedding-models).
+The **Agent** component displays all language models that you've configured globally. If a provider doesn't have any language models available, they won't be listed.


Suggested change

The **Agent** component displays all language models that you've configured globally. If a provider doesn't have any language models available, they won't be listed.

The **Language Model** field lists all language models that you've configured globally. If a provider doesn't have any language models available, they aren't listed.

For example, if a provider offers only embeddings models, those models aren't listed on the **Agent** component.

aimurphy · 2026-01-07T19:54:34Z

docs/docs/Components/components-embedding-models.mdx

-You can enter the API key directly or use a <Icon name="Globe" aria-hidden="true"/> [global variable](/configuration-global-variables).
+2. <PartialGlobalModelProviders />
+
+    If a provider doesn't have any embedding models available, they won't be listed in the **Embedding Model** component.


this duplicates a line from the partial.

aimurphy · 2026-01-07T19:54:59Z

docs/docs/Components/components-embedding-models.mdx

+
+    If a provider doesn't have any embedding models available, they won't be listed in the **Embedding Model** component.

    :::tip My preferred provider or model isn't listed


You probably want to edit this tip to account for the new global config.

aimurphy · 2026-01-07T21:32:18Z

docs/docs/_partial-global-model-providers.mdx

+4. Toggle on the specific models you want to enable from the list of available models for that provider.
+Models are grouped into **LLM Models** and **Embedding Models** sections.
+If a provider doesn't have any language models available, they aren't listed in the Agent component.


Suggested change

4. Toggle on the specific models you want to enable from the list of available models for that provider.

Models are grouped into **LLM Models** and **Embedding Models** sections.

If a provider doesn't have any language models available, they aren't listed in the Agent component.

4. Enable the specific models that you want to use in Langflow.

The available models depends on the provider and your API key's permissions.

Models that generate text are listed under **LLM Models**.

Models that generate embeddings are listed under **Embedding Models**.

aimurphy · 2026-01-07T21:35:14Z

docs/docs/_partial-global-model-providers.mdx

+Models are grouped into **LLM Models** and **Embedding Models** sections.
+If a provider doesn't have any language models available, they aren't listed in the Agent component.
+
+Models are now configured globally and available to all components in your flows.


Suggested change

Models are now configured globally and available to all components in your flows.

After you enable a model in Langflow's global model configuration, you can use that model in any model-driven component in your flows.

aimurphy · 2026-01-07T21:37:16Z

docs/docs/Support/release-notes.mdx

+
+- Global model provider configuration
+
+    Model providers for language models, embedding models, and agents are now configured globally in the **Model providers** pane, instead of within individual components.


I think you could just use the partial here because you have it anyway and it says all of this stuff anyway :)

aimurphy · 2026-01-07T21:40:23Z

docs/docs/Support/release-notes.mdx

+    Enable models once and then use them in any component across your flows.
+    For more information, see [Language Model component](/components-models).
+
+    If you need to use per-component API keys for different model providers in the same flow, use [bundle components](/components-bundle-components).


this sentence isn't clear. does it mean multiple keys for the same provider or other non-global providers?

If the latter, it might be easier to just reuse the tip from here https://github.com/langflow-ai/langflow/pull/11231/files#diff-0fb70484040c61f09d50109c82fb937a1e5a915433846817347a5b5812daf05dR32 as a new partial or add to the existing partial.

aimurphy · 2026-01-07T21:42:36Z

docs/docs/_partial-global-model-providers.mdx

+
+1. To open the **Model providers** pane, click <Icon name="BrainCog" aria-hidden="true" /> **Models** in the Langflow header.
+2. In the **Model providers** pane, select a provider from the list.
+3. In the **API Key** field, add your provider's API key.


I'm not sure if you can add more than one key per provider.

Suggested change

3. In the **API Key** field, add your provider's API key.

3. In the **API Key** field, add your provider's API key.

The key must have permission to call the models you want to use in your flow, and your account must have sufficient credits for the actions you want to perform.

You can only add one key for each provider. Make sure the key has access to _all_ models that you want to use in Langflow.

mendonk · 2026-01-07T21:59:07Z

docs/docs/_partial-global-model-providers.mdx

+2. In the **Model providers** pane, select a provider from the list.
+3. In the **API Key** field, add your provider's API key.
+4. Toggle on the specific models you want to enable from the list of available models for that provider.
+Models are grouped into **LLM Models** and **Embedding Models** sections.


This text will likely change

mendonk added 2 commits January 7, 2026 11:33

initial-changes-to-model-providers

fd12b85

Merge branch 'main' into docs-global-model-provider

ed88425

Merge branch 'docs-1.8-release' into docs-global-model-provider

2c7226e

github-actions bot added the documentation Improvements or additions to documentation label Jan 7, 2026

mendonk changed the title ~~docs: global provider feature~~ docs: global model provider feature Jan 7, 2026