Azure OpenAI model connection

[Harshitha-HM1999]

Hello Team!

Thank you for the fantastic package! I am currently trying to use the Azure OpenAI model for my testing but am encountering connection issues. I noticed that LiteLLM support has been added, and it would be greatly appreciated if you could provide a code snippet or documentation that guide us in connecting the package with Azure OpenAI providers.

Thank you!

[Harshitha-HM1999]

Hello Team,

I previously reported an issue regarding the Azure OpenAI connection, but I was able to resolve it, however later when I gone through the logs, I still discovered errors related to the provider. I have attached a screenshot of the errors for your reference. Since the issue isn't fully isolated, I would appreciate any suggestions you might have to help resolve it. Please let me know if you need some more details.

Error:

[2025-06-07 12:54:31,381 - plexe.internal.common.provider - ERROR - (MainThread)]: - Error querying provider: RetryError[<Future at 0x2018d4c8c50 state=finished raised APIError>]
[2025-06-07 12:54:31,401 - plexe.internal.common.utils.chain_of_thought.callable - WARNING - (MainThread)]: - Error generating friendly summary: RetryError[<Future at 0x2018d4c8c50 state=finished

Thank you!

[isaacdalmarco]

Hi @Harshitha-HM1999, could you please share your code for azure connection?

[karasto97]

Hi @isaacdalmarco
provider_config = ProviderConfig(
default_provider="azure/gpt-4o-mini",
research_provider="azure/gpt-4o-mini", # For complex planning
engineer_provider="azure/gpt-4o-mini", # For code generation
orchestrator_provider="azure/gpt-4o-mini",
ops_provider="azure/gpt-4o-mini",
tool_provider="azure/gpt-4o-mini", # For internal tools/helpers
)

model.build(
datasets=datasets_to_use,
provider=provider_config,
max_iterations=3
)

....
at the same env pure litellm works well
.......
from litellm import completion

resp = completion(
model="azure/gpt-4o-mini",
messages=[{"role": "user", "content": "ping"}],
timeout=60
)
print(resp.choices[0].message)