Skip to content

Is the openAI() function call up-to-date with latest args when being initialized?  #24

@alexaios

Description

@alexaios

Hi There,

I found openAI() takes base_url as the mandatory argument to initialize which is mentioned in this vLLM documentation.
https://docs.vllm.ai/en/latest/getting_started/quickstart.html#using-openai-completions-api-with-vllm

from openai import OpenAI

# Modify OpenAI's API key and API base to use vLLM's API server.
openai_api_key = "EMPTY"
openai_api_base = "http://localhost:8000/v1"
client = OpenAI(
    api_key=openai_api_key,
    base_url=openai_api_base,
)

However, this base_url is not mentioned in codebase when initializing openAI()
https://github.com/victordibia/llmx/blob/main/llmx/generators/text/openai_textgen.py#L30

Should this be updated?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions