Add GitHub Actions workflows for model availability testing #4
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This PR implements automated model availability testing for the Deep.Assistant API using GitHub Actions, addressing issue #3.
What's Included
Model Checker Scripts
check_models.py- Python-based async model checker using aiohttpcheck_models.js- JavaScript-based model checker using OpenAI SDKGitHub Actions Workflows
Python Model Testing (
.github/workflows/check-models-python.yml)JavaScript Model Testing (
.github/workflows/check-models-javascript.yml)Combined Testing (
.github/workflows/check-all-models.yml)Models Tested
o3-mini,o1-preview,o1-mini,gpt-4o,gpt-4o-mini,gpt-3.5-turbo,gpt-autoclaude-3-opus,claude-3-5-sonnet,claude-3-5-haiku,claude-3-7-sonnetdeepseek-chat,deepseek-reasonerFeatures
Configuration Required
To enable the workflows, add the following repository secret:
OPENAI_API_KEY- Your Deep.Assistant API key (obtain from @DeepGPTBot using/apicommand)Optional repository variable:
OPENAI_API_BASE- Custom API base URL (defaults tohttps://api.deep.assistant.run.place/v1)Testing
The scripts can be tested locally before running in CI:
Files Changed
.github/workflows/check-all-models.yml- Combined testing workflow.github/workflows/check-models-javascript.yml- JavaScript testing workflow.github/workflows/check-models-python.yml- Python testing workflowcheck_models.py- Python model checkercheck_models.js- JavaScript model checkerpackage.json- JavaScript dependenciesrequirements.txt- Python dependenciesREADME.md- Documentation updatesFixes
Closes #3
🤖 Generated with Claude Code
Co-Authored-By: Claude noreply@anthropic.com