Add OpenRouter connection tester with GitHub Action #5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Adding CLAUDE.md with task information for AI processing. This file will be removed when the task is complete. Issue: #2
Implements model availability testing for OpenRouter API similar to existing PiAPI tests. Both scripts test a curated list of popular models including frontier reasoning models, specialized coding models, multimodal vision models, and efficient open models. Features: - Parallel testing of multiple models - Detailed status reporting with response times - Markdown table output for easy reading - Model validation to ensure correct model responses 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Implements automated CI/CD testing for both PiAPI and OpenRouter models: - test-openrouter.yml: Tests OpenRouter model availability - test-piapi.yml: Tests PiAPI model availability Features: - Scheduled runs every 6 hours for continuous monitoring - Manual workflow dispatch with language selection (JavaScript/Python/both) - Artifact upload for test results (30-day retention) - Job summary with recent results - Failure detection and warnings Both workflows support testing in JavaScript and Python with parallel job execution. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Enhances README with detailed information about model testing capabilities: - Added feature overview highlighting automated testing and dual provider support - Documented both PiAPI and OpenRouter testing scripts - Included clear usage instructions for both JavaScript and Python - Added API key acquisition instructions for both providers - Documented GitHub Actions workflows and their capabilities - Improved overall structure and navigation The README now serves as a complete guide for using the testing tools. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
konard
changed the title
This reverts commit 648375a.
Contributor
Author
🤖 Solution Draft LogThis log file contains the complete execution trace of the AI solution draft process. 💰 Cost estimation:
Now working session is ended, feel free to review and add any feedback on the solution draft. |
Contributor
Author
🔄 Auto-restart 1/3Detected uncommitted changes from previous run. Starting new session to review and commit them. Uncommitted files: Auto-restart will stop after changes are committed or after 2 more iterations. Please wait until working session will end and give your feedback. |
Clean up .gitignore to prevent Python cache files (__pycache__, *.pyc, etc.) from being tracked in the repository. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Contributor
Author
🤖 Solution Draft LogThis log file contains the complete execution trace of the AI solution draft process. 💰 Cost estimation:
Now working session is ended, feel free to review and add any feedback on the solution draft. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This PR implements OpenRouter model availability testing similar to the existing PiAPI tests, adding comprehensive monitoring capabilities for the OpenRouter API gateway.
Changes Made
1. OpenRouter Testing Scripts
test-openrouter-models.mjs- JavaScript implementation using Node.jstest-openrouter-models.py- Python implementation using asyncio/aiohttpBoth scripts test a curated list of 30+ popular OpenRouter models including:
2. GitHub Actions Workflows
.github/workflows/test-openrouter.yml- Automated OpenRouter model testing.github/workflows/test-piapi.yml- Automated PiAPI model testing (bonus!)Features:
3. Documentation
Testing Approach
The OpenRouter scripts follow the same proven pattern as the PiAPI tests:
API Compatibility
OpenRouter uses OpenAI-compatible API endpoints at:
https://openrouter.ai/api/v1Setup Required
To enable the workflows, add the following repository secret:
OPENROUTER_API_KEY- OpenRouter API key from https://openrouter.ai/keysFor PiAPI workflow:
PIAPI_API_KEY- PiAPI API key from Telegram botManual Testing
Users can run the scripts locally:
Related Issue
Fixes #2
🤖 Generated with Claude Code