Skip to content

Conversation

@minpeter
Copy link
Contributor

Summary

Adds Friendli serverless endpoints as a new provider to models.dev.

Changes

  • Add provider configuration using @ai-sdk/openai-compatible
  • Implement auto-generation script (generate-friendli.ts)
  • Add 11 models from Friendli API:
    • 4 models with TOKEN-based pricing (Llama 3.3, Llama 3.1, Qwen3-235B, EXAONE)
    • 7 models with SECOND-based pricing (Llama 4, Qwen3, DeepSeek-R1, GLM - cost section omitted)

Technical Details

  • Auto-infer model families (llama-3.3, llama-3.1, llama-4, qwen3, deepseek-r1, exaone, glm-4)
  • Auto-detect open_weights from HuggingFace URLs and licenses
  • Handle SECOND-based pricing by omitting cost section (per-token pricing only supported)
  • Follow Venice.ai pattern for auto-generation with merge logic

Testing

  • Script runs successfully with --dry-run
  • All 11 models generated
  • Validation passes (bun validate)
  • Schema validation successful

🤖 Generated with Claude Code

minpeter and others added 4 commits December 23, 2025 19:02
- Add provider configuration for Friendli serverless endpoints
- Implement auto-generation script (generate-friendli.ts)
- Add 11 models: Llama, Qwen, DeepSeek-R1, EXAONE, GLM
- Handle TOKEN-based pricing (4 models) and SECOND-based pricing (7 models)
- Auto-infer model families and open_weights status

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Fix possible undefined array access in generate-friendli.ts
- Fix undefined type assignments in generate-venice.ts
- Use safe array access with .at() and nullish coalescing operators

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@minpeter minpeter marked this pull request as ready for review December 23, 2025 10:17
@rekram1-node rekram1-node merged commit 006d020 into sst:dev Dec 25, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants