Welcome to ScalingOpt (Optimization Community), a dedicated community for advancing efficient AI through optimization methods, scalable algorithms, and resource-aware model design.
If this repository has been helpful to you, please consider giving it a ⭐️ to show your support. Your support helps us reach more researchers and contributes to the growth of this resource. Thank you!
[2026.2] ScalingOpt's latest optimizer, Mano, is now officially released! Authored by Yufei Gu.
[2026.1] We are always welcoming new members to join us. ScalingOpt has now supplemented the A-Summary-Sheet-of-Optimization-in-Deep-Learning (collecting over 100 types of optimizers), authored by Yifeng Liu.
[2025.12] ScalingOpt team has published its first blog post: Backbone-Optimizer Coupling Bias: The Hidden Co-Design Principle. Welcome to read it!
[2025.11] ScalingOpt has been officially released and is currently undergoing continuous improvement and expansion of its content. Please stay tuned!
Join our growing community of optimization researchers and practitioners:
- GitHub Discussions: Technical discussions and Q&A
- Research Collaboration: Connect with other researchers
- Blog Posts: Share your optimization insights
- Tutorial Contributions: Help others learn optimization
We thank the optimization research community for their groundbreaking work and contributions. Special thanks to:
- All researchers who developed the optimization algorithms featured in this platform