
Sophia
by Liuhong99 (personal account)
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training” (description from the project’s GitHub page)
Repository facts
- Stars
- 1,000
- Forks
- 57
- Open issues and pull requests
- 8
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- Liuhong99 · Personal account
- Created
- May 23, 2023
- Last push
- Jan 30, 2024
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/liuhong99--sophia/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/liuhong99--sophia/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/liuhong99--sophia.svg" alt="Ranked #6,117 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 7,309: microsoft/Trace
End-to-end Generative Optimization for AI Agents
762 starsPythonMITLast push Jun 17, 2026
Rank 7,557: AGI-Arena/MARS
The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
724 starsPythonApache-2.0Last push Mar 26, 2026
Rank 6,943: sail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
823 starsPythonApache-2.0Last push Jun 8, 2025
Rank 138: ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
44,061 starsPythonApache-2.0Last push Oct 18, 2026
Rank 457: camel-ai/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
17,926 starsPythonApache-2.0Last push Oct 12, 2026
Rank 592: Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
13,715 starsPythonApache-2.0Last push Oct 13, 2026