Megatron-LM
by NVIDIA (organization)
Ongoing research training transformer models at scale (description from the project’s GitHub page)
Repository facts
- Stars
- 18,188
- Forks
- 4,634
- Open issues and pull requests
- 1,651
- Primary language
- Python
- License
- Other license
- Owner
- NVIDIA · Organization
- Created
- Mar 21, 2019
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/nvidia--megatron-lm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/nvidia--megatron-lm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/nvidia--megatron-lm.svg" alt="Ranked #450 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 618: neuml/txtai
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
13,024 starsPythonApache-2.0Last push Oct 16, 2026
Rank 660: FareedKhan-dev/train-llm-from-scratch
A straightforward method for training your LLM, from downloading data to generating text.
12,176 starsPythonMITLast push Oct 2, 2026
Rank 811: OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
10,095 starsPythonApache-2.0Last push Oct 5, 2026
Rank 1,323: amazon-science/chronos-forecasting
Chronos: Pretrained Models for Time Series Forecasting
6,135 starsPythonApache-2.0Last push Oct 5, 2026
Rank 1,473: imoneoi/openchat
OpenChat: Advancing Open-source Language Models with Imperfect Data
5,484 starsPythonApache-2.0Last push Sep 13, 2024