#2,617 of 5,656 by stars
NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
- Stars
- 18,192
- Forks
- 4,637
- Created
- 7y ago
- Last push
- today
Momentum
- Per day
- +8
- Per 7 days
- +71
- Per 30 days
- +255
- Rank, 7 days
- -3
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 17,920 |
| Oct 5, 2026 | 18,073 |
| Oct 12, 2026 | 18,121 |
| Oct 19, 2026 | 18,192 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 4407

A straightforward method for training your LLM, from downloading data to generating text.
- 3101

Automated Penetration Testing Agentic Framework Powered by Large Language Models
- 5601

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
- 1644

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- 2381

Machine Learning Engineering Open Book
- 4098

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows