#118 of 5,656 by stars
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- Stars
- 106,839
- Forks
- 16,451
- Created
- 3y ago
- Last push
- 16d ago
Momentum
- Per day
- +72
- Per 7 days
- +427
- Per 30 days
- +1.6K
- Rank, 7 days
- -1
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 105,086 |
| Oct 5, 2026 | 106,041 |
| Oct 12, 2026 | 106,412 |
| Oct 19, 2026 | 106,839 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 2535
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
- 1644
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
- 1161
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
- 2435
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
- 279
Learn AI Engineering! Learn it. Build it. Ship it for others.
- 4924
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production