#3,535 of 5,656 by stars
FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- Stars
- 14,587
- Forks
- 1,468
- Created
- 3mo ago
- Last push
- today
Momentum
- Per day
- +19
- Per 7 days
- +163
- Per 30 days
- +1.5K
- Rank, 7 days
- +40
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 12,964 |
| Oct 5, 2026 | 14,191 |
| Oct 12, 2026 | 14,424 |
| Oct 19, 2026 | 14,587 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 854
SGLang is a high-performance serving framework for large language models and multimodal models.
- 3109
- 4979
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
- 157
A high-throughput and memory-efficient inference and serving engine for LLMs
- 44
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- 51
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.