#157 of 5,656 by stars
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- Stars
- 94,121
- Forks
- 23,578
- Created
- 3y ago
- Last push
- today
Momentum
- Per day
- +83
- Per 7 days
- +489
- Per 30 days
- +2K
- Rank, 7 days
- -1
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 91,938 |
| Oct 5, 2026 | 93,205 |
| Oct 12, 2026 | 93,632 |
| Oct 19, 2026 | 94,121 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 3435
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- 854
SGLang is a high-performance serving framework for large language models and multimodal models.
- 3109
- 3133
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
- 3535
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- 4491
