#3,435 of 5,656 by stars
NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- Stars
- 14,858
- Forks
- 2,835
- Created
- 3y ago
- Last push
- today
Momentum
- Per day
- +12
- Per 7 days
- +57
- Per 30 days
- +213
- Rank, 7 days
- 0
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 14,631 |
| Oct 5, 2026 | 14,762 |
| Oct 12, 2026 | 14,801 |
| Oct 19, 2026 | 14,858 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 157
A high-throughput and memory-efficient inference and serving engine for LLMs
- 854
SGLang is a high-performance serving framework for large language models and multimodal models.
- 3361
- 1675
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
- 3535
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
- 1105
facebookresearch/fairseqArchivedFacebook AI Research Sequence-to-Sequence Toolkit written in Python.