awesome/repos

#854 of 5,656 by stars

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Open on GitHubWebsiteOpen comparison
Stars
37,361
Forks
9,685
Created
2y ago
Last push
today

Momentum

Per day
+97
Per 7 days
+325
Per 30 days
+1.2K
Rank, 7 days
+13

Stars over time

36K36.5K37K37.5KSep 17Oct 5Oct 12Oct 19
View as table
DateStars
Sep 17, 202636,059
Oct 5, 202636,790
Oct 12, 202637,036
Oct 19, 202637,361

Understand this repo

Open it in a tool that explains, diagrams or digests the code.

Similar repositories

Ranked by how many distinctive topics they share with this one.

  1. 3535

    FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

    14.6K+163 7d1.5KPythontoday
  2. 157

    A high-throughput and memory-efficient inference and serving engine for LLMs

    94.1K+489 7d23.6KPythontoday
  3. 3435

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    14.9K+57 7d2.8KPythontoday
  4. 44

    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    183.8K+954 7d18.4KGo1d ago
  5. 51

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    167.8K+275 7d34.9KPythontoday
  6. 3109
    16K+193 7d2.9KPython5mo ago