awesome/repos

#1,931 of 5,656 by stars

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Open on GitHubWebsiteOpen comparison
Stars
22,919
Forks
2,163
Created
8mo ago
Last push
today

Momentum

Per day
+23
Per 7 days
+188
Per 30 days
+1K
Rank, 7 days
+5

Stars over time

21.5K22K22.5K23KSep 17Oct 5Oct 12Oct 19
View as table
DateStars
Sep 17, 202621,811
Oct 5, 202622,526
Oct 12, 202622,731
Oct 19, 202622,919

Understand this repo

Open it in a tool that explains, diagrams or digests the code.

Similar repositories

Ranked by how many distinctive topics they share with this one.

  1. 1354

    MLX: An array framework for Apple silicon

    28.8K+109 7d2.4KC++today
  2. 242

    Examples and guides for using the OpenAI API

    76.7K+118 7d13KJupyter Notebook1d ago
  3. 4085

    Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

    13.1K+4 7d1.4KPython2d ago
  4. 823

    Hundreds of models & providers. One command to find what runs on your hardware.

    38.1K+271 7d2.5KRusttoday
  5. 408

    The open-source AI voice studio. Clone, dictate, create.

    58K+980 7d7.3KPython12d ago