awesome/repos

Collections · For builders

Run AI on Your Own Machine

The pieces for running language and image models locally instead of through a hosted API.

Last reviewed Oct 2, 2026. Open in the explorer to search and filter within it.

  1. 1

    LLM inference in C/C++

    The inference engine many local tools are built on; runs models on CPUs and consumer GPUs.

    131.7K+763 7d24.5KC++today
  2. 2

    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    Download and run models with one command, behind a local API.

    183.8K+954 7d18.4KGo1d ago
  3. 3

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    A chat interface for local models, with Ollama and OpenAI-compatible backends.

    156.1K+1.7K 7d22.7KPython1d ago
  4. 4

    The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.

    Node-based workflows for image and video generation models.

    139.1K+2K 7d16.5KPythontoday
  5. 5

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    A self-hosted, OpenAI-compatible API in front of local models.

    49.6K+150 7d4.5KGotoday
  6. 6

    A high-throughput and memory-efficient inference and serving engine for LLMs

    High-throughput model serving, for when one machine has to serve many requests.

    94.1K+489 7d23.6KPythontoday