HYSEN LABS DIRECTORY

#Local AI

Deployment tag · curated repositories and deep analysis.

Largest Star gains over the past seven days, from our daily GitHub snapshots.

  1. ggml-org/llama.cpp+1,292 this week
  2. ollama/ollama+855 this week
  3. open-webui/open-webui+631 this week
  4. RVC-Boss/GPT-SoVITS+574 this week
  5. Mintplex-Labs/anything-llm+236 this week

Latest discussions

Posts on Hacker News, dev.to and Lobsters that link to a project listed here.

  1. Why Your 19.5GB LLM Crawls on 24GB VRAM (The KV Cache Fix)dev.to · Nov 14 · 3 points · llama.cpp
  2. Benchmarking the Gemini Decisions APIdev.to · Nov 13 · 11 points · llama.cpp
  3. Jensen is out. CUDA isn't. A Developer's Guide to Everything Nvidia Builtdev.to · Nov 13 · 7 points · llama.cpp
  4. Six Serving Engines on Four Accelerators: Gemma 4 E2B on an RTX 3050, a T4, an L4 and a TPU v5edev.to · Nov 13 · 14 points · llama.cpp
  5. llama.cpp v1.0Hacker News · Nov 13 · 5 points · llama.cpp
6 curated open-source projects
open-webui

open-webui

★ 158,573

Open WebUI is a self-hosted AI interface that runs entirely offline, supporting Ollama and OpenAI-compatible APIs with a built-in inference engine for RAG.

PythonAI & Machine Learning23,055 forks6 min read
ggml-org

llama.cpp

★ 134,864

llama.cpp runs LLM inference in plain C/C++, serving models locally through a REST API and web UI with multimodal support in its llama-server.

C++AI & Machine Learning25,568 forks6 min read
RVC-Boss

GPT-SoVITS

★ 64,973

GPT-SoVITS is a few-shot voice cloning and TTS WebUI that fine-tunes a speaker's voice from one minute of audio and supports zero-shot synthesis from a five-second sample.

PythonAI & Machine Learning6,800 forks6 min read
ggml-org

whisper.cpp

★ 55,166

whisper.cpp is a dependency-free C/C++ port of OpenAI's Whisper speech-recognition model, optimized for Apple Silicon and supporting CPU-only inference on many platforms.

C++AI & Machine Learning6,298 forks6 min read