mudler

mudler

LocalAI

★ 49,278

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

mudler

LocalAGI

★ 1,980

LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for OpenAI's Responses APIs with advanced agentic capabilities. No clouds. Local AI that works on consumer-grade hardware (CPU and GPU).

mudler

parakeet.cpp

★ 795

Parakeet implementation in C++ with ggml

mudler

locate-anything.cpp

★ 598

Port of Nvidia LocateAnything-3B on ggml

mudler

vllm.cpp

★ 435

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)