Hysen Labsggml-org
llama.cpp
llama.cpp runs LLM inference in plain C/C++, serving models locally through a REST API and web UI with multimodal support in its llama-server.
121,303 stars20,901 forksC++MIT
01
EDITORIAL BRIEF
What it solves
llama.cpp runs LLM inference in plain C/C++, serving models locally through a REST API and web UI with multimodal support in its llama-server.
The project context on this page is free to read. The original GitHub repository remains the source of truth; sign in only when you want to save or join the discussion.
02
Best fit
Community notes