shimmy
Pure-Rust WebGPU inference engine, OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
What it solves
Pure-Rust WebGPU inference engine, OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
The project context on this page is free to read. The original GitHub repository remains the source of truth; sign in only when you want to save or join the discussion.
Best fit
Teams evaluating AI & Machine Learning and Developer Tools
Community notes