Bonsai-demo

GitHub describes it as Bonsai Demo. The repository metadata lists Shell as its primary language. The metadata lists the Apache-2.0 license. This article stays within the project description and details documented in the GitHub repository README.

GitHub describes it as Bonsai Demo. The repository metadata lists Shell as its primary language. The metadata lists the Apache-2.0 license. The README describes the project this way: Using this demo repository you can run Bonsai (1-bit) and Ternary-Bonsai language models locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU.

The README section "🌱 New: Bonsai 27B" states: The family's newest and largest generation, and its first vision-language models (Bonsai 27B collection):

The README section "🌱 New: Bonsai 27B" states: - Vision: send photos, screenshots, and PDFs; ask about them (see VISION.md). - Agentic tool calling: native OpenAI-style tool calls with full round-trips, plus MCP servers in both demo UIs (see TOOLS.md). - Thinking: a reasoning model; pick the reasoning effort per chat in the UI or budget it per request. - Long context: 256k+ token conversations. - Tiny footprint: the 1-bit Bonsai-27B packs to ~1.125 bits per weight: it fits on a modern iPhone without memory offloading. Ternary-Bonsai-27B (~1.7 bits per weight, packed into 2-bit for fast accelerated kernels) is the higher-quality option and this demo's default.

The README section "🌱 New: Bonsai 27B" states: Quick Start below gets you there in two commands: ./setup.sh downloads Ternary-Bonsai-27B by default, then ./scripts/start llama server.sh gives you chat, vision, and tools at http://localhost:8080.

The repository README is the source for this review. It does not replace a local installation or an independent test.

• Source 1 · Project repository
• Source 2 · README