AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

3,457–3,480 of 4,156
OpenSparX

MasterAgent

451

Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.

C++
zhongkaifu

TensorSharp

451

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

C#
duxweb

codux

450

⬛ A native connected terminal for AI agent development. 为 AI Agent 开发而生的原生互联终端。

Rust
edouard-claude

snip

450

CLI proxy that reduces LLM token usage by 60-90%. Declarative YAML filters for Claude Code, Cursor, Copilot, Gemini. rtk alternative in Go.

Go
450

基于LangChain、FastAPI和React的RAG项目,主分支为基于知识图谱的知识管理平台,base-rag分支为开箱即用的基础RAG项目供学习使用

Python
strongshuai

proxy-checker

450

Proxy Checker 是一个自托管优先的免费代理检测、筛选、仓库维护工具。你可以把它理解成一个给代理池做体检的小面板:拉取持续更新的公共代理源,批量检测 HTTP、HTTPS、SOCKS4、SOCKS5、SOCKS5H,把真正有用的代理放进“我的仓库”,再生成稳定的 TXT / JSON 链接给脚本、服务或其他工具直接拉取。 如果你经常折腾代理、跑号服务器、API 连通性。

Python
xybrid-ai

xybrid

450

Cross-platform on-device AI toolkit

Rust
GenielabsOpenSource

spine-animation-ai

449

AI-powered Claude skill for Spine 2D skeletal animation — auto-rig, animate, and preview characters

Python
astronomer

agents

448

AI agent tooling for data engineering workflows.

Python
echogarden-project

echogarden

448

Cross-platform speech toolset, used from the command-line or as a Node.js library. Includes a variety of engines for speech synthesis, speech recognition, forced alignment, speech translation, voice isolation, language detection and more.

TypeScript
ImDarkTom

LlamaPen

448

A no-install needed GUI for Ollama and other local LLM providers.

Vue
tomascupr

sandstorm

448

Run Claude agents in secure cloud sandboxes — via API, CLI, or Slack. One call. Full agent. Zero infrastructure.

Python
Gan-Xing

CodexBridge

447

WeChat-to-Codex bridge for running Codex app-server from chat, with threads, slash commands, approvals, agents, automation, uploads, and assistant records.

TypeScript
gaotiexinqu

OneResearchClaw

447

Any research. One Claw. 🦞 From any materials to research with fully autonomous & skill-driven researcher.

Python
nejib1

Free-LLM

447

Directory of 34+ free LLM & AI APIs — permanent free tiers, trial credits, and no-card options. GPT-4o, Gemini, Claude, Llama, DeepSeek, Mistral & more. Synced daily from the live directory at free-llm.com.

JavaScript
ThunderAgent-org

ThunderAgent

447

A simple, fast and robust program-aware agentic inference system.

Python
AIProxyTeam

AIProxySwift

446

Swift clients for AI providers. You can make requests straight to the provider or proxied through our abuse protection backend

Swift
CodeSoul-co

Hypha

446

Harness-oriented agent system framework for production-grade LLM agent applications

TypeScript
composio-community

open-chatgpt-atlas

446

Open Source and Free Alternative to ChatGPT Atlas.

TypeScript
leancodepl

marionette_mcp

446

MCP server enabling AI agents to interact with Flutter apps at runtime - let them inspect widgets, simulate taps, enter text, scroll, and take screenshots.

Dart

AI-Native 工程师招聘面试官手册 · Builder / Reviewer 双岗评分 · AI 驾驶能力实操考核 · 易哈佛医疗

HTML
agentverse-os

AgentVerse-OS

445

Personal cloud OS for a developer and their AI agents on a single server. One-command install on Ubuntu, then everything in the browser: a windowed desktop, isolated workspaces with VS Code, Claude Code and Codex, a store of 944 self-hosted apps, backups and updates. Access only via Tailscale, nothing exposed to the internet. Rust core, Svelte UI.

Rust
Dicklesworthstone

ntm

445

Named Tmux Manager: spawn, tile, and coordinate multiple AI coding agents (Claude, Codex, Gemini) across tmux panes with a TUI command palette

Go