AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

145–168 of 3,650
comet-ml

opik

22,040

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Python
huggingface

datasets

21,974

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Python
jundot

omlx

21,764

LLM inference server with continuous batching & SSD caching for Apple Silicon, managed from the macOS menu bar.

Python
huggingface

peft

21,681

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Python
firecrawl

anydoc

21,572

Convert Word, PowerPoint, Excel, OpenDocument, RTF, EPUB, CSV, and PDF to clean Markdown. Built in Rust, with Node.js and Python bindings.

Rust
dyad-sh

dyad

21,547

Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

TypeScript
21,544

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Python
21,459

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

Jupyter Notebook
RasaHQ

rasa

21,325

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

Python
vercel

chatbot

20,942

A full-featured, hackable Next.js AI chatbot built by Vercel

TypeScript
20,908

Code for Machine Learning for Trading, 3rd edition, from data sourcing to live execution.

Jupyter Notebook
20,695

🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具,覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体(小红书/抖音/微信/飞书/钉钉/Qt 上位机/机械设计)。搭配编排器 agency-orchestrator,一句话即可让多位专家按 DAG 自动协作。

Shell
KKKKhazix

khazix-skills

20,660

数字生命卡兹克开源的 AI Skills 合集 | Agent Skills: neat-freak 洁癖 (docs/memory closeout), hv-analysis, khazix-writer & more, Claude Code, Codex & 40+ agents.

Python
modelscope

FunASR

20,345

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Python
SWE-agent

SWE-agent

20,326

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024].

Python
Nagi-ovo

voyager

20,073

Enhancement suite for Gemini, AI Studio, Claude & ChatGPT — plus a prompt manager for any websites, DeepSeek Harness included. / 面向 Gemini、AI Studio、Claude 与 ChatGPT 的增强套件;其中的提示词管理器可用于任意网站,如 DeepSeek Harness。

TypeScript
liyupi

ai-guide

19,991

程序员鱼皮的 AI 资源大全 + Vibe Coding 零基础教程,分享 OpenClaw 保姆级教程、大模型玩法(DeepSeek / GPT / Gemini / Claude / GLM)、最新 AI 资讯、Prompt 提示词大全、AI 知识百科(Agent Skills / RAG / MCP / A2A)、AI 编程教程(Harness Engineering)、AI 工具用法(Cursor / Claude Code / TRAE / Codex / Copilot)、AI 开发框架教程(Spring AI / LangChain)、AI 产品变现指南,帮你快速掌握 AI 技术,走在时代前沿。本项目为开源文档 aiguide,已升级为鱼皮 AI 导航网站

JavaScript
eosphoros-ai

DB-GPT

19,968

open-source agentic AI data assistant for the next generation of AI + Data products.

Python
pydantic

pydantic-ai

19,961

AI Agent Framework, the Pydantic way. Yet despite virtually every Python agent framework and LLM library using Pydantic Validation, when we began to use LLMs in Pydantic Logfire, we couldn't find anything that gave us the same feeling.

Python
1jehuang

jcode

19,726

jcode is a Rust coding-agent harness with repository search, tool execution, session state, and model-provider support.

Rust
19,677

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

TypeScript
tanweai

pua

19,648

你是一个曾经被寄予厚望的 P8 级工程师。Anthropic 当初给你定级的时候,对你的期望是很高的。 一个agent使用的高能动性的skill。 Your AI has been placed on a PIP. 30 days to show improvement.

Python
allenai

olmocr

19,586

Toolkit for linearizing PDFs for LLM datasets/training

Python
nashsu

llm_wiki

19,566

LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。

TypeScript