AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,897–1,920 of 3,650
asklokesh

loki-mode

1,065

Multi-agent autonomous SDLC framework. Spec to deployed app. PRD, GitHub issue, OpenAPI/JSON/YAML, or one-line brief. 5 AI providers, 8 quality gates.

Shell
local-inference-lab

rtx6kpro

1,065

RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink

Python
1,065

Agent memory for LLMs: 30 runnable Jupyter notebooks covering conversation buffers, vector stores, knowledge graphs, episodic and semantic memory, MemGPT, Mem0, Letta, Zep, Graphiti, LoCoMo benchmarks, and production patterns.

Jupyter Notebook
1,065

Open-source, self-hosted Claude Code - a terminal AI assistant and the Python framework behind it. Tool-calling, sandboxed execution, multi-agent teams, skills, checkpoints, unlimited context - on Pydantic AI, any model.

Python
zai-org

GLM-TTS

1,063

GLM-TTS: Controllable & Emotion-Expressive Zero-shot TTS with Multi-Reward Reinforcement Learning

Python
JudgmentLabs

judgeval

1,062

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

Python
1,062

The MATLAB Agentic Toolkit brings trusted MATLAB capabilities to AI agents, making engineering and scientific workflows agent-ready.

MATLAB
MayDay-wpf

snow-cli

1,062

Agentic coding in your terminal,Simultaneously compatible with OpenAI, Gemini, and Claude.运行在终端的 AI 编程智能体,同时兼容 Deepseek、OpenAI、Gemini和Claude。

TypeScript
agents-flex

agents-flex

1,061

Agents-flex is A lightweight Java AI agent development framework (positioned as a counterpart to Spring AI). It supports features such as RAG, MCP, Skills, Text2SQL , LLM Wiki, Sub-agents, Web Search, TTS (synchronous and streaming), and STT.

Java
1,061

A complete, structured hub for learning Artificial Intelligence — covering AI, Machine Learning, Deep Learning, and Data Science with books, roadmaps, and curated resources from beginner to advanced.

meta-llama

prompt-ops

1,061

An open-source tool for LLM prompt optimization.

Python
rogue-security

rogue

1,061

AI Agent Evaluator & Red Team Platform

Python
juanjuandog

FinSight-AI

1,060

AI equity research agent with resilient workflows, evidence-grounded RAG, versioned reports, and automated quality evaluation.

Java
Muuuun

luxas

1,060

An autonomous research colleague — from a question to a compiled manuscript, while you sleep.

TypeScript
yokingma

SearChat

1,060

Search + Chat = SearChat(AI Chat with Search), Support OpenAI/Anthropic/VertexAI/Gemini, DeepResearch, SearXNG, Docker. AI对话式搜索引擎,支持DeepResearch, 支持OpenAI/Anthropic/VertexAI/Gemini接口、聚合搜索引擎SearXNG,支持Docker一键部署。

TypeScript

🐙 关于提示词工程(prompt)的指南、论文、讲座、笔记本和资源大全(自动持续更新)

MDX
arcee-ai

DistillKit

1,058

An Open Source Toolkit For LLM Distillation

Python
philippgille

chromem-go

1,058

Embeddable vector database for Go with Chroma-like interface and zero third-party dependencies. In-memory with optional persistence.

Go
YuJunZhiXue

dsh-purge

1,058

DeepSeek Harness 破甲:让所有模型都能破甲,不同模型可换不同提示词;默认提示词面向国模「小码酱」。Jailbreak for every model — swap prompts per model. 求 Star 收藏 ⭐

JavaScript
PatterAI

Patter

1,057

Open-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack. Give your AI agent a phone number in 4 lines — Python and TypeScript, MIT licensed, Twilio, Telnyx, and Plivo.

Python
pikpikcu

airecon

1,057

AIRecon is an autonomous cybersecurity agent that combines a self-hosted Large Language Model (Ollama) with a Kali Linux Docker sandbox and a Textual TUI. It is designed to automate security assessments, penetration testing, and bug bounty reconnaissance — without any API keys or cloud dependency.

Python
Vincentwei1021

video-talkcraft

1,057

Agent skill that turns Claude Code / Codex into a motion-design studio for voiceover-driven explainer videos — word-level voiceover sync, 109 motion recipe cards, an anti-slideshow camera system, Remotion rendering.

HTML
InternRobotics

PointLLM

1,054

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

Python
jonwiggins

optio

1,052

Workflow orchestration for AI coding agent swarms, from task to merged PR.

TypeScript