AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

385–408 of 3,650
7,685

"OpenSpace: The Skill Management Layer for AI Agents" -- https://open-space.cloud/

Python
EricLBuehler

mistral.rs

7,684

Fast, flexible LLM inference

Rust
mufeedvh

code2prompt

7,656

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Rust
steel-dev

steel-browser

7,648

🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.

TypeScript
tailcallhq

forgecode

7,634

AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

Rust
7,603

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

Python
7,583

A slide framework built for agents.

TypeScript
microsoft

TinyTroupe

7,572

LLM-powered multiagent persona simulation for imagination enhancement and business insights.

Jupyter Notebook
di-sukharev

opencommit

7,545

top #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models too

JavaScript
ArvinLovegood

go-stock

7,534

🦄🦄🦄AI赋能股票分析:AI加持的股票分析/选股工具。股票行情获取,AI热点资讯分析,AI资金/财务分析,涨跌报警推送。支持A股,港股,美股。支持市场整体/个股情绪分析,AI辅助选股等。数据全部保留在本地。支持DeepSeek,OpenAI, Ollama,LMStudio,AnythingLLM,硅基流动,火山方舟,阿里云百炼等平台或模型。

Go
7,525

Connect Your Agents And Harnesses With Any Provider 🦚

TypeScript
refly-ai

refly

7,519

The first open-source agent skills builder. Define skills by vibe workflow, run on Claude Code, Cursor, Codex & more. Build Clawdbot 🦞· APIs for Lovable · Bots for Slack & Lark/Feishu · Skills are infrastructure, not prompts.

TypeScript
7,515

Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.

TypeScript
LuckyOne7777

LLM-Trading-Lab

7,505

This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.

Python
flyteorg

flyte

7,487

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Go
7,459

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

JavaScript
open-compass

opencompass

7,442

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Python
traceloop

openllmetry

7,430

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Python
guardrails-ai

guardrails

7,421

Adding guardrails to large language models.

Python
apache

hertzbeat

7,397

An AI-powered next-generation open source real-time observability system.

Java
7,392

Repo to accompany my mastering LLM engineering course

Jupyter Notebook
chaitanyagiri

munder-difflin

7,382

A local multi-agent harness that works with your existing Claude Code, Codex subscriptions, allows you to run an office of agents

TypeScript
7,379

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

TypeScript
arcee-ai

mergekit

7,350

Tools for merging pretrained large language models.

Python