AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,249–1,272 of 4,628
sonos

tract

★ 3,077

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Rust
containers

ramalama

★ 3,066

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Python
datawhalechina

hugging-llm

★ 3,062

HuggingLLM, Hugging Future.

Jupyter Notebook
MemMachine

MemMachine

★ 3,058

Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.

Python
motiful

cc-gateway

★ 3,056

AI API identity gateway — reverse proxy that normalizes device fingerprints and telemetry for privacy-preserving API proxying

TypeScript
★ 3,047

AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.

Python
pinecone-io

examples

★ 3,045

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

Jupyter Notebook
LLMQuant

quant-mind

★ 3,043

QuantMind is an agent-native knowledge extraction and retrieval framework for quantitative finance.

Python
FreedomIntelligence

OpenClaw-Medical-Skills

★ 3,042

The largest open-source medical AI skills library for OpenClaw🦞.

Python
collabs-inc

collab-public

★ 3,041

Collaborator is a place to create with agents.

TypeScript
OpenNSWM-Lab

FAROS

★ 3,041

A blueprint-driven AutoResearch runtime for orchestrating AI research workflows from idea generation and experiments to paper writing and peer review.

Python
★ 3,039

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

JavaScript
ianarawjo

ChainForge

★ 3,032

An open-source visual programming environment for battle-testing prompts to LLMs.

TypeScript
xyproto

algernon

★ 3,032

Small self-contained pure-Go web server with Lua, Teal, Markdown, HTTP/2, QUIC, Redis, TypeScript, npm-less React 19, SQLite, and PostgreSQL support ++

JavaScript
★ 3,029

Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.

Java
betalgo

openai

★ 3,024

.NET library for the OpenAI service API by Betalgo Ranul

C#
Simon-He95

markstream-vue

★ 3,024

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

Vue
★ 3,021

AI agent skills for social media research. Outlier posts, comment mining, competitor teardowns, ad libraries & trends across TikTok, Instagram, YouTube, Reddit, X, LinkedIn & more. Powered by ScrapeCreators. Works with Claude Code, Cursor, Codex, Gemini CLI.

Python
★ 3,018

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various relevant websites and do research for you all on its own! And more, not limited to but including saving the findings for you!

Python
vercel-labs

opensrc

★ 3,008

Fetch source code for npm packages to give AI coding agents deeper context

Rust
★ 3,006

J-Space Cognition Suite V3.7 - AI cognitive-enhancement Skills based on Anthropic's J-space global workspace research. | 哔哩哔哩：Tiger380 (UID 3494375382321675) — https://space.bilibili.com/3494375382321675

Python
Dicklesworthstone

llm_aided_ocr

★ 3,003

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

Python
signerless

llm-checker

★ 3,000

Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.

JavaScript