AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,665–2,688 of 4,121

DevoxxGenie is an agentic plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code. Latest version now also supports Spec Driven Development with CLI Runners.

Java
FireRedTeam

FireRedASR2S

681

A SOTA Industrial-Grade All-in-One ASR system with ASR, VAD, LID, and Punc modules. FireRedASR2 supports Chinese (Mandarin, 20+ dialects/accents), English, code-switching, and both speech and singing ASR. FireRedVAD supports speech/singing/music in 100+ langs. FireRedLID supports 100+ langs and 20+ zh dialects. FireRedPunc supports zh and en.

Python
xynehq

xyne

681

AI-first Search & Answer Engine for work. Open-source alternative to Glean.

TypeScript
680

Read, write, search, and surgically edit Obsidian vault notes, tags, and frontmatter via MCP. STDIO or Streamable HTTP.

TypeScript
JuliusBrussee

cavemem

680

Frozen — cross-agent persistent memory for coding assistants. Still works; the compressed-memory core now ships inside JuliusBrussee/caveman.

TypeScript
LerSent001

orb

680

实时 WebGPU 液态玻璃球编辑器,支持 Web 与 SwiftUI/Metal 导出,使用 OpenAI Codex 辅助开发与验证 | Real-time WebGPU liquid-glass orb editor with Web and SwiftUI/Metal export, built and verified with OpenAI Codex.

TypeScript
versun

RSSBox

680

让RSS管理更智能,让信息获取更高效 | Smarter RSS management, more efficient information access

Python

2026年最新机场服务套餐与线路对比、VPN 使用资料及 Clash/Mihomo 客户端配置教程。内容仅供购买前参考,具体服务以官方信息为准。

mondaycom

vibe

679

🎨 Vibe Design System - Official monday.com UI resources for application development in React.js

TypeScript
NVlabs

OmniVinci

679

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

Python
zh-plus

openlrc

679

Transcribe and translate voice into LRC file using Whisper and LLMs (GPT, Claude, et,al). 使用whisper和LLM(GPT,Claude等)来转录、翻译你的音频为字幕文件。

Python
AgriQuantAI

AgriQuant-AI

678

AI-powered weather intelligence for agricultural commodity futures. Predicts price moves 48-72 hours early across OJ, Coffee, Cocoa, Sugar, Corn and Wheat using Claude Sonnet + satellite data

Python
microsoft

vidur

678

Accurate, large-scale, and extensible simulator for LLM inference Systems

Python
product-on-purpose

pm-skills

677

68 plug-and-play, best-practice product management skills for AI agents: 30 Triple Diamond phase + 11 foundation + 12 utility + 15 tool (Foundation Sprint + Design Sprint). Plus 6 sub-agents, workflows, 200+ output samples, guides, and CI-enforced contracts. Apache 2.0.

JavaScript
samuelfaj

distill

677

Distill large CLI outputs into small answers for LLMs and save tokens!

TypeScript
yangfeng20

ai-job

677

找工作,用AI工作猎手!让AI帮您找工作!【DeepSeek+ChatGpt】赋能,ai助理作为您的求职者分身7*24小时在线找工作,并结合您的简历信息定制化回复。批量投递,自动发送简历,交换联系方式。hr拒绝挽留。高意向邮件通知,让您不错过每一份工作机会。BOSS直聘

Java
rusiaaman

wcgw

676

Shell and coding agent on mcp clients

Python
675

🤖 AI-Powered MCP Server for Polymarket - Enable Claude to trade prediction markets with 45 tools, real-time monitoring, and enterprise-grade safety features

Python
crisng95

flowkit

675

AI agent can create video content better than you. No reason why you do it manually in google flow!

Python
675

Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams)

Python
use-novamira

novamira

675

MCP server that gives AI agents full access to WordPress through PHP execution and filesystem operations

PHP
teilomillet

gollm

674

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

Go
ARahim3

mlx-dspark

673

Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.

Python
Bessouat40

RAGLight

673

RAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vector stores, and now includes seamless MCP integration to connect external tools and data sources.

Python