varunvasudeva1/llm-server-docs 848 +1 today
turboderp-org/exllamav3 1,747
The wheel exllamav3 tells you to install is v0.0.6, and the PyPI package compiles kernels on first import
ttttccxxui/DataInfra-RedactionEverything 1,145
Personal use only, non-commercial weights, and an empty default JWT secret
triton-inference-server/tensorrtllm_backend 945
tensorrtllm_backend: the C++ moved out and the repository kept the README
tonbistudio/turboquant-pytorch 1,049
turboquant-pytorch's own table shows its headline configuration producing garbage
thedaviddias/llms-txt-hub 917 +1 today
llms-txt-hub is a directory with four validators and a typo in its own title
TheAiSingularity/graphrag-local-ollama 1,108
graphrag-local-ollama inherits Microsoft's author list and installs jupyter in the image
techjarves/Uncensored-Local-Studio 1,559 +1 today
Portable AI Studio: four local engines, and an anchor left from the old name
Taewan-P/gpt_mobile 1,265 +4 today
GPT Mobile keeps keys on the device, except when you open the Tools dialog
stepfun-ai/Step-Audio-EditX 992 +1 today
Step-Audio-EditX pins vLLM to a release candidate wheel and marks training code unreleased while checking three of its four trainers
skygazer42/DL-Hub 1,117 +1 today
DL-Hub: 339 PyTorch lessons held to one implementation contract
shubham0204/SmolChat-Android 897
SmolChat-Android: a vector database module with no feature attached yet
ScalingIntelligence/KernelBench 1,275
KernelBench pins Python to one minor version, keeps an archived requirements file that disagrees with it, and marks its own metric script as missing
scaleapi/llm-engine 839
LLM Engine: an open source engine whose newest tag is two years older than its last commit
RockChinQ/free-one-api 933 +1 today
free-one-api's answer to unstable reverse-engineered adapters is a heartbeat check and an auto-disable
raphaelmansuy/code2prompt 886 +1 today
Code2Prompt: your codebase rendered as one Markdown prompt
qinshihu/itops-agent-platform 945
The ITOps Agent Platform README tells you not to pull the images yet
PrinceSinghhub/Ultimate-AI-Engineer-Roadmap-2026 906