sgl-project
★ 35,949sglang
SGLang 是一个用于大型语言模型和多模态模型的高性能服务框架。
HYSEN LABS 项目目录
sgl-project
来自 sgl-project 组织的可信仓库、分类与深度解析。
3 个精选开源项目
sgl-project
★ 5,066mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
sgl-project
★ 1,172SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.