sgl-project
★ 38,831sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
HYSEN LABS DIRECTORY
sgl-project
Verified repositories, classifications and analysis from the sgl-project organization.
4 curated open-source projects
sgl-project
★ 5,577mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
sgl-project
★ 1,778sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
sgl-project
★ 1,282SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.