sgl-project
★ 36,482sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
HYSEN LABS DIRECTORY
sgl-project
Verified repositories, classifications and analysis from the sgl-project organization.
4 curated open-source projects
sgl-project
★ 5,186mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
sgl-project
★ 1,294sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
sgl-project
★ 1,195SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.