sgl-project
★ 35,949sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
HYSEN LABS DIRECTORY
sgl-project
Verified repositories, classifications and analysis from the sgl-project organization.
3 curated open-source projects
sgl-project
★ 5,066mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
sgl-project
★ 1,172SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.