sgl-project
★ 35,949sglang
SGLang 是一個用於大型語言模型和多模態模型的高效能服務框架。
HYSEN LABS 專案目錄
來自 sgl-project 組織的可信儲存庫、分類與深度解析。
SGLang 是一個用於大型語言模型和多模態模型的高效能服務框架。
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.