ModelTC
★ 4,289LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
HYSEN LABS 專案目錄
來自 ModelTC 組織的可信儲存庫、分類與深度解析。
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
專案速覽:輕量級影像影片動作產生推理框架。 2026 年 2 月 27 日:我們現在支持自回歸視訊生成模型的 FP8 和 NVFP4 量化(自強迫)!
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.