ModelTC
★ 4,289LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
HYSEN LABS 项目目录
来自 ModelTC 组织的可信仓库、分类与深度解析。
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
项目速览:轻量级图像视频动作生成推理框架。 2026 年 2 月 27 日:我们现在支持自回归视频生成模型的 FP8 和 NVFP4 量化(自强迫)!
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.