Hysen Labsvllm-project
★ 86,907vllm
A high-throughput and memory-efficient inference and serving engine for LLMs.
HYSEN LABS DIRECTORY
vllm-project
Verified repositories, classifications and analysis from the vllm-project organization.
3 curated open-source projects
vllm-project
★ 5,699vllm-omni
A framework for efficient model inference with omni-modality models.
vllm-project
★ 4,982aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference.