turboderp-org
★ 4,631exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
HYSEN LABS DIRECTORY
Verified repositories, classifications and analysis from the turboderp-org organization.
A fast inference library for running LLMs locally on modern consumer-class GPUs
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs