huawei-csl
★ 635SINQ
Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model smaller while preserving accuracy [ICML 2026]
HYSEN LABS DIRECTORY
huawei-csl
Verified repositories, classifications and analysis from the huawei-csl organization.
2 curated open-source projects
huawei-csl
★ 512KVarN
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.