0xSero
★ 1,788turboquant
TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration
HYSEN LABS DIRECTORY
Verified repositories, classifications and analysis from the 0xSero organization.
TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration
extract all your personal data history from cursor, codex, claude-code, windsurf, and trae
Your AI friend right in your browser