MInference
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
HYSEN LABS DIRECTORY
Deployment tag · curated repositories and deep analysis.
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
A web extension to clip information from web page. Save it to your local machine to avoid information invalidation. Not bored registration, Not charged.
Framework agnostic and headless rich text editor
Beautiful, consistent, pixel-perfect icons for every framework. 60,000+ icons (6,000+ free) for React, Vue, Svelte, Angular, React Native, Flutter and more.
A tool for formatting Clojure code
An extensive framework for testing Android apps
A framework for rapid prototyping and development of real-time rendering techniques.
CakeML: A Verified Implementation of ML
A nice looking home screen for KOReader. Lets you pick a book from your shelf and read it, with some customisation around the book preview info that's shown.
A SwiftUI view that is able to scan barcodes, QR codes, and more, and send back what was found.
:page_with_curl: Asciidoctor PDF: A native PDF converter for AsciiDoc based on Asciidoctor and Prawn, written entirely in Ruby.
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
Natural language workflows that enable AI agents to perform complex, multi-step tasks with consistency and reliability.
Import C++ files directly from Python!
A custom element that allows you to easily put a Dark Mode 🌒 toggle or switch on your site:
SVG rendering and manipulation library in C++
A Flutter UI components lib for TDesign.
Lightweight C/C++ Extended Kalman Filter with Python for prototyping
Cinematic launch films and motion design from code, directed by your coding agent.
A free & open tool for transcribing audio interviews