HYSEN LABS 專案目錄

NVIDIA

來自 NVIDIA 組織的可信儲存庫、分類與深度解析。

28 個精選開源專案
14,627

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python2,745 個 Fork
NVIDIA

TensorRT

13,348

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

C++2,407 個 Fork
NVIDIA

cutlass

10,437

CUDA Templates and Python DSLs for High-Performance Linear Algebra

C++2,084 個 Fork
NVIDIA

garak

9,258

the LLM vulnerability scanner

Python1,282 個 Fork
NVIDIA

OpenShell

8,615

OpenShell is the safe, private runtime for autonomous AI agents.

Rust1,252 個 Fork
NVIDIA

DALI

5,759

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

C++676 個 Fork
NVIDIA

cuml

5,277

NVIDIA cuML: GPU-Accelerated Machine Learning

Python674 個 Fork
NVIDIA

nccl

5,092

Optimized primitives for collective multi-GPU communication

C++1,415 個 Fork
4,181

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Jupyter Notebook1,098 個 Fork
3,810

量化、蒸餾、剪枝、神經架構搜尋、推測解碼等 SOTA 模型最佳化技術的統一函式庫。它為 TensorRT-LLM、TensorRT、vLLM 等下游部署框架壓縮深度學習模型,以優化推理速度。

PythonAI 與機器學習599 個 Fork
3,533

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

Python823 個 Fork
NVIDIA

skills

3,301

專案速覽:適用於 NVIDIA 產品的代理技能,安裝到 Claude Code、Codex 和其他編碼代理程式中,以端對端運行實體 AI、機器人、模擬、CUDA 和 RAG 工作流程。技能目錄產品|說明 |技能 |愛智商 | NVIDIA AI-Q 藍圖 - 部署本地 AI-Q 服務並作為代理技能運行淺層或深層研究工作流程。

Python394 個 Fork
3,253

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

Python783 個 Fork
2,632

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

Python755 個 Fork
NVIDIA

kvpress

1,209

LLM KV cache compression made easy

Python179 個 Fork
NVIDIA

raft

1,042

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

Cuda250 個 Fork