HYSEN LABS DIRECTORY

lucidrains

Verified repositories, classifications and analysis from the lucidrains organization.

21 curated open-source projects
lucidrains

vit-pytorch

★ 25,574

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Python3,495 forks5 min read
★ 10,725

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

Python1,284 forks5 min read
★ 7,864

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Python666 forks5 min read
lucidrains

x-transformers

★ 5,961

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Python532 forks5 min read
lucidrains

lion-pytorch

★ 2,207

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Python54 forks7 min read
lucidrains

titans-pytorch

★ 2,007

Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch

Python213 forks8 min read
lucidrains

byol-pytorch

★ 1,899

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

Python248 forks5 min read
★ 1,700

Implementation of Alphafold 3 from Google Deepmind in Pytorch

Python232 forks5 min read
★ 1,413

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

Python77 forks6 min read
★ 1,224

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Python140 forks7 min read
lucidrains

BS-RoFormer

★ 1,020

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

Python48 forks7 min read
★ 827

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

Python70 forks6 min read
lucidrains

ema-pytorch

★ 659

A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model

Python42 forks6 min read
lucidrains

pi-zero-pytorch

★ 590

Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence

Python31 forks7 min read
★ 576

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Python99 forks6 min read
lucidrains

slot-attention

★ 502

Implementation of Slot Attention from GoogleAI

Python32 forks6 min read
★ 490

Implementation of rectified flow and some of its followup research / improvements in Pytorch

Python39 forks5 min read
lucidrains

q-transformer

★ 406

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind

Python21 forks5 min read