HYSEN LABS DIRECTORY

lucidrains

Verified repositories, classifications and analysis from the lucidrains organization.

21 curated open-source projects
lucidrains

vit-pytorch

★ 25,525

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Python3,496 forks
★ 7,860

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Python673 forks
lucidrains

x-transformers

★ 5,949

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Python522 forks
lucidrains

lion-pytorch

★ 2,204

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Python56 forks
lucidrains

titans-pytorch

★ 1,986

Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch

Python208 forks
lucidrains

byol-pytorch

★ 1,900

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

Python247 forks
★ 1,695

Implementation of Alphafold 3 from Google Deepmind in Pytorch

Python232 forks
★ 1,404

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

Python75 forks
★ 1,220

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Python141 forks
lucidrains

BS-RoFormer

★ 956

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

Python46 forks
★ 827

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

Python68 forks
lucidrains

ema-pytorch

★ 659

A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model

Python41 forks
lucidrains

pi-zero-pytorch

★ 587

Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence

Python29 forks
★ 574

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Python101 forks
lucidrains

slot-attention

★ 499

Implementation of Slot Attention from GoogleAI

Python34 forks
★ 487

Implementation of rectified flow and some of its followup research / improvements in Pytorch

Python36 forks
lucidrains

q-transformer

★ 406

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind

Python21 forks