Rank #6,824 845 starsPython

linear-attention-transformer

by lucidrains (personal account)

Transformer based on a variant of attention that is linear complexity in respect to sequence length (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 845
Forks: 78
Open issues and pull requests: 10
Primary language: Python
License: MIT License (MIT)
Owner: lucidrains · Personal account
Created: Jun 4, 2020
Last push: May 5, 2024

Topics

Rank #6,824 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,824 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,824 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/lucidrains--linear-attention-transformer.svg)](https://unitedstatesofamericasuperintelligence.com/github/lucidrains--linear-attention-transformer/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/lucidrains--linear-attention-transformer/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/lucidrains--linear-attention-transformer.svg" alt="Ranked #6,824 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 551: BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…
14,748 starsPythonApache-2.0Last push Sep 28, 2026
Rank 5,352: awslabs/sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
1,216 starsPythonApache-2.0Last push Oct 24, 2024
Rank 5,360: The-AI-Summer/self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
1,214 starsPythonMITLast push Sep 14, 2021
Rank 5,744: lucidrains/tab-transformer-pytorch
Implementation of TabTransformer, attention network for tabular data, in Pytorch
1,099 starsPythonMITLast push Jan 8, 2026
Rank 6,179: qinzheng93/GeoTransformer
[CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration
984 starsPythonMITLast push Nov 22, 2023
Rank 7,779: soobinseo/Transformer-TTS
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
695 starsPythonMITLast push Nov 8, 2023

Repository facts

Topics

Add this badge to your README

Related projects

Rank 551: BlinkDL/RWKV-LM

Rank 5,352: awslabs/sockeye

Rank 5,360: The-AI-Summer/self-attention-cv

Rank 5,744: lucidrains/tab-transformer-pytorch

Rank 6,179: qinzheng93/GeoTransformer

Rank 7,779: soobinseo/Transformer-TTS

Support Us