Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated pink circuit-trace artwork for lucidrains/native-sparse-attention-pytorch, labeled USASI · AI on GitHub, with Personal account · Python · MIT.
Rank #6,986 816 starsPython

native-sparse-attention-pytorch

by lucidrains (personal account)

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper (description from the project’s GitHub page)

View on GitHub (external site: github.com)

Repository facts

Stars
816
Forks
51
Open issues and pull requests
12
Primary language
Python
License
MIT License (MIT)
Owner
lucidrains · Personal account
Created
Feb 19, 2025
Last push
Aug 15, 2025

Topics

Rank #6,986 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,986 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,986 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/lucidrains--native-sparse-attention-pytorch.svg)](https://unitedstatesofamericasuperintelligence.com/github/lucidrains--native-sparse-attention-pytorch/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/lucidrains--native-sparse-attention-pytorch/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/lucidrains--native-sparse-attention-pytorch.svg" alt="Ranked #6,986 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 7,676: svg-project/Sparse-VideoGen

    [ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attention

    710 starsPythonApache-2.0Last push Jul 4, 2026

  • Rank 4,536: lucidrains/lambda-networks

    Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

    1,530 starsPythonMITLast push Nov 18, 2020

  • Rank 4,804: lucidrains/transfusion-pytorch

    Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

    1,407 starsPythonMITLast push Sep 4, 2026

  • Rank 5,360: The-AI-Summer/self-attention-cv

    Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

    1,214 starsPythonMITLast push Sep 14, 2021

  • Rank 5,476: lucidrains/performer-pytorch

    An implementation of Performer, a linear attention-based transformer, in Pytorch

    1,184 starsPythonMITLast push Feb 2, 2022

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project