Rank #6,164 987 starsJupyter Notebook

gated_attention

by qiuzh20 (personal account)

The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 987
Forks: 61
Open issues and pull requests: 1
Primary language: Jupyter Notebook
License: MIT License (MIT)
Owner: qiuzh20 · Personal account
Created: May 9, 2025
Last push: Dec 20, 2025

Rank #6,164 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,164 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,164 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/qiuzh20--gated-attention.svg)](https://unitedstatesofamericasuperintelligence.com/github/qiuzh20--gated-attention/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/qiuzh20--gated-attention/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/qiuzh20--gated-attention.svg" alt="Ranked #6,164 in AI on GitHub" height="20"></a>

Repository facts

Add this badge to your README

Support Us