Rank #9,041 548 starsPython

attentions

by sooftware (personal account)

PyTorch implementation of some attentions for Deep Learning Researchers. (description from the project’s GitHub page)

Repository facts

Stars: 548
Forks: 73
Open issues and pull requests: 2
Primary language: Python
License: MIT License (MIT)
Owner: sooftware · Personal account
Created: Mar 21, 2020
Last push: Mar 4, 2022

Topics

Rank #9,041 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #9,041 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #9,041 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/sooftware--attentions.svg)](https://unitedstatesofamericasuperintelligence.com/github/sooftware--attentions/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/sooftware--attentions/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/sooftware--attentions.svg" alt="Ranked #9,041 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 8,265: therealoliver/Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
629 starsJupyter NotebookMITLast push Feb 24, 2025
Rank 9,274: anicolson/DeepXi
Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.
525 starsMATLABMPL-2.0Last push Feb 17, 2022
Rank 544: kyegomez/OpenMythos
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
14,911 starsPythonMITLast push May 23, 2026
Rank 659: xmu-xiaoma666/External-Attention-pytorch
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
12,181 starsPythonMITLast push Mar 16, 2026
Rank 835: jadore801120/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
9,817 starsPythonMITLast push Apr 16, 2024
Rank 1,719: hyunwoongko/transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
4,672 starsPythonNo license file detectedLast push Jul 15, 2025

Repository facts

Topics

Add this badge to your README

Related projects

Rank 8,265: therealoliver/Deepdive-llama3-from-scratch

Rank 9,274: anicolson/DeepXi

Rank 544: kyegomez/OpenMythos

Rank 659: xmu-xiaoma666/External-Attention-pytorch

Rank 835: jadore801120/attention-is-all-you-need-pytorch

Rank 1,719: hyunwoongko/transformer

Support Us