pytorch-original-transformer
by gordicaleksa (personal account)
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,117
- Forks
- 188
- Open issues and pull requests
- 9
- Primary language
- Jupyter Notebook
- License
- MIT License (MIT)
- Owner
- gordicaleksa · Personal account
- Created
- Oct 19, 2020
- Last push
- Dec 27, 2020
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/gordicaleksa--pytorch-original-transformer/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/gordicaleksa--pytorch-original-transformer/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/gordicaleksa--pytorch-original-transformer.svg" alt="Ranked #5,672 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 5,360: The-AI-Summer/self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
1,214 starsPythonMITLast push Sep 14, 2021
Rank 2,884: gordicaleksa/pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention m…
2,688 starsJupyter NotebookMITLast push Nov 17, 2022
Rank 2,753: linto-ai/whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
2,855 starsPythonAGPL-3.0Last push Sep 28, 2026
Rank 5,352: awslabs/sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
1,216 starsPythonApache-2.0Last push Oct 24, 2024
Rank 9,379: WenjieDu/SAITS
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model fo…
513 starsPythonMITLast push Aug 25, 2026
Rank 6,742: jeya-maria-jose/Medical-Transformer
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
860 starsPythonMITLast push Feb 23, 2023