attention-is-all-you-need-pytorch

Repository facts

Stars

9,817

Forks

2,098

Open issues and pull requests

83

Primary language

Python

License

MIT License (MIT)

Owner

jadore801120 · Personal account

Created

Jun 14, 2017

Last push

Apr 16, 2024

Topics

• attention
• attention-is-all-you-need
• deep-learning
• natural-language-processing
• nlp
• pytorch

Rank #835 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 8,798

  Rank 8,798: chengchingwen/Transformers.jl

  Julia Implementation of Transformer models

  573 starsJuliaMITLast push Jul 31, 2026

• 5,672

  Rank 5,672: gordicaleksa/pytorch-original-transformer

  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currentl…

  1,117 starsJupyter NotebookMITLast push Dec 27, 2020

• 14

  Rank 14: huggingface/transformers

  🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

  167,814 starsPythonApache-2.0Last push Oct 18, 2026

• 370

  Rank 370: huggingface/datasets

  🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

  22,065 starsPythonApache-2.0Last push Oct 16, 2026

• 1,028

  Rank 1,028: stanfordnlp/stanza

  Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

  7,905 starsPythonOther licenseLast push Oct 15, 2026

• 1,643

  Rank 1,643: thunlp/OpenPrompt

  An Open-Source Framework for Prompt-Learning.

  4,904 starsPythonApache-2.0Last push Jul 16, 2024