Rank #5,731 1,101 starsPython

former

by pbloem (personal account)

Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg) (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 1,101
Forks: 171
Open issues and pull requests: 10
Primary language: Python
License: MIT License (MIT)
Owner: pbloem · Personal account
Created: Aug 15, 2019
Last push: Mar 20, 2025

Topics

Rank #5,731 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #5,731 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #5,731 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/pbloem--former.svg)](https://unitedstatesofamericasuperintelligence.com/github/pbloem--former/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/pbloem--former/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/pbloem--former.svg" alt="Ranked #5,731 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 14: huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
167,814 starsPythonApache-2.0Last push Oct 18, 2026
Rank 484: lukas-blecher/LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
16,591 starsPythonMITLast push Jan 18, 2025
Rank 768: bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10,639 starsPythonMITLast push Sep 7, 2024
Rank 998: jessevig/bertviz
BertViz: Visualize Attention in Transformer Models
8,200 starsPythonApache-2.0Last push Jan 8, 2026
Rank 1,868: Nixtla/neuralforecast
Scalable and user friendly neural forecasting algorithms.
4,287 starsPythonApache-2.0Last push Oct 14, 2026
Rank 5,352: awslabs/sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
1,216 starsPythonApache-2.0Last push Oct 24, 2024

Repository facts

Topics

Add this badge to your README

Related projects

Rank 14: huggingface/transformers

Rank 484: lukas-blecher/LaTeX-OCR

Rank 768: bigscience-workshop/petals

Rank 998: jessevig/bertviz

Rank 1,868: Nixtla/neuralforecast

Rank 5,352: awslabs/sockeye

Support Us