Rank #8,955 557 starsPython

attention_with_linear_biases

by ofirpress (personal account)

Code for the ALiBi method for transformer language models (ICLR 2022) (description from the project’s GitHub page)

Repository facts

Stars: 557
Forks: 42
Open issues and pull requests: 5
Primary language: Python
License: MIT License (MIT)
Owner: ofirpress · Personal account
Created: Aug 24, 2021
Last push: Oct 30, 2023

Rank #8,955 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #8,955 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #8,955 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/ofirpress--attention-with-linear-biases.svg)](https://unitedstatesofamericasuperintelligence.com/github/ofirpress--attention-with-linear-biases/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/ofirpress--attention-with-linear-biases/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/ofirpress--attention-with-linear-biases.svg" alt="Ranked #8,955 in AI on GitHub" height="20"></a>

Repository facts

Add this badge to your README

Support Us