
rotary-embedding-torch
by lucidrains (personal account)
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch (description from the project’s GitHub page)
Repository facts
- Stars
- 828
- Forks
- 69
- Open issues and pull requests
- 27
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- lucidrains · Personal account
- Created
- Jun 29, 2021
- Last push
- Jun 20, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/lucidrains--rotary-embedding-torch/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/lucidrains--rotary-embedding-torch/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/lucidrains--rotary-embedding-torch.svg" alt="Ranked #6,914 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 8,265: therealoliver/Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
629 starsJupyter NotebookMITLast push Feb 24, 2025
Rank 216: explosion/spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
33,968 starsPythonMITLast push Oct 12, 2026
Rank 246: Lightning-AI/pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
31,416 starsPythonApache-2.0Last push Oct 12, 2026
Rank 370: huggingface/datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
22,065 starsPythonApache-2.0Last push Oct 16, 2026
Rank 382: onnx/onnx
Open standard for machine learning interoperability
21,597 starsPythonApache-2.0Last push Oct 18, 2026
Rank 457: camel-ai/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
17,926 starsPythonApache-2.0Last push Oct 12, 2026