Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated red constellation network artwork for BlinkDL/RWKV-LM, labeled USASI · AI on GitHub, with Personal account · Python · Apache-2.0.
Rank #551 14,748 starsPython

RWKV-LM

by BlinkDL (personal account)

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training… (description from the project’s GitHub page)

View on GitHub (external site: github.com)

Repository facts

Stars
14,748
Forks
1,024
Open issues and pull requests
159
Primary language
Python
License
Apache License 2.0 (Apache-2.0)
Owner
BlinkDL · Personal account
Created
Aug 8, 2021
Last push
Sep 28, 2026

Topics

Rank #551 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #551 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #551 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/blinkdl--rwkv-lm.svg)](https://unitedstatesofamericasuperintelligence.com/github/blinkdl--rwkv-lm/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/blinkdl--rwkv-lm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/blinkdl--rwkv-lm.svg" alt="Ranked #551 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 5,513: SuperBruceJia/EEG-DL

    A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

    1,173 starsPythonMITLast push Jul 20, 2025

  • Rank 867: BlinkDL/ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

    9,493 starsPythonApache-2.0Last push Jul 19, 2026

  • Rank 8,886: voidful/TextRL

    Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)

    564 starsPythonMITLast push Apr 23, 2026

  • Rank 8,265: therealoliver/Deepdive-llama3-from-scratch

    Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.

    629 starsJupyter NotebookMITLast push Feb 24, 2025

  • Rank 588: microsoft/LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

    13,860 starsPythonMITLast push Dec 17, 2024

  • Rank 963: OptimalScale/LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    8,481 starsPythonApache-2.0Last push Aug 10, 2026

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project