Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated teal flowing-wave artwork for seal-rg/recurrent-pretraining, labeled USASI · AI on GitHub, with Organization · Python · Apache-2.0.
Rank #6,187 981 starsPython

recurrent-pretraining

by seal-rg (organization)

Pretraining and inference code for a large-scale depth-recurrent language model (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: huggingface.co)

Repository facts

Stars
981
Forks
89
Open issues and pull requests
1
Primary language
Python
License
Apache License 2.0 (Apache-2.0)
Owner
seal-rg · Organization
Created
Feb 7, 2025
Last push
Dec 29, 2025

Topics

Rank #6,187 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,187 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,187 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/seal-rg--recurrent-pretraining.svg)](https://unitedstatesofamericasuperintelligence.com/github/seal-rg--recurrent-pretraining/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/seal-rg--recurrent-pretraining/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/seal-rg--recurrent-pretraining.svg" alt="Ranked #6,187 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 6,948: madaan/self-refine

    LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.

    822 starsPythonApache-2.0Last push Oct 4, 2024

  • Rank 9,277: NVlabs/QeRL

    [ICLR 2026]QeRL enables RL for 32B LLMs on a single H100 GPU.

    525 starsPythonApache-2.0Last push Mar 30, 2026

  • Rank 1,402: PySpur-Dev/pyspur

    A visual playground for agentic workflows: Iterate over your agents 10x faster

    5,791 starsTypeScriptApache-2.0Last push Jun 29, 2026

  • Rank 1,483: rasbt/reasoning-from-scratch

    Implement a reasoning LLM in PyTorch from scratch, step by step

    5,425 starsJupyter NotebookApache-2.0Last push Oct 2, 2026

  • Rank 1,786: microsoft/LMOps

    General technology for enabling AI capabilities w/ LLMs and MLLMs

    4,484 starsPythonMITLast push Sep 15, 2026

  • Rank 3,006: OFA-Sys/OFA

    Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

    2,553 starsPythonApache-2.0Last push Apr 24, 2024

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project