Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated blue orbit artwork for niieani/gpt-tokenizer, labeled USASI · AI on GitHub, with Personal account · TypeScript · MIT.
Rank #6,768 855 starsTypeScript

gpt-tokenizer

by niieani (personal account)

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features. (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: gpt-tokenizer.dev)

Repository facts

Stars
855
Forks
63
Open issues and pull requests
2
Primary language
TypeScript
License
MIT License (MIT)
Owner
niieani · Personal account
Created
Mar 22, 2023
Last push
Oct 18, 2026

Topics

Rank #6,768 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,768 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,768 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/niieani--gpt-tokenizer.svg)](https://unitedstatesofamericasuperintelligence.com/github/niieani--gpt-tokenizer/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/niieani--gpt-tokenizer/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/niieani--gpt-tokenizer.svg" alt="Ranked #6,768 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 7,372: retkowsky/Azure-AIGEN-demos

    Microsoft Foundry (demos, documentation, accelerators).

    754 starsJupyter NotebookMITLast push Jul 22, 2026

  • Rank 652: TheR1D/shell_gpt

    A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

    12,294 starsPythonMITLast push Jul 2, 2026

  • Rank 1,392: openai-php/client

    ⚡️ OpenAI PHP is a supercharged community-maintained PHP API client that allows you to interact with OpenAI API.

    5,836 starsPHPMITLast push Oct 14, 2026

  • Rank 120: Aider-AI/aider

    aider is AI pair programming in your terminal

    49,614 starsPythonApache-2.0Last push May 22, 2026

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project