
Rank #417 19,487 starsPython
tiktoken
by openai (organization)
tiktoken is a fast BPE tokeniser for use with OpenAI's models. (description from the project’s GitHub page)
Repository facts
- Stars
- 19,487
- Forks
- 1,650
- Open issues and pull requests
- 143
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- openai · Organization
- Created
- Dec 1, 2022
- Last push
- Aug 17, 2026
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/openai--tiktoken/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/openai--tiktoken/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/openai--tiktoken.svg" alt="Ranked #417 in AI on GitHub" height="20"></a>