
sentencepiece
by google (organization)
Unsupervised text tokenizer for Neural Network-based text generation. (description from the project’s GitHub page)
Repository facts
- Stars
- 12,138
- Forks
- 1,387
- Open issues and pull requests
- 6
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- google · Organization
- Created
- Mar 7, 2017
- Last push
- Oct 17, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/google--sentencepiece/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/google--sentencepiece/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/google--sentencepiece.svg" alt="Ranked #665 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 7,891: vncorenlp/VnCoreNLP
A Vietnamese natural language processing toolkit (NAACL 2018)
679 starsJavaOther licenseLast push Feb 12, 2023
Rank 2,807: NiuTrans/MTBook
《机器翻译:基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models
2,795 starsTeXNo license file detectedLast push Sep 14, 2024
Rank 3,578: delip/PyTorchNLPBook
Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L
2,058 starsJupyter NotebookApache-2.0Last push Mar 12, 2023
Rank 4,608: OpenNMT/OpenNMT-tf
Neural machine translation and sequence learning using TensorFlow
1,486 starsPythonMITLast push Oct 14, 2023
Rank 1,708: OpenNMT/CTranslate2
Fast inference engine for Transformer models
4,713 starsC++MITLast push Oct 18, 2026