
fastT5
by Ki6an (personal account)
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x. (description from the project’s GitHub page)
Repository facts
- Stars
- 586
- Forks
- 76
- Open issues and pull requests
- 27
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Ki6an · Personal account
- Created
- Mar 11, 2021
- Last push
- Apr 24, 2023
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/ki6an--fastt5/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/ki6an--fastt5/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/ki6an--fastt5.svg" alt="Ranked #8,662 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,236: huggingface/optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
3,504 starsPythonApache-2.0Last push Oct 6, 2026
Rank 2,553: guillaume-be/rust-bert
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
3,084 starsRustApache-2.0Last push Jan 13, 2026
Rank 6,118: PINTO0309/onnx2tf
A tool for converting ONNX files to LiteRT/TFLite/TensorFlow, PyTorch native code (nn.Module), TorchScript (.pt), state_dict (.pt), Exported Program (.pt2), and Dynamo ONNX. It al…
1,000 starsPythonMITLast push Sep 14, 2026
Rank 5,380: openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
1,209 starsPythonApache-2.0Last push Oct 14, 2026
Rank 7,514: zhiqwang/yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
730 starsPythonGPL-3.0Last push Apr 10, 2026