
XPretrain
by microsoft (organization)
Multi-modality pre-training (description from the project’s GitHub page)
Repository facts
- Stars
- 512
- Forks
- 35
- Open issues and pull requests
- 16
- Primary language
- Python
- License
- Other license
- Owner
- microsoft · Organization
- Created
- Mar 15, 2022
- Last push
- Aug 28, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/microsoft--xpretrain/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/microsoft--xpretrain/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/microsoft--xpretrain.svg" alt="Ranked #9,389 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 4,292: invictus717/MetaTransformer
Meta-Transformer for Unified Multimodal Learning
1,643 starsPythonApache-2.0Last push Dec 5, 2023
Rank 975: bytedeco/javacv
Java interface to OpenCV, FFmpeg, and more
8,347 starsJavaOther licenseLast push Aug 12, 2026
Rank 6,770: pipeless-ai/pipeless
An open-source computer vision framework to build and deploy apps in minutes
855 starsRustApache-2.0Last push May 8, 2024
Rank 8,495: Fabric-Project/Fabric
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
603 starsSwiftBSD-3-ClauseLast push Oct 17, 2026
Rank 6,230: brightmart/bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
968 starsPythonNo license file detectedLast push Jan 1, 2019
Rank 8,146: princeton-nlp/LLM-Shearing
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
643 starsPythonMITLast push Mar 4, 2024