
vidur
by microsoft (organization)
Accurate, large-scale, and extensible simulator for LLM inference Systems (description from the project’s GitHub page)
Repository facts
- Stars
- 698
- Forks
- 139
- Open issues and pull requests
- 24
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- microsoft · Organization
- Created
- Nov 2, 2023
- Last push
- Aug 24, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/microsoft--vidur/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/microsoft--vidur/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/microsoft--vidur.svg" alt="Ranked #7,753 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,619: vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2,996 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,308: vllm-project/semantic-router
An open, programmable decision layer for models and compute.
6,206 starsGoApache-2.0Last push Oct 18, 2026
Rank 669: LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
12,108 starsPythonApache-2.0Last push Oct 18, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 2,117: PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
3,721 starsPythonApache-2.0Last push Sep 24, 2026