server

Repository facts

Stars

11,095

Forks

1,856

Open issues and pull requests

902

Primary language

Python

License

BSD 3-Clause "New" or "Revised" License (BSD-3-Clause)

Owner

triton-inference-server · Organization

Created

Oct 4, 2018

Last push

Oct 16, 2026

Topics

• cloud
• datacenter
• deep-learning
• edge
• gpu
• inference
• machine-learning

Rank #729 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,312

  Rank 6,312: openvinotoolkit/model_server

  A scalable inference server for models optimized with OpenVINO™

  950 starsC++Apache-2.0Last push Oct 16, 2026

• 3,293

  Rank 3,293: dstackai/dstack

  A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clus…

  2,284 starsPythonMPL-2.0Last push Oct 17, 2026

• 2,777

  Rank 2,777: leptonai/leptonai

  A Pythonic framework to simplify AI service building

  2,824 starsPythonApache-2.0Last push Oct 12, 2026

• 141

  Rank 141: deepspeedai/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  43,242 starsPythonApache-2.0Last push Oct 18, 2026

• 6,770

  Rank 6,770: pipeless-ai/pipeless

  An open-source computer vision framework to build and deploy apps in minutes

  855 starsRustApache-2.0Last push May 8, 2024

• 5,139

  Rank 5,139: modal-labs/modal-examples

  Examples of programs built using Modal

  1,282 starsPythonMITLast push Oct 16, 2026