LFX Platform

Know more about LFX Platform

LFX Insights
Curated Collections

ML Model Serving Platforms

Frameworks and platforms designed to deploy, serve, and manage machine learning models in production environments with features for scaling, monitoring, and optimizing inference performance.

The Linux Foundation

by The Linux Foundation

18 projects ・ Updated 14 Mar 2025

Project
Contributors
Organizations
Software value
Kubeflow
10,790
2,324
$442M
Ray
9,061
1,536
$53M
ONNX Runtime
9,009
1,232
$165M
ONNX
8,076
1,029
$52M
TensorRT
4,039
471
$130M
TensorRT LLM
3,421
361
$49M
Modular Platform
2,689
467
$56M
MNN
2,609
189
$113M
Kserve
2,197
441
$243M
LMDeploy
1,697
178
$5.7M
BentoML
1,204
270
$3.1M
Intel XPU Backend for Triton
1,088
140
$11M
FedML
402
57
$7.9M
TFRT
187
32
$1.7M
Instill Core
137
28
$2.1M
Adlik
106
7
$2.7M
Machine Learning eXchange (MLX)
47
5
$376K
ForestFlow
10
5
$235K
Looking for a project that’s not listed?