LFX Platform

Know more about LFX Platform

LFX Insights
Curated Collections

ML Model Serving Platforms

Frameworks and platforms designed to deploy, serve, and manage machine learning models in production environments with features for scaling, monitoring, and optimizing inference performance.

The Linux Foundation

by The Linux Foundation

19 projects

Project
Contributors
Organizations
Software value
Kubeflow
10,767
2,311
$441M
Ray
9,040
1,534
$53M
ONNX Runtime
8,996
1,232
$165M
ONNX
8,074
1,025
$52M
TensorRT
4,033
471
$130M
TensorRT LLM
3,394
360
$49M
Modular Platform
2,683
466
$55M
MNN
2,592
189
$112M
Kserve
2,191
439
$233M
LMDeploy
1,696
178
$5.6M
BentoML
1,204
270
$3.1M
Intel XPU Backend for Triton
1,088
140
$11M
FedML
402
57
$7.9M
TFRT
187
32
$1.7M
Instill Core
136
28
$2.1M
Adlik
106
7
$2.7M
Machine Learning eXchange (MLX)
47
5
$376K
ForestFlow
10
5
$235K
Looking for a project that’s not listed?