LFX Platform

Know more about LFX Platform

LFX Insights
Curated Collections

On-Device Neural Engines

Frameworks and runtimes optimized for executing neural network models directly on edge and mobile devices.

The Linux Foundation

by The Linux Foundation

29 projects ・ Updated 14 Mar 2025

Project
Contributors
Organizations
Software value
llama cpp
12,644
1,935
$31M
ONNX Runtime
9,009
1,232
$165M
YOLOv5
8,838
714
$802K
ONNX
8,076
1,029
$52M
OpenVINO
4,503
403
$84M
TensorRT
4,039
471
$130M
ncnn
3,527
313
$28M
TensorRT LLM
3,421
361
$49M
Triton Inference Server
3,373
513
$5.2M
Apache TVM
3,306
398
$22M
MNN
2,609
189
$113M
MLC LLM
1,737
243
$2.9M
XLA
1,733
221
$60M
LMDeploy
1,697
178
$5.7M
ExecuTorch
1,624
180
$32M
TT-Metal
1,577
91
$124M
GGML
1,570
278
$8.3M
MLX
1,117
270
$5.8M
Deep Java Library (DJL)
997
133
$18M
Ascend Extension for PyTorch
494
14
$14M
Neural Network (NN) Streamer
459
48
$34M
XNNPACK
427
98
$106M
Optimum Intel
318
35
$1.9M
tract
307
78
$6.8M
TFRT
187
32
$1.7M
NNTrainer
160
14
$10M
ShaderNN
Archived
14
3
$35M
Neuro-One
0
0
$0
Torch-TensorRT
0
0
$0
Looking for a project that’s not listed?