Search projects, repositories, or collections

⇧+K

Curated Collections

On-Device Neural Engines

Frameworks and runtimes optimized for executing neural network models directly on edge and mobile devices.

by The Linux Foundation

・

29 projects ・ Updated 14 Mar 2025

Only Linux Foundation projects

Project

Contributors

Organizations

Software value

llama cpp

12,668

1,939

$31M

ONNX Runtime

9,014

1,235

$166M

YOLOv5

8,839

714

$802K

ONNX

8,076

1,029

$52M

OpenVINO

4,504

403

$84M

TensorRT

4,040

471

$130M

ncnn

3,527

313

$28M

TensorRT LLM

3,424

361

$51M

Triton Inference Server

3,373

513

$5.2M

Apache TVM

3,307

398

$22M

MNN

2,613

190

$113M

MLC LLM

1,737

243

$2.9M

XLA

1,734

221

$61M

LMDeploy

1,699

178

$5.8M

ExecuTorch

1,625

180

$32M

TT-Metal

1,577

$125M

GGML

1,570

278

$8.3M

MLX

1,118

270

$5.8M

Deep Java Library (DJL)

997

133

$18M

Ascend Extension for PyTorch

494

$15M

Neural Network (NN) Streamer

459

$34M

XNNPACK

427

$106M

Optimum Intel

318

$1.9M

tract

307

$6.8M

TFRT

187

$1.7M

NNTrainer

160

$10M

ShaderNN

Archived

$35M

Neuro-One

Torch-TensorRT

Looking for a project that’s not listed?