Search projects, repositories, or collections

⇧+K

Curated Collections

On-Device Neural Engines

Frameworks and runtimes optimized for executing neural network models directly on edge and mobile devices.

by The Linux Foundation

・

29 projects ・ Updated 14 Mar 2025

Only Linux Foundation projects

Project

Contributors

Organizations

Software value

llama cpp

12,644

1,935

$31M

ONNX Runtime

9,009

1,232

$165M

YOLOv5

8,838

714

$802K

ONNX

8,076

1,029

$52M

OpenVINO

4,503

403

$84M

TensorRT

4,039

471

$130M

ncnn

3,527

313

$28M

TensorRT LLM

3,421

361

$49M

Triton Inference Server

3,373

513

$5.2M

Apache TVM

3,306

398

$22M

MNN

2,609

189

$113M

MLC LLM

1,737

243

$2.9M

XLA

1,733

221

$60M

LMDeploy

1,697

178

$5.7M

ExecuTorch

1,624

180

$32M

TT-Metal

1,577

$124M

GGML

1,570

278

$8.3M

MLX

1,117

270

$5.8M

Deep Java Library (DJL)

997

133

$18M

Ascend Extension for PyTorch

494

$14M

Neural Network (NN) Streamer

459

$34M

XNNPACK

427

$106M

Optimum Intel

318

$1.9M

tract

307

$6.8M

TFRT

187

$1.7M

NNTrainer

160

$10M

ShaderNN

Archived

$35M

Neuro-One

Torch-TensorRT

Looking for a project that’s not listed?