Search projects, repositories, or collections

⇧+K

Curated Collections

LLM API Gateways

Tools that provide a unified API interface and proxy layers for accessing multiple large language model services.

by The Linux Foundation

・

21 projects

Only Linux Foundation projects

Project

Contributors

Organizations

Software value

vLLM

24,757

2,604

$94M

Ollama

17,476

2,825

$32M

LiteLLM

9,349

1,710

$55M

SGLang

6,642

741

$33M

Spring AI

3,057

432

$11M

OpenAI Python API library

2,851

572

$3.2M

llama-cpp-python

2,650

437

$822K

Agno

2,605

370

$18M

LocalAI

1,738

339

$14M

ChatGPT

1,617

224

$626K

Quivr

1,283

152

$512K

LLM

875

343

$766K

tiktoken

709

199

$81K

AI Gateway

470

104

$3.6M

Quarkus LangChain4j

323

$7.3M

llm-d

280

$1.1M

RisuAI

170

$84M

Instill Core

136

$2.1M

SillyTavern

$7.1M

Unstructured

$38M

Looking for a project that’s not listed?