LFX Platform

Know more about LFX Platform

Meet us in Atlanta for KubeCon + CloudNativeCon North America · Nov 10-13 REGISTER TODAY
LFX Insights

LLM Application Frameworks

Frameworks for building applications that leverage large language models to enable context-aware reasoning and decision making.

37 projects

57,794 contributors

$189M

LangChain

LangChain is a framework for developing applications powered by language models, offering tools and abstractions for building LLM-powered applications. It provides components for working with language models, document processing, memory/state management, and chains/agents for complex reasoning.

Contributors

22,442

Organizations

2,692

Software value

$8.6M

LLamaIndex

LlamaIndex is an open-source data framework for building LLM applications, providing tools to connect custom data sources to large language models, with features for data ingestion, structuring, retrieval, and natural language querying.

Contributors

8,233

Organizations

1,061

Software value

$61M

AutoGPT

AutoGPT is an experimental open-source application that demonstrates autonomous AI agents. It implements GPT-4 to create AI agents that can independently perform tasks and achieve specified goals through chain-of-thought reasoning and task decomposition.

Contributors

7,363

Organizations

832

Software value

$34M

SGLang

SGLang is a structured generation language and runtime system designed for efficient text generation and large language model inference. It provides a Python-based DSL for defining generation workflows with features like speculative decoding and token healing.

Contributors

4,460

Organizations

553

Software value

$17M

Llama Models

A collection of large language models (LLMs) developed by Meta AI, including the Llama family of models. These models are designed for natural language processing tasks and are made available for research and commercial use under specific licensing terms.

Contributors

3,943

Organizations

683

Software value

$358K

FastChat

FastChat is an open-source platform for training, serving, and evaluating large language models (LLMs). It provides tools for training and deploying LLM-based chatbots, including implementations of models like Vicuna and support for various model architectures.

Contributors

2,827

Organizations

423

Software value

$1M

Ollama

Ollama is an open-source project that allows running, managing and serving large language models (LLMs) locally. It provides a simple API to run models like Llama 2, Mistral, and others on your own hardware, with features for model management, customization, and efficient inference.

Contributors

585

Organizations

94

Software value

$23M

FlagAI

The mission of the Project is to develop a fast, easy-to-use and extensible toolkit for large-scale AI modeling, with the goal of supporting training, fine-tuning, and deployment of large-scale models on various downstream tasks with multi-modality.

Contributors

333

Organizations

29

Software value

$8.7M

Unsloth

Unsloth is an open-source project focused on optimizing and accelerating Large Language Models (LLMs) through efficient fine-tuning techniques. It provides tools and methods for faster LLM training and inference while reducing memory usage and computational requirements.

Contributors

134

Organizations

15

Software value

$1.1M

AGENTS.md

A project focused on AI agents and their capabilities, likely containing documentation or guidelines about agent-based AI systems

Contributors

111

Organizations

56

Software value

$48K

AI SDK

Build AI-powered applications with React, Svelte, Vue, and Solid

This project hasn't been onboarded to LFX Insights.

ChatGPT on WeChat

基于大模型搭建的聊天机器人,同时支持 微信公众号、企业微信应用、飞书、钉钉 等接入,可选择GPT3.5/GPT-4o/GPT-o1/ DeepSeek/Claude/文心一言/讯飞星火/通义千问/ Gemini/GLM-4/Claude/Kimi/LinkAI,能处理文本、语音和图片,访问操作系统和互联网,支持基于自有知识库进行定制企业智能客服。

This project hasn't been onboarded to LFX Insights.

ChatGPT-Next-Web

✨ Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

This project hasn't been onboarded to LFX Insights.

Continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

This project hasn't been onboarded to LFX Insights.

DSPy

DSPy: The framework for programming—not prompting—language models

This project hasn't been onboarded to LFX Insights.

Dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

This project hasn't been onboarded to LFX Insights.

FlashInfer

FlashInfer: Kernel Library for LLM Serving

This project hasn't been onboarded to LFX Insights.

GPT Researcher

LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.

This project hasn't been onboarded to LFX Insights.

H2O GPT

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

This project hasn't been onboarded to LFX Insights.

Haystack

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

This project hasn't been onboarded to LFX Insights.

Infiniflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

This project hasn't been onboarded to LFX Insights.

InstructLab Core

InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

This project hasn't been onboarded to LFX Insights.

JanHQ

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

This project hasn't been onboarded to LFX Insights.

LLaMA.cpp

LLM inference in C/C++

This project hasn't been onboarded to LFX Insights.

Langchain-Chatchat

Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

This project hasn't been onboarded to LFX Insights.

Langflow

Langflow is a low-code app builder for RAG and multi-agent AI applications. It’s Python-based and agnostic to any model, API, or database.

This project hasn't been onboarded to LFX Insights.

Llama Cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

This project hasn't been onboarded to LFX Insights.

Llamafile

Distribute and run LLMs with a single file.

This project hasn't been onboarded to LFX Insights.

MaxKB

💬 Ready-to-use & flexible RAG Chatbot, supporting mainstream large language models (LLMs) such as DeepSeek-R1, Llama 3.3, Qwen2, OpenAI, and more.

This project hasn't been onboarded to LFX Insights.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

This project hasn't been onboarded to LFX Insights.

Open WebUI

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

This project hasn't been onboarded to LFX Insights.

OpenAI Playground

LLM Frontend for Power Users.

This project hasn't been onboarded to LFX Insights.

PEFT

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

This project hasn't been onboarded to LFX Insights.

Project Cambria

Chatbot for documentation, that allows you to chat with your data. Privately deployable, provides AI knowledge sharing and integrates knowledge into your AI workflow

This project hasn't been onboarded to LFX Insights.

The Multi-Agent Framework

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

This project hasn't been onboarded to LFX Insights.
Looking for a project that’s not listed?