LFX Platform

Know more about LFX Platform

Meet us in Atlanta for KubeCon + CloudNativeCon North America · Nov 10-13 REGISTER TODAY
LFX Insights

Distributed Streaming Platforms

Platforms for processing and analyzing large volumes of real-time data streams.

16 projects

17,254 contributors

$370M

Apache Flink

Apache Flink is a distributed stream processing and batch computation framework. It provides high-throughput, low-latency data streaming engines as well as support for event-driven applications and batch processing. The framework enables stateful computations over data streams and features automatic memory management, fault tolerance, and exactly-once processing semantics.

Contributors

4,830

Organizations

564

Software value

$97M

Apache Kafka

Apache Kafka is a distributed event streaming platform designed for high-throughput, fault-tolerant handling of real-time data feeds. It enables building real-time streaming data pipelines and applications that can process, transform, and react to streams of events.

Contributors

4,157

Organizations

710

Software value

$43M

Strimzi

Strimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.

Contributors

3,531

Organizations

834

Software value

$122M

Apache Pulsar

Apache Pulsar is a cloud-native, distributed messaging and streaming platform designed to handle high-performance workloads. It provides pub-sub messaging, queuing, stream processing, and event streaming capabilities with built-in multi-tenancy, geo-replication, and persistent storage features.

Contributors

3,483

Organizations

530

Software value

$28M

Pravega

Pravega is a storage system that uses Stream as the main building block for storing continuous and limitless data.

Contributors

775

Organizations

165

Software value

$70M

Tremor

Tremor is an early stage event processing system for unstructured data with rich support for structural pattern matching, filtering and transformation.

Contributors

478

Organizations

92

Software value

$11M

Apache Kafka client for Go

Sarama is a Go library for Apache Kafka.

This project hasn't been onboarded to LFX Insights.

AutoMQ

AutoMQ is a cloud-native alternative to Kafka by decoupling durability to S3 and EBS. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency.

This project hasn't been onboarded to LFX Insights.

BookKeeper

Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads

This project hasn't been onboarded to LFX Insights.

Celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

This project hasn't been onboarded to LFX Insights.

Franz

franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.8+. Producing, consuming, transacting, administrating, etc.

This project hasn't been onboarded to LFX Insights.

Kafka Docker Playground

🐳✨ Fully automated Apache Kafka® and Confluent Docker based examples // 👷‍♂️ Easily build examples or reproduction models

This project hasn't been onboarded to LFX Insights.

Redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

This project hasn't been onboarded to LFX Insights.

RocketMQ

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

This project hasn't been onboarded to LFX Insights.

Storm

Apache Storm

This project hasn't been onboarded to LFX Insights.

Viridian

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

This project hasn't been onboarded to LFX Insights.
Looking for a project that’s not listed?