32 projects
Laravel Framework
Laravel Framework is an open-source PHP framework for building web applications, offering features such as routing, authentication, and database management.
Contributors
23,916
Organizations
4,492
Software value
$11M
Celery
Celery is a distributed task queue system that enables asynchronous task processing and scheduling in Python applications. It supports real-time operations, scheduled tasks, and complex workflows with features like task routing, retries, and monitoring.
Contributors
8,957
Organizations
2,255
Software value
$4M
Ray
Ray is an open-source unified framework for scaling AI and Python applications. It provides a simple, universal API for building distributed applications and includes libraries for machine learning, serving, streaming, and more. Ray enables developers to parallelize single-machine code with minimal code changes and scale applications from a laptop to a cluster.
Contributors
8,643
Organizations
1,461
Software value
$49M
Sidekiq
Sidekiq is a background job processing system for Ruby applications that uses Redis for job storage and provides features like scheduling, retries, and monitoring through a web interface. It enables efficient handling of asynchronous tasks and is designed to be enterprise-ready with high performance and reliability.
Contributors
5,627
Organizations
1,765
Software value
$787K
Apache Beam
Apache Beam is a unified programming model and framework for building and executing batch and streaming data processing pipelines. It provides a portable API that enables developers to write data processing code once and run it on various execution engines like Apache Spark, Apache Flink, and Google Cloud Dataflow.
Contributors
4,738
Organizations
623
Software value
$94M
Prefect
Prefect is a workflow orchestration platform that enables users to build, schedule, and monitor data pipelines and machine learning workflows. It provides a Python-based framework for creating resilient, distributed workflows with features like automatic retries, caching, and real-time monitoring.
Contributors
3,772
Organizations
747
Software value
$30M
Apache Hadoop
Apache Hadoop is a distributed computing framework that enables processing and storage of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, with each offering local computation and storage.
Contributors
2,311
Organizations
268
Software value
$190M
Quartz Scheduler
Quartz is an open source job scheduling library that enables Java applications to schedule and execute jobs at specified times and intervals. It provides a rich set of features for defining triggers, handling job persistence, clustering, and managing scheduled tasks in enterprise applications.
Contributors
1,391
Organizations
222
Software value
$1.6M
node-cron
Cron for NodeJS.
Contributors
1,161
Organizations
288
Software value
$152K
Windmill
Windmill is an open-source developer platform for building internal tools and workflows. It provides a low-code solution for creating backend scripts, APIs, and UIs with features like resource management, scheduling, and version control. The platform enables developers to write scripts in multiple languages and automate business processes.
Contributors
895
Organizations
238
Software value
$23M
HTCondor
HTCondor is a specialized workload management system for compute-intensive jobs. It provides a job queueing mechanism, scheduling policy, priority scheme, resource monitoring, and resource management. HTCondor places jobs on distributed computing resources and manages their execution, handling job submission, monitoring, and completion across clusters and grids.
Contributors
397
Organizations
51
Software value
$29M
HPCC Systems Platform
HPCC Systems Platform is an open-source, enterprise-grade big data analytics computing platform that allows processing and analysis of massive data sets across parallel computing clusters. It provides a complete end-to-end data lake management solution with built-in ETL capabilities, high-performance distributed computing, and a declarative programming language called ECL.
Contributors
289
Organizations
9
Software value
$89M
workerpool
A JavaScript library that provides a pool of web workers for parallel processing and task execution in both Node.js and browser environments, enabling efficient distribution of CPU-intensive tasks across multiple threads
Contributors
286
Organizations
91
Software value
$213K
fastq
Fast, in memory work queue
Contributors
93
Organizations
34
Software value
$43K
Pegasus WMS
Pegasus WMS is a workflow management system that automates the execution of complex computational workflows across distributed computing resources. It transforms abstract workflow descriptions into concrete execution plans, handles data management, job scheduling, and fault tolerance for scientific applications.
Contributors
80
Organizations
11
Software value
$24M
Action Scheduler
A scalable, traceable job queue for background processing large queues of tasks in WordPress. Specifically designed for distribution in WordPress plugins (and themes) - no server access required.
This project hasn't been onboarded to LFX Insights.
ActiveJob::TrafficControl
Database-backed Active Job backend
This project hasn't been onboarded to LFX Insights.
Apache Tez
Apache Tez
This project hasn't been onboarded to LFX Insights.
BullMQ
BullMQ - Message Queue and Batch processing for NodeJS and Python based on Redis
This project hasn't been onboarded to LFX Insights.
DolphinScheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
This project hasn't been onboarded to LFX Insights.
Ganga
Ganga is an easy-to-use frontend for job definition and management
This project hasn't been onboarded to LFX Insights.
Hangfire
An easy way to perform background job processing in .NET and .NET Core applications. No Windows Service or separate process required
This project hasn't been onboarded to LFX Insights.
Oban
💎 Robust job processing in Elixir, backed by modern PostgreSQL, SQLite3, and MySQL
This project hasn't been onboarded to LFX Insights.
Odoo Queue
Asynchronous Job Queue
This project hasn't been onboarded to LFX Insights.
Redis Queue
Simple job queues for Python
This project hasn't been onboarded to LFX Insights.
Resque
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
This project hasn't been onboarded to LFX Insights.
Sidekiq-Cron
Scheduler / Cron for Sidekiq jobs
This project hasn't been onboarded to LFX Insights.
Spring Batch
Spring Batch is a framework for writing batch applications using Java and Spring
This project hasn't been onboarded to LFX Insights.
enqueue
Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro
This project hasn't been onboarded to LFX Insights.
gocron
Easy and fluent Go cron scheduling. This is a fork from https://github.com/jasonlvhit/gocron
This project hasn't been onboarded to LFX Insights.
node-resque
Node.js Background jobs backed by redis.
This project hasn't been onboarded to LFX Insights.