LFX Platform

Know more about LFX Platform

LFX Insights

Parallel Computing Libraries

Libraries that simplify parallel execution of code by leveraging multi-threading, multiprocessing, or distributed execution paradigms for faster computations.

61 projects

43,400 contributors

$2.1B

Apache Spark

Apache Spark - A unified analytics engine for large-scale data processing

Contributors

9,125

Organizations

1,282

Software value

$82M

ipython

ipython is a sub-project of Project Jupyter.

Contributors

8,696

Organizations

1,714

Software value

$72M

Dask

Dask is a flexible parallel computing library for analytics that provides dynamic task scheduling optimized for computation and integrates with Python data science libraries like NumPy, Pandas and Scikit-learn. It enables parallel and distributed computing through intuitive APIs and scales Python code from multi-core machines to clusters.

Contributors

3,572

Organizations

901

Software value

$6.9M

OpenJDK Panama Foreign

https://openjdk.org/projects/panama

Contributors

2,539

Organizations

119

Software value

$431M

Open MPI

Open MPI is a high-performance message passing library implementation of the Message Passing Interface (MPI) standard, designed for distributed memory computing environments and parallel programming. It provides a portable and efficient framework for developing parallel applications across different computing platforms and architectures.

Contributors

2,259

Organizations

411

Software value

$21M

CuPy

NumPy & SciPy for GPU

Contributors

1,993

Organizations

428

Software value

$8.6M

Colossal-AI

Making large AI models cheaper, faster and more accessible

Contributors

1,460

Organizations

160

Software value

$9.2M

joblib

Joblib is a set of tools to provide lightweight pipelining in Python, designed to optimize disk I/O operations, caching, and parallel processing. It offers transparent disk-caching of functions and lazy re-evaluation, as well as simple parallel computing capabilities.

Contributors

1,246

Organizations

401

Software value

$694K

Kokkos Project

The mission of the Project is to develop and support a programming system for performance portability across hardware architectures relevant for compute heavy workloads. The Project is composed of subprojects addressing different aspects of a comprehensive performance portability solution for engineering, science and other compute intensive software.

Contributors

1,223

Organizations

181

Software value

$606M

MLX

MLX: An array framework for Apple silicon

Contributors

1,028

Organizations

245

Software value

$5.5M

Rayon

Rayon is a data parallelism library for Rust that makes it easy to convert sequential computations into parallel ones. It provides parallel iterators, parallel collections, and other utilities for writing fast, safe parallel code.

Contributors

828

Organizations

305

Software value

$972K

AMReX

The mission and charitable purposes (collectively, the “Charitable Purposes”) of the Project is to provide a parallel, performance-portable block-structured adaptive mesh refinement framework for science and engineering applications.

Contributors

792

Organizations

75

Software value

$185M

CUDA Core Compute Libraries (CCCL)

CUDA Core Compute Libraries

Contributors

778

Organizations

148

Software value

$28M

WarpX

The mission and charitable purposes (collectively, the “Charitable Purposes”) of the Project is to provide a community, performance-portable and modular Particle in-Cell code with advanced algorithms.

Contributors

601

Organizations

56

Software value

$12M

HYPRE

Parallel solvers for sparse linear systems featuring multigrid methods.

Contributors

536

Organizations

66

Software value

$24M

Daft

Distributed data engine for Python/SQL designed for the cloud, powered by Rust

Contributors

535

Organizations

111

Software value

$15M

HOOMD-blue

Molecular dynamics and Monte Carlo soft matter simulation on GPUs.

Contributors

498

Organizations

37

Software value

$8.6M

RAPIDS Accelerator For Apache Spark

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Contributors

402

Organizations

40

Software value

$13M

ASPECT

A parallel, extensible finite element code to simulate convection in both 2D and 3D models.

Contributors

401

Organizations

27

Software value

$50M

Parsl

Parsl - a Python parallel scripting library

Contributors

389

Organizations

84

Software value

$1.1M

Highway

Performance-portable, length-agnostic SIMD with runtime dispatch

Contributors

371

Organizations

99

Software value

$4.6M

NWChem

NWChem: Open Source High-Performance Computational Chemistry

Contributors

322

Organizations

43

Software value

$218M

Hardware Locality (hwloc)

Hardware locality (hwloc)

Contributors

319

Organizations

98

Software value

$3.5M

Legion

Legion is a high-performance data-centric parallel programming system that enables efficient distributed execution of applications on heterogeneous architectures. It provides a programming model and runtime system for writing portable high performance programs targeting distributed heterogeneous architectures.

Contributors

311

Organizations

51

Software value

$23M

QMCPACK

Main repository for QMCPACK, an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids with full performance portable GPU support

Contributors

292

Organizations

30

Software value

$74M

LinearSolve.jl

LinearSolve.jl: High-Performance Unified Interface for Linear Solvers in Julia. Easily switch between factorization and Krylov methods, add preconditioners, and all in one interface.

Contributors

286

Organizations

80

Software value

$697K

OpenPMIx

OpenPMIx Project Repository

Contributors

271

Organizations

70

Software value

$5.6M

PIConGPU

Performance-Portable Particle-in-Cell Simulations for the Exascale Era :sparkles:

Contributors

261

Organizations

32

Software value

$15M

QUDA

QUDA is a library for performing calculations in lattice QCD on GPUs.

Contributors

253

Organizations

28

Software value

$5.3M

preCICE

A coupling library for partitioned multi-physics simulations, including, but not restricted to fluid-structure interaction and conjugate heat transfer simulations.

Contributors

253

Organizations

29

Software value

$4.8M

Feel++

:gem: Feel++: Finite Element Embedded Language and Library in C++

Contributors

243

Organizations

18

Software value

$30M

Ginkgo

Numerical linear algebra software package

Contributors

211

Organizations

43

Software value

$9.7M

RAJA

RAJA Performance Portability Layer (C++)

Contributors

205

Organizations

19

Software value

$4.8M

ITensors.jl

A Julia library for efficient tensor computations and tensor network calculations. ITensor is supported by the Simons Foundation's Flatiron Institute.

Contributors

201

Organizations

36

Software value

$1.2M

Earth System Modeling Framework (ESMF)

The Earth System Modeling Framework (ESMF) is a suite of software tools for developing high-performance, multi-component Earth science modeling applications.

Contributors

184

Organizations

29

Software value

$44M

Yambo

This is the official GPL repository of the yambo code

Contributors

152

Organizations

18

Software value

$4.5M

TornadoVM

TornadoVM: A practical and efficient heterogeneous programming framework for managed languages

Contributors

145

Organizations

21

Software value

$5.7M

SCOREC Core

SCOREC Core is a scientific computing library that provides mesh data structures, parallel mesh adaptation, and geometric modeling capabilities for high-performance computing applications. It focuses on parallel mesh modification, load balancing, and geometric operations for simulation workflows.

Contributors

109

Organizations

4

Software value

$3.8M

Goma

A Full-Newton Finite Element Program for Free and Moving Boundary Problems with Coupled Fluid/Solid Momentum, Energy, Mass, and Chemical Species Transport

Contributors

71

Organizations

3

Software value

$13M

PISM (Parallel Ice Sheet Model)

PISM (Parallel Ice Sheet Model) is a computer model for simulating large-scale ice sheets and glaciers. It uses parallel computing techniques to simulate ice dynamics, thermodynamics, and interactions with climate and ocean systems, enabling research on past and future ice sheet behavior, sea level change, and climate dynamics.

Contributors

39

Organizations

2

Software value

$4.3M

Apache Uniffle

Uniffle is a high performance, general purpose Remote Shuffle Service.

This project hasn't been onboarded to LFX Insights.

Castro

Castro (Compressible Astrophysics): An adaptive mesh, astrophysical compressible (radiation-, magneto-) hydrodynamics simulation code for massively parallel CPU and GPU architectures.

This project hasn't been onboarded to LFX Insights.

GPUArrays

Reusable array functionality for Julia's various GPU backends.

This project hasn't been onboarded to LFX Insights.

Gloo

Collective communications library with various primitives for multi-machine training.

This project hasn't been onboarded to LFX Insights.

HeAT

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

This project hasn't been onboarded to LFX Insights.

KernelAbstractions.jl

Heterogeneous programming in Julia

This project hasn't been onboarded to LFX Insights.

MPI.jl

MPI wrappers for Julia

This project hasn't been onboarded to LFX Insights.

NCCL

Optimized primitives for collective multi-GPU communication

This project hasn't been onboarded to LFX Insights.

OneFlow

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

This project hasn't been onboarded to LFX Insights.

Paboyle_Data_Parallel_Cpp_Grid

Data parallel C++ mathematical object library

This project hasn't been onboarded to LFX Insights.

SIMDe

Implementations of SIMD instruction sets for systems which don't natively support them.

This project hasn't been onboarded to LFX Insights.

SPHinXsys

SPHinXsys provides C++ APIs for engineering simulation and optimization. It aims at complex systems driven by fluid, structure, multi-body dynamics and beyond. The multi-physics library is based on a unique and unified computational framework by which strong coupling has been achieved for all involved physics.

This project hasn't been onboarded to LFX Insights.

SimSIMD

Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, and bit vectors using SIMD for both AVX2, AVX-512, NEON, SVE, & SVE2 📐

This project hasn't been onboarded to LFX Insights.

VOLK

The Vector Optimized Library of Kernels

This project hasn't been onboarded to LFX Insights.

Workflow

C++ Parallel Computing and Asynchronous Networking Framework

This project hasn't been onboarded to LFX Insights.

Xilinx Runtime

Run Time for AIE and FPGA based platforms

This project hasn't been onboarded to LFX Insights.

libEnsemble

A Python toolkit for coordinating asynchronous and dynamic ensembles of calculations.

This project hasn't been onboarded to LFX Insights.
Looking for a project that’s not listed?