LFX Platform

Know more about LFX Platform

LFX Insights

Binary Serialization Libraries

Libraries for efficient binary encoding and decoding of structured data, enabling high‐performance, low‐overhead serialization with zero‐copy capabilities across multiple programming languages.

43 projects

37,031 contributors

$152M

Protocol Buffers

Protocol Buffers is a language-agnostic, platform-neutral extensible mechanism for serializing structured data. It's a method of encoding structured data in an efficient yet extensible format, developed by Google. Protocol Buffers can be used to create services and APIs, define message formats, and enable communication between different systems and programming languages.

Contributors

10,711

Organizations

2,539

Software value

$34M

jackson-databind

Jackson-databind is a core data-binding package for Jackson, providing functionality to convert between Java objects and various data formats like JSON, XML, YAML, etc. It enables automatic serialization and deserialization of Java objects with extensive configuration options and customization features.

Contributors

4,034

Organizations

930

Software value

$8.9M

FlatBuffers

FlatBuffers is a serialization library developed by Google that provides an efficient, cross-platform way to serialize structured data. It offers memory efficiency, fast serialization/deserialization, and schema evolution while avoiding the need to parse/unpack data before access.

Contributors

3,306

Organizations

791

Software value

$9.3M

Kotlinx Serialization

Kotlin multiplatform / multi-format serialization

Contributors

2,335

Organizations

568

Software value

$4.2M

protobuf.js

A comprehensive implementation of Protocol Buffers in JavaScript/TypeScript, providing efficient binary serialization and deserialization of structured data with support for both Node.js and browsers

Contributors

2,300

Organizations

723

Software value

$1.2M

Go Protocol Buffers

Go Protocol Buffers is Google's official implementation of protocol buffers for the Go programming language. Protocol buffers are a language-neutral, platform-neutral extensible mechanism for serializing structured data.

Contributors

1,719

Organizations

621

Software value

$638K

Apache Avro

Apache Avro is a data serialization system.

Contributors

1,392

Organizations

333

Software value

$9M

MessagePack for C#

Extremely Fast MessagePack Serializer for C#(.NET, .NET Core, Unity, Xamarin). / msgpack.org[C#]

Contributors

1,350

Organizations

185

Software value

$2.7M

PROST

PROST! a Protocol Buffers implementation for the Rust Language

Contributors

1,068

Organizations

425

Software value

$527K

Buf

The best way of working with Protocol Buffers.

Contributors

1,008

Organizations

391

Software value

$8.3M

Cap'n Proto

Cap'n Proto serialization/RPC system - core tools and C++ library

Contributors

988

Organizations

292

Software value

$6M

ts-proto

An idiomatic protobuf generator for TypeScript

Contributors

892

Organizations

262

Software value

$4.7M

rust-protobuf

Rust implementation of Google protocol buffers

Contributors

666

Organizations

278

Software value

$2.7M

Safetensors

Simple, safe way to store and distribute tensors

Contributors

471

Organizations

155

Software value

$273K

MessagePack for Python

MessagePack implementation for C and C++ / msgpack.org[C/C++]

Contributors

444

Organizations

170

Software value

$162K

JLD2

HDF5-compatible file format in pure Julia

Contributors

403

Organizations

137

Software value

$364K

Chronicle Queue

Micro second messaging that stores everything to disk

Contributors

387

Organizations

60

Software value

$2.1M

JSONCONS

A C++, header-only library for constructing JSON and JSON-like data formats, with JSON Pointer, JSON Patch, JSON Schema, JSONPath, JMESPath, CSV, MessagePack, CBOR, BSON, UBJSON

Contributors

366

Organizations

66

Software value

$10M

uPickle

uPickle: a simple, fast, dependency-free JSON & Binary (MessagePack) serialization library for Scala

Contributors

365

Organizations

125

Software value

$770K

ByteString

ByteString is a Haskell library that provides fast, compact, strict and lazy byte arrays for efficient string manipulation and binary data handling. It offers an alternative to regular Haskell String types with better performance characteristics for certain use cases.

Contributors

338

Organizations

113

Software value

$473K

go-codec

idiomatic codec and rpc lib for msgpack, cbor, json, etc. msgpack.org[Go]

Contributors

312

Organizations

138

Software value

$4.6M

JS-BSON

JS-BSON is a JavaScript implementation of the BSON (Binary JSON) serialization format used by MongoDB. It provides functionality to serialize JavaScript objects to BSON and deserialize BSON back to JavaScript objects.

Contributors

285

Organizations

93

Software value

$7.9M

Numcodecs

A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.

Contributors

267

Organizations

121

Software value

$285K

rust-base64

base64, in rust

Contributors

262

Organizations

113

Software value

$177K

msgp

A Go code generator for MessagePack / msgpack.org[Go]

Contributors

240

Organizations

99

Software value

$1.2M

Chill

Scala extensions for the Kryo serialization library

Contributors

237

Organizations

68

Software value

$278K

MessagePack

msgpack.org[Go] MessagePack encoding for Golang

Contributors

237

Organizations

102

Software value

$193K

Chronicle Wire

A Low Garbage Java Serialisation Library that supports multiple formats

Contributors

154

Organizations

20

Software value

$3.1M

Airframe

Essential Building Blocks for Scala

Contributors

124

Organizations

34

Software value

$4.5M

CBOR Codec

CBOR codec (RFC 8949) with CBOR tags, Go struct tags (toarray, keyasint, omitempty), float64/32/16, big.Int, and fuzz tested billions of execs.

Contributors

115

Organizations

51

Software value

$969K

Multiformats

Multiformats interface (multihash, multicodec, multibase and CID)

Contributors

112

Organizations

61

Software value

$121K

xxhash

A Go implementation of the 64-bit xxHash algorithm (XXH64)

Contributors

75

Organizations

37

Software value

$35K

Protobom

protobom is a protocol buffers representation of SBOM data able to ingest documents in modern SPDX and CycloneDX versions without loss. It has an accompanying Go library generated from the protocol buffers definiton that also implements ingesters for those formats.

Contributors

68

Organizations

26

Software value

$22M

FFI with OCaml and Rust

Sets of libraries and tools to write applications and libraries mixing OCaml and Rust. These libraries will help keeping your types and data structures synchronized, and enable seamless exchange between OCaml and Rust

This project hasn't been onboarded to LFX Insights.

Kryo

Java binary serialization and cloning: fast, efficient, automatic

This project hasn't been onboarded to LFX Insights.

Swift Protobuf

Plugin and runtime library for using protobuf with Swift

This project hasn't been onboarded to LFX Insights.

binary

Efficient, pure binary serialisation using ByteStrings in Haskell.

This project hasn't been onboarded to LFX Insights.

msgpackr

Ultra-fast MessagePack implementation with extension for record and structural cloning / msgpack.org[JavaScript/NodeJS]

This project hasn't been onboarded to LFX Insights.

node-cbor

Encode and decode CBOR documents, with both easy mode, streaming mode, and SAX-style evented mode.

This project hasn't been onboarded to LFX Insights.
Looking for a project that’s not listed?