Skip to content

airlift/aircompressor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Compression in pure Java

Maven Central

This library contains implementations of Zstandard (Zstd), LZ4, Snappy, and LZO written in pure Java. They are typically 10-40% faster than the JNI wrapper for the native libraries.
Additionally implementations of GZIP and Deflate using the Java built-in library, and pure Java BZip2 implementations are provided for ease of integrations with systems that need these algorithms.

Hadoop CompressionCodec

In addition to the raw block encoders, there are implementations of the Hadoop CompressionCodec (Streaming) for each algorithm. They are typically 300% faster than the JNI wrappers.

Requirements

This library requires a Java 1.8+ virtual machine containing the sun.misc.Unsafe interface running on a little endian platform.

Users

This library is used in projects such as Trino (https://trino.io), a distributed SQL engine.