Ad

density: High-speed compression library

Density is a pure Rust compression library focused on achieving exceptional compression speed through a unique 4-byte work unit design. It provides a straightforward API for quick integration in Rust projects.
Screenshot of g1mv/density homepage

Density is a pure Rust open-source compression library designed for high-speed compression. Density achieves this speed through a novel 4-byte work unit approach, unlike conventional byte-oriented algorithms. The library provides a simple API for easy integration into Rust projects, prioritizing performance without sacrificing reasonable compression ratios. It offers three primary algorithms: Chameleon, Cheetah, and Lion, each optimized for different performance/ratio tradeoffs.

Density's core design centers around 4-byte work units, leveraging processor registers and minimizing branching for speed. The library features a straightforward API for rapid integration and includes an in-memory benchmark for performance evaluation. It offers configurable options for optimization and includes robust error handling. Density is actively maintained with a clear release cycle, ensuring ongoing support and updates.

  • Performance: Achieves high compression speeds through 4-byte work units and register usage.
  • Ease of Use: Provides a simple and intuitive API for easy integration into Rust projects.
  • Benchmarking: Includes an integrated in-memory benchmark for performance testing.
  • Multiple Algorithms: Offers Chameleon, Cheetah, and Lion algorithms for different trade-offs.
  • Safety: Implements a 'blowup protection' to prevent exceeding input data size.
  • Community: Actively maintained with a growing user base and contributors.
  • Extensibility: Designed to be easily integrated into existing data processing pipelines.

Density is an actively maintained project with a solid release history and regular updates. The project has a strong community presence and provides comprehensive documentation, including examples and benchmark results. Recent commits indicate ongoing development and improvements. The stable releases ensure reliability for production use.

Density benefits developers seeking high-performance compression solutions for Rust applications. It is well-suited for scenarios demanding fast compression and decompression, such as data streaming, network transfer, and archival. Density offers a compelling alternative to slower, more established algorithms, particularly when speed is a primary concern.

Languages:
Summarize:
Share:
Stars
1,043
Forks
54
Issues
0
Created
12 years ago
Commit
2 months ago
License
APACHE-2.0
Archived
No
Updated 17 days ago

Similar Repositories