Data Compression Device based on Modified LZ4 Algorithm

Weiqiang Liu, Faqiang Mei, Chenghua Wang, Maire O'Neill, Earl E. Swartzlander

Research output: Contribution to journalArticlepeer-review

43 Citations (Scopus)
2894 Downloads (Pure)

Abstract

Data compression is commonly used in NAND flash-based Solid State Drives (SSDs) to increase their storage performance and lifetime as it can reduce the amount of data written to and read from NAND flash memory. Software based data compression reduces SSD performance significantly and, as such, hardware-based data compression designs are required. This paper studies the latest lossless data compression algorithm, i.e., the LZ4 algorithm which is one of the fastest compression algorithms reported to date. A data compression FPGA prototype based on the LZ4 lossless compression algorithm is studied. The original LZ4 compression algorithm is modified for real-time hardware implementation. Two hardware architectures of the modified LZ4 algorithm (MLZ4) are proposed with both compressors and decompressors, which are implemented on a FPGA evaluation kit. The implementation results show that the proposed compressor architecture can achieve a high throughput of up to 1.92Gbps with a compression ratio of up to 2.05, which is higher than all previous LZ algorithm designs implemented on FPGAs. The compression device can be used in high-end SSDs to further increase their storage performance and lifetime.
Original languageEnglish
Pages (from-to)110-117
Number of pages9
JournalIEEE Transactions on Consumer Electronics
Volume64
Issue number1
Early online date02 Mar 2018
DOIs
Publication statusEarly online date - 02 Mar 2018

Fingerprint

Dive into the research topics of 'Data Compression Device based on Modified LZ4 Algorithm'. Together they form a unique fingerprint.

Cite this