Hacker News with Generative AI: Compression Algorithms

Reverse-engineering Fujitsu M7MU RELC hardware compression (op-co.de)
This is a follow-up to the Samsung NX mini (M7MU) firmware reverse-engineering series. This part is about the proprietary LZSS compression used for the code sections in the firmware of Samsung NX mini, NX3000/NX3300 and Galaxy K Zoom. The post is documenting the step-by-step discovery process, in order to show how an unknown compression algorithm can be analyzed. The discovery process was supported by Igor Skochinsky and Tedd Sterr, and by writing the ideas out on encode.su.
Hardware, Reverse Engineering, Compression Algorithms, Firmware, Samsung
40 points by ge0rg 18 days ago | 2 comments
Taking a Look at Compression Algorithms (cefboud.github.io)
I recently undertook the delusional project of writing my own implementation of a Kafka Broker: MonKafka. Deep into that rabbit hole, I fell into a different one when trying to implement compression for Kafka’s record batches. Kafka supports, as of now, four schemes: GZIP, Snappy, LZ4, and ZSTD. While proceeding with my implementation, I realized I really didn’t know that much about the fascinating topic of compression.
Compression Algorithms, Software Development, Kafka
213 points by thunderbong 123 days ago | 38 comments
Dissecting the gzip format (2011) (infinitepartitions.com)
In this article I describe the DEFLATE algorithm that GZIP implements and depends on. The DEFLATE algorithm uses a combination of LZ77, Huffman codes and run-length-encoding; this article describes each in detail by walking through an example and developing source code to implement the algorithm. My aim is to implement readable rather than efficient or extensible code. I'll focus here on unzipping, rather than zipping, but by the end of the article, the zipping process should be clear.
Compression Algorithms, Software, Computer Science, Programming, Data Structures
113 points by solannou 250 days ago | 55 comments
Latest update for 'fast' compression algorithm LZ4 sprints past old versions (theregister.com)
Compression Algorithms, Software, Performance, Speed
7 points by uticus 297 days ago | 0 comments
A (hopefully) new compression algorithm that uses binomials (github.com/Peter-Ebert)
Compression Algorithms, Mathematics, Open Source, Software
29 points by peter-ebert 333 days ago | 55 comments