Hacker News with Generative AI: Deduplication

Show HN: Plik – a tiny FUSE filesystem with compression and deduplication (sytes.net)
File system in user space (FUSE) with compression and deduplication. Written in a single C file (1K LOC). Uses OpenSSL for hashing, zlib for compression and SQLite for data storage.
Operating Systems, File Systems, Compression, Deduplication
5 points by zeymejbdv 25 days ago | 0 comments
OpenZFS deduplication is good now and you shouldn't use it (despairlabs.com)
OpenZFS 2.3.0 will be released any day now, and it includes the new “Fast Dedup” feature. My team at Klara spent many months in 2023 and 2024 working on it, and we reckon it’s pretty good, a huge step up from the old dedup as well as being a solid base for further improvements.
Open Source, File Systems, Software, Deduplication
454 points by type0 114 days ago | 243 comments