Hacker News with Generative AI: File Systems

Home Loss File System (docs.google.com)
This tool was created by former California wildfire survivors committed to supporting you through the challenging process of disaster recovery.
Stupidfs: Hide files by storing them in the metadata of other files (github.com/GoldenStack)
More files per file: hide files by storing them in the metadata of other files
Fedora Stakeholders Have Been Debating Whether to Retire GlusterFS (phoronix.com)
A discussion that originally started last summer has been reignited: whether it's time to retire GlusterFS within Fedora Linux.
Show HN: Windows' ext4 filesystem accesibility by new Visual Studio 2022 (github.com/abdulbadii)
ext4fsd is ext2, ext3 and ext4 file system accessibility on Windows
A gotcha with importing ZFS pools and NFS exports on Linux (utoronto.ca)
Ever since its Solaris origins, ZFS has supported automatic NFS and CIFS sharing of ZFS filesystems through their 'sharenfs' and 'sharesmb' properties.
XDG Base Directory Specification (freedesktop.org)
Various specifications specify files and file formats. This specification defines where these files should be looked for by defining one or more base directories relative to which files should be located.
Mount S3 like local file system for macOS (mountos.app)
mountOS (mount Object Storage) allows seamless integration of S3-compatible cloud storage, making it accessible and usable as a file system
Proof of Concept showcasing WASM program access files outside node:wasi's dir (github.com/humodz)
This repository showcases how to open files outside the "filesystem sandbox" in node:wasi.
ExFAT patents set to expire in early 2027; filesystem to become public domain (patents.google.com)
An extensible file system format for portable storage media is provided.
My wish for VFS or filesystem level cgroup (v2) IO limits (utoronto.ca)
I wish Linux cgroups (v2 of course) had an option/interface that limited *filesystem* IO that you could do, read and/or write.
Ntfs2btrfs does in-place conversion of NTFS filesystem to the open-source Btrfs (github.com/maharmstone)
Ntfs2btrfs is a tool which does in-place conversion of Microsoft's NTFS filesystem to the open-source filesystem Btrfs, much as btrfs-convert does for ext2.
ReiserFS Has Been Deleted from the Linux Kernel (phoronix.com)
Linus Torvalds just merged the change to the Linux 6.13 kernel that goes ahead and deletes the ReiserFS file-system from the source tree.
OpenZFS Driver for Windows (github.com/openzfsonwindows)
OpenZFS is an advanced file system and volume manager which was originally developed for Solaris and is now maintained by the OpenZFS community.
Bcachefs Brings Self-Healing Work and Better Reflink Repair for Linux 6.13 (phoronix.com)
Bcachefs has now joined the party of various kernel components sending in preemptive pull requests ahead of the Linux 6.13 merge window that is expected to open following the expected Linux 6.12 release on Sunday.
Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS (ycombinator.com)
Hey HN, I’m Hunter the founder of Regatta Storage (https://regattastorage.com). Regatta Storage is a new cloud file system that provides unlimited pay-as-you-go capacity, local-like performance, and automatic synchronization to S3-compatible storage. For example, you can use Regatta to instantly access massive data sets in S3 with Spark, Pytorch, or pandas without paying for large, local disks or waiting for the data to download.
Representing filesystems in databases efficiently with Hierarchical Ordering (danthegoodman.substack.com)
The way the we interface with files in a file system and rows in a database are fundamentally not the same.
Uncached Buffered IO Is Performing Great, Working Now on Btrfs / EXT4 / XFS (phoronix.com)
As covered last week Linux I/O expert Jens Axboe has been taking a fresh pursuit of uncached buffered I/O for Linux.
Origin private file system (mozilla.org)
The origin private file system (OPFS) is a storage endpoint provided as part of the File System API, which is private to the origin of the page and not visible to the user like the regular file system.
Debcow Optimizing Debian Packages for Copy-on-Write File-Systems (phoronix.com)
Debcow is an experimental implementation of deploying Debian packages on copy-on-write file-systems like Btrfs and Bcachefs.
A mental model for Linux file, hard and soft links (bhoot.dev)
I always felt bothered about my superficial understanding of inode, hard and soft links in Linux. Here I attempt to structure my learnings into a simplified mental model. Corrections are welcome.
A mental model for Linux file, hard and soft links (bhoot.dev)
I always felt bothered about my superficial understanding of inode, hard and soft links in Linux. Here I attempt to structure my learnings into a simplified mental model. Corrections are welcome.
Userland Disk I/O: Filesystems, file IO, and durability (transactional.blog)
In database land, most databases open(2) their WAL and data files with O_DIRECT so that write(2)/writev(2)/pwritev(2) perform unbuffered IO, maintain their own page cache, and utilize fdatasync() for durability.
OpenZFS deduplication is good now and you shouldn't use it (despairlabs.com)
OpenZFS 2.3.0 will be released any day now, and it includes the new “Fast Dedup” feature. My team at Klara spent many months in 2023 and 2024 working on it, and we reckon it’s pretty good, a huge step up from the old dedup as well as being a solid base for further improvements.
Using /tmp/ and /var/tmp/ Safely (systemd.io)
/tmp/ and /var/tmp/ are two world-writable directories Linux systems provide for temporary files.
Are you sure you want to use MMAP in your database management system? (2022) (cs.cmu.edu)
Memory-mapped (MMAP) file I/O is an OS-provided feature that maps the contents of a file on secondary storage into a program’s address space.
Using /tmp/ and /var/tmp/ Safely (systemd.io)
/tmp/ and /var/tmp/ are two world-writable directories Linux systems provide for temporary files.
ReiserFS File-System Expected to Be Removed with Linux 6.13 (phoronix.com)
With ReiserFS having been deprecated for two years with plans to remove it in 2025, the upcoming Linux 6.13 cycle for what will be the first major kernel release of the new year and past the Linux 6.12 LTS kernel is expected to do just that... ReiserFS is set to be stripped from the mainline kernel codebase.
Filesystem Hierarchy Standard (linuxfoundation.org)
This standard consists of a set of requirements and guidelines for file and directory placement under UNIX-like operating systems.
Linus Torvalds is fed up with bcachefs (kernel.org)
Several more filesystems repaired, thank you to the users who have been providing testing. The snapshots + unlinked fixes on top of this are posted here:
Bcachefs Fixes Pull Once Again Frustrates Linus Torvalds – Two Choices Offered (phoronix.com)
Linus Torvalds merged the newest round of fixes to the experimental Bcachefs file-system, but it's left Linux creator Linus Torvalds frustrated and he's presented two choices for the file-system moving forward due to the continued LKML drama.