Hacker News with Generative AI: File Systems

Bcachefs Brings Self-Healing Work and Better Reflink Repair for Linux 6.13 (phoronix.com)
Bcachefs has now joined the party of various kernel components sending in preemptive pull requests ahead of the Linux 6.13 merge window that is expected to open following the expected Linux 6.12 release on Sunday.
Linux, Operating Systems, Software, File Systems
12 points by voxadam 2 days ago | 0 comments
Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS (ycombinator.com)
Hey HN, I’m Hunter the founder of Regatta Storage (https://regattastorage.com). Regatta Storage is a new cloud file system that provides unlimited pay-as-you-go capacity, local-like performance, and automatic synchronization to S3-compatible storage. For example, you can use Regatta to instantly access massive data sets in S3 with Spark, Pytorch, or pandas without paying for large, local disks or waiting for the data to download.
Cloud Storage, S3, YC, Software, File Systems
572 points by huntaub 3 days ago | 310 comments
Representing filesystems in databases efficiently with Hierarchical Ordering (danthegoodman.substack.com)
The way the we interface with files in a file system and rows in a database are fundamentally not the same.
Databases, Data Structures, File Systems, Optimization
9 points by dangoodmanUT 5 days ago | 0 comments
Uncached Buffered IO Is Performing Great, Working Now on Btrfs / EXT4 / XFS (phoronix.com)
As covered last week Linux I/O expert Jens Axboe has been taking a fresh pursuit of uncached buffered I/O for Linux.
Linux, File Systems, Performance, Operating Systems
28 points by LinuxBender 7 days ago | 0 comments
Origin private file system (mozilla.org)
The origin private file system (OPFS) is a storage endpoint provided as part of the File System API, which is private to the origin of the page and not visible to the user like the regular file system.
Web Development, Security, File Systems, Privacy
78 points by thunderbong 7 days ago | 48 comments
Debcow Optimizing Debian Packages for Copy-on-Write File-Systems (phoronix.com)
Debcow is an experimental implementation of deploying Debian packages on copy-on-write file-systems like Btrfs and Bcachefs.
Debian, Linux, Operating Systems, File Systems
7 points by dmmalam 10 days ago | 0 comments
A mental model for Linux file, hard and soft links (bhoot.dev)
I always felt bothered about my superficial understanding of inode, hard and soft links in Linux. Here I attempt to structure my learnings into a simplified mental model. Corrections are welcome.
Linux, Operating Systems, File Systems, Hard Links, Soft Links
52 points by signa11 11 days ago | 24 comments
A mental model for Linux file, hard and soft links (bhoot.dev)
I always felt bothered about my superficial understanding of inode, hard and soft links in Linux. Here I attempt to structure my learnings into a simplified mental model. Corrections are welcome.
Linux, Operating Systems, File Systems, Hard Links, Soft Links
15 points by todsacerdoti 12 days ago | 0 comments
Userland Disk I/O: Filesystems, file IO, and durability (transactional.blog)
In database land, most databases open(2) their WAL and data files with O_DIRECT so that write(2)/writev(2)/pwritev(2) perform unbuffered IO, maintain their own page cache, and utilize fdatasync() for durability.
Operating Systems, File Systems, Databases
30 points by thunderbong 13 days ago | 2 comments
OpenZFS deduplication is good now and you shouldn't use it (despairlabs.com)
OpenZFS 2.3.0 will be released any day now, and it includes the new “Fast Dedup” feature. My team at Klara spent many months in 2023 and 2024 working on it, and we reckon it’s pretty good, a huge step up from the old dedup as well as being a solid base for further improvements.
Open Source, File Systems, Software, Deduplication
454 points by type0 21 days ago | 243 comments
Using /tmp/ and /var/tmp/ Safely (systemd.io)
/tmp/ and /var/tmp/ are two world-writable directories Linux systems provide for temporary files.
Linux, Security, File Systems
12 points by thunderbong 25 days ago | 0 comments
Are you sure you want to use MMAP in your database management system? (2022) (cs.cmu.edu)
Memory-mapped (MMAP) file I/O is an OS-provided feature that maps the contents of a file on secondary storage into a program’s address space.
Operating Systems, Memory Management, Performance Optimization, File Systems
15 points by tosh 26 days ago | 2 comments
Using /tmp/ and /var/tmp/ Safely (systemd.io)
/tmp/ and /var/tmp/ are two world-writable directories Linux systems provide for temporary files.
Linux, Security, File Systems, System Administration
5 points by todsacerdoti 28 days ago | 0 comments
ReiserFS File-System Expected to Be Removed with Linux 6.13 (phoronix.com)
With ReiserFS having been deprecated for two years with plans to remove it in 2025, the upcoming Linux 6.13 cycle for what will be the first major kernel release of the new year and past the Linux 6.12 LTS kernel is expected to do just that... ReiserFS is set to be stripped from the mainline kernel codebase.
Linux, Operating Systems, Kernel, File Systems
6 points by mfiguiere 32 days ago | 1 comments
Filesystem Hierarchy Standard (linuxfoundation.org)
This standard consists of a set of requirements and guidelines for file and directory placement under UNIX-like operating systems.
Operating Systems, File Systems, Standards, Linux
5 points by leetrout 41 days ago | 0 comments
Linus Torvalds is fed up with bcachefs (kernel.org)
Several more filesystems repaired, thank you to the users who have been providing testing. The snapshots + unlinked fixes on top of this are posted here:
Linux, Kernel Development, File Systems
37 points by ramon156 45 days ago | 10 comments
Bcachefs Fixes Pull Once Again Frustrates Linus Torvalds – Two Choices Offered (phoronix.com)
Linus Torvalds merged the newest round of fixes to the experimental Bcachefs file-system, but it's left Linux creator Linus Torvalds frustrated and he's presented two choices for the file-system moving forward due to the continued LKML drama.
Linux, Operating Systems, File Systems
9 points by marcodiego 46 days ago | 3 comments
Bcachefs Fixes Pull Once Again Frustrates Linus Torvalds (phoronix.com)
Linus Torvalds merged the newest round of fixes to the experimental Bcachefs file-system, but it's left Linux creator Linus Torvalds frustrated and he's presented two choices for the file-system moving forward due to the continued LKML drama.
Linux Kernel, Operating Systems, File Systems, Linus Torvalds
28 points by mfiguiere 46 days ago | 10 comments
Gefs: A good enough filesystem for Plan 9 (orib.dev)
Recently, I have been working on a new file system called gefs. It isn't yet trustworthy, but it's ready for testing. The code is available here: https://shithub.us/ori/gefs/HEAD/f.html
Operating Systems, File Systems, Plan 9
6 points by fanf2 50 days ago | 0 comments
The best browser bookmarking system is files (afewthingz.com)
Along the years I have tested various browser bookmarking systems.
Web Browsing, Productivity, Bookmarks, File Systems, Personal Projects
267 points by josephernest 52 days ago | 163 comments
Linux 6.12 NFS Adds Localio Protocol for "Extreme" Performance Boost (phoronix.com)
The Network File System (NFS) changes have been merged for the ongoing Linux 6.12 development cycle. Notable this time with NFS is adding LOCALIO protocol extension support that can lead to fairly "extreme" performance improvements in scenarios where the NFS client and server are on the same host.
Linux, Networking, File Systems, Performance
17 points by westurner 56 days ago | 3 comments
Is there now a generation of users who never worked with files? (hyperknot.com)
Is there now a generation of users who never worked with files?
Generational Differences, User Interface, Computing History, File Systems
12 points by novoreorx 56 days ago | 6 comments
fd - A simple, fast and user-friendly alternative to 'find' (github.com/sharkdp)
fd is a program to find entries in your filesystem. It is a simple, fast and user-friendly alternative to find.
Command-line Tools, File Systems, Software, Open Source
8 points by voxadam 58 days ago | 8 comments
Bcachefs Hopes to Remove "Experimental" Flag in the Next Year (phoronix.com)
Bcachefs lead developer Kent Overstreet has submitted all of the Bcachefs file-system feature patches for the Linux 6.12 kernel merge window.
Linux Kernel, File Systems, Open Source
5 points by turrini 60 days ago | 0 comments
Sshfs for Windows (github.com/winfsp)
SSHFS-Win is a minimal port of SSHFS to Windows. Under the hood it uses Cygwin for the POSIX environment and WinFsp for the FUSE functionality.
Windows, SSH, File Systems
81 points by keepamovin 61 days ago | 31 comments
Bcachefs (bcachefs.org)
"The COW filesystem for Linux that won't eat your data".
Linux, File Systems, Performance
4 points by tosh 68 days ago | 0 comments
How to sync Mac and Linux /home (sive.rs)
Synchronization, macOS, Linux, File Systems
5 points by Kortaggio 80 days ago | 4 comments
Shufflecake: Plausible deniability for hidden filesystems on Linux (2023) (iacr.org)
Security, Linux, Operating Systems, File Systems
66 points by simonpure 88 days ago | 23 comments
Linus Torvalds Begins Expressing Regrets Merging Bcachefs (phoronix.com)
Linux, Operating Systems, File Systems
23 points by mfiguiere 89 days ago | 1 comments
Microsoft is finally removing the FAT32 partition size limit in Windows 11 (theverge.com)
Windows 11, Operating Systems, Microsoft, File Systems, Storage
59 points by tosh 97 days ago | 66 comments