Hacker News with Generative AI: Caching

Analyzing the codebase of Caffeine, a high performance caching library (adriacabeza.github.io)
The other day, while wasting time reading reddit, I stumbled upon a blogpost mentioning S3 FIFO, a method claiming to outperform LRU (Least Recently Used) in terms of cache miss ratio.

Caching, Software, Performance, Libraries

268 points by synthc 18 days ago | 47 comments

Show HN: Foyer, Hybrid in-memory and disk cache in Rust (github.com/foyer-rs)
foyer aims to be an efficient and user-friendly hybrid cache lib in Rust.

Rust, Caching, Software, New Releases, Programming

18 points by tison 49 days ago | 0 comments

Sometimes I cache: implementing lock-free probabilistic caching (cloudflare.com)
HTTP caching is conceptually simple: if the response to a request is in the cache, serve it, and if not, pull it from your origin, put it in the cache, and return it.

Caching, Web Development, Performance, Algorithms, Distributed Systems

5 points by jgrahamc 56 days ago | 0 comments

Thruster – HTTP/2 proxy for Rails apps with built-in Let's Encrypt and caching (github.com/basecamp)
Thruster is an HTTP/2 proxy for simple production-ready deployments of Rails applications.

Rails, HTTP/2, Web Development, Deployment, Caching

17 points by jbverschoor 56 days ago | 3 comments

Turning Off Zen 4's Op Cache for Curiosity and Giggles (chipsandcheese.com)
CPUs start executing instructions by fetching those instruction bytes from memory and decoding them into internal operations (micro-ops). Getting data from memory and operating on it consumes power and incurs latency. Micro-op caching is a popular technique to improve on both fronts, and involves caching micro-ops that correspond to frequently executed instructions.

CPUs, Performance Optimization, Hardware, Caching

68 points by mfiguiere 72 days ago | 10 comments

Making AWS News stupid fast with smart caching (lucvandonkersgoed.com)
As I’m typing this, Re:Invent 2024 is only weeks away. In anticipation of https://aws-news.com‘s busiest period of the year, I redesigned the API access patterns to support very effective caching. This resulted in significantly reduced backend load and a much faster frontend.

AWS, Caching, Web Development, Performance Optimization

50 points by tatersolid 83 days ago | 17 comments

FreeLRU: GC-less, fast and generic LRU hashmap library for Go (github.com/elastic)
FreeLRU allows you to cache objects without introducing GC overhead.

Go, Caching, Performance, Data Structures, Libraries

18 points by ingve 86 days ago | 1 comments

Cache Directory Tagging Specification (2004) (bford.info)
Many applications create and manage directories containing cached information about content stored elsewhere, such as cached Web content or thumbnail-size versions of images or movies.

Caching, Web Development, Specifications

21 points by networked 103 days ago | 8 comments

Nix at work: FlakeHub Cache and private flakes (determinate.systems)
Today, we’re delighted to announce a new chapter for FlakeHub with the general availability of two new features: FlakeHub Cache and private flakes.

Nix, Software, Cloud Computing, Caching

34 points by grhmc 120 days ago | 29 comments

Show HN: Pocache, preemptive optimistic caching for Go (github.com/naughtygopher)
Pocache (poh-cash (/poʊ kæʃ/)), Preemptive optimistic cache, is a lightweight in-app caching package. It introduces preemptive cache updates, optimizing performance in concurrent environments by reducing redundant database calls while maintaining fresh data. It uses Hashicorp's Go LRU package as the default storage.

Go, Caching, Optimization, Software, Open Source

97 points by bnkamalesh 132 days ago | 32 comments

The Simple Magic of Consistent Hashing (2011) (paperplanes.de)
The simplicity of consistent hashing is pretty mind-blowing. Here you have a number of nodes in a cluster of databases, or in a cluster of web caches. How do you figure out where the data for a particular key goes in that cluster?

Data Structures, Distributed Systems, Caching

31 points by tosh 151 days ago | 3 comments

Cache Me Not, Cache Me, Cache Me Not (hazelweakly.me)
Caching is hard. So hard. But also, we are so fucking bad at it. Every time I have to use a public wifi setup I have a joker moment. Does absolutely nobody test shit on anything less than wired symmetric gigabit anymore?

Networking, Caching, Software, Technology

57 points by mooreds 154 days ago | 21 comments

Telum II at Hot Chips 2024: Mainframe with a Unique Caching Strategy (chipsandcheese.com)
Mainframes still play a vital role in today, providing extremely high uptime and low latency for financial transactions.

Mainframes, Caching, Computer Architecture, Hot Chips

78 points by mfiguiere 165 days ago | 49 comments

Setting up a cache server for apt packages (qmacro.org)

Caching, Linux, Software, Networking, Package Management

30 points by todsacerdoti 170 days ago | 5 comments

Speeding Up Your Website Using Cloudflare Cache (pillser.com)

Website Optimization, Cloudflare, Caching

83 points by lilouartz 179 days ago | 25 comments

Row Embedded Cache: Experimenting with a new pattern of caching (zarar.dev)

Caching, Software Development, Performance

31 points by recroad 196 days ago | 7 comments

Sieve: Cache eviction can be simple, effective, and scalable (usenix.org)