Hacker News with Generative AI: Caching

Caching Strategies for Ultra-High Performance in Ruby on Rails, Part 1 (scoutapm.com)
When it comes to optimizing web applications, a proper caching strategy is critical because it can significantly reduce load times and improve the overall user experience.

Caching, Performance Optimization, Web Development

5 points by thunderbong 22 days ago | 1 comments

Cache Is King: Smart Page Eviction with eBPF (arxiv.org)
The page cache is a central part of an OS. It reduces repeated accesses to storage by deciding which pages to retain in memory. As a result, the page cache has a significant impact on the performance of many applications. However, its one-size-fits-all eviction policy performs poorly in many workloads.

Operating Systems, Performance Optimization, Computer Science, Caching

8 points by PaulHoule 40 days ago | 0 comments

Analyzing the codebase of Caffeine, a high performance caching library (adriacabeza.github.io)
The other day, while wasting time reading reddit, I stumbled upon a blogpost mentioning S3 FIFO, a method claiming to outperform LRU (Least Recently Used) in terms of cache miss ratio.

Caching, Software, Performance, Libraries

268 points by synthc 60 days ago | 47 comments

Show HN: Foyer, Hybrid in-memory and disk cache in Rust (github.com/foyer-rs)
foyer aims to be an efficient and user-friendly hybrid cache lib in Rust.

Rust, Caching, Software, New Releases, Programming

18 points by tison 90 days ago | 0 comments

Sometimes I cache: implementing lock-free probabilistic caching (cloudflare.com)
HTTP caching is conceptually simple: if the response to a request is in the cache, serve it, and if not, pull it from your origin, put it in the cache, and return it.

Caching, Web Development, Performance, Algorithms, Distributed Systems

5 points by jgrahamc 97 days ago | 0 comments

Thruster – HTTP/2 proxy for Rails apps with built-in Let's Encrypt and caching (github.com/basecamp)
Thruster is an HTTP/2 proxy for simple production-ready deployments of Rails applications.

Rails, HTTP/2, Web Development, Deployment, Caching

17 points by jbverschoor 98 days ago | 3 comments

Turning Off Zen 4's Op Cache for Curiosity and Giggles (chipsandcheese.com)
CPUs start executing instructions by fetching those instruction bytes from memory and decoding them into internal operations (micro-ops). Getting data from memory and operating on it consumes power and incurs latency. Micro-op caching is a popular technique to improve on both fronts, and involves caching micro-ops that correspond to frequently executed instructions.

CPUs, Performance Optimization, Hardware, Caching

68 points by mfiguiere 113 days ago | 10 comments

Making AWS News stupid fast with smart caching (lucvandonkersgoed.com)
As I’m typing this, Re:Invent 2024 is only weeks away. In anticipation of https://aws-news.com‘s busiest period of the year, I redesigned the API access patterns to support very effective caching. This resulted in significantly reduced backend load and a much faster frontend.

AWS, Caching, Web Development, Performance Optimization

50 points by tatersolid 124 days ago | 17 comments

FreeLRU: GC-less, fast and generic LRU hashmap library for Go (github.com/elastic)
FreeLRU allows you to cache objects without introducing GC overhead.

Go, Caching, Performance, Data Structures, Libraries

18 points by ingve 128 days ago | 1 comments

Cache Directory Tagging Specification (2004) (bford.info)
Many applications create and manage directories containing cached information about content stored elsewhere, such as cached Web content or thumbnail-size versions of images or movies.

Caching, Web Development, Specifications

21 points by networked 145 days ago | 8 comments

Nix at work: FlakeHub Cache and private flakes (determinate.systems)
Today, we’re delighted to announce a new chapter for FlakeHub with the general availability of two new features: FlakeHub Cache and private flakes.

Nix, Software, Cloud Computing, Caching

34 points by grhmc 161 days ago | 29 comments

Show HN: Pocache, preemptive optimistic caching for Go (github.com/naughtygopher)
Pocache (poh-cash (/poʊ kæʃ/)), Preemptive optimistic cache, is a lightweight in-app caching package. It introduces preemptive cache updates, optimizing performance in concurrent environments by reducing redundant database calls while maintaining fresh data. It uses Hashicorp's Go LRU package as the default storage.

Go, Caching, Optimization, Software, Open Source

97 points by bnkamalesh 174 days ago | 32 comments

The Simple Magic of Consistent Hashing (2011) (paperplanes.de)
The simplicity of consistent hashing is pretty mind-blowing. Here you have a number of nodes in a cluster of databases, or in a cluster of web caches. How do you figure out where the data for a particular key goes in that cluster?

Data Structures, Distributed Systems, Caching

31 points by tosh 193 days ago | 3 comments

Cache Me Not, Cache Me, Cache Me Not (hazelweakly.me)
Caching is hard. So hard. But also, we are so fucking bad at it. Every time I have to use a public wifi setup I have a joker moment. Does absolutely nobody test shit on anything less than wired symmetric gigabit anymore?

Networking, Caching, Software, Technology

57 points by mooreds 195 days ago | 21 comments

Telum II at Hot Chips 2024: Mainframe with a Unique Caching Strategy (chipsandcheese.com)
Mainframes still play a vital role in today, providing extremely high uptime and low latency for financial transactions.

Mainframes, Caching, Computer Architecture, Hot Chips

78 points by mfiguiere 206 days ago | 49 comments

Setting up a cache server for apt packages (qmacro.org)

Caching, Linux, Software, Networking, Package Management

30 points by todsacerdoti 212 days ago | 5 comments

Speeding Up Your Website Using Cloudflare Cache (pillser.com)

Website Optimization, Cloudflare, Caching

83 points by lilouartz 220 days ago | 25 comments

Row Embedded Cache: Experimenting with a new pattern of caching (zarar.dev)

Caching, Software Development, Performance

31 points by recroad 238 days ago | 7 comments

Sieve: Cache eviction can be simple, effective, and scalable (usenix.org)