Hacker News with Generative AI: Caching

Show HN: I built a Ruby gem that handles memoization with a ttl (github.com/mishalzaman)
MemoTTL is a thread-safe memoization utility for Ruby that supports TTL (Time-To-Live) and LRU (Least Recently Used) eviction.

Ruby, Programming, Software, Memoization, Caching

47 points by hp_hovercraft84 4 days ago | 26 comments

Is Python Code Sensitive to CPU Caching? (2024) (lukasatkinson.de)
Cache-aware programming can make a huge performance difference, especially when writing code in C++ or Rust. Python is a much more high-level language, and doesn't give us that level of control over memory layout of our data structures. So does this mean that CPU caching effects aren't relevant in Python?

Programming, Optimization, Python, Caching

81 points by leonry 24 days ago | 36 comments

Caching Strategies for Ultra-High Performance in Ruby on Rails, Part 1 (scoutapm.com)
When it comes to optimizing web applications, a proper caching strategy is critical because it can significantly reduce load times and improve the overall user experience.

Caching, Performance Optimization, Web Development

5 points by thunderbong 45 days ago | 1 comments

Cache Is King: Smart Page Eviction with eBPF (arxiv.org)
The page cache is a central part of an OS. It reduces repeated accesses to storage by deciding which pages to retain in memory. As a result, the page cache has a significant impact on the performance of many applications. However, its one-size-fits-all eviction policy performs poorly in many workloads.

Operating Systems, Performance Optimization, Computer Science, Caching

8 points by PaulHoule 64 days ago | 0 comments

Analyzing the codebase of Caffeine, a high performance caching library (adriacabeza.github.io)
The other day, while wasting time reading reddit, I stumbled upon a blogpost mentioning S3 FIFO, a method claiming to outperform LRU (Least Recently Used) in terms of cache miss ratio.

Caching, Software, Performance, Libraries

268 points by synthc 83 days ago | 47 comments

Show HN: Foyer, Hybrid in-memory and disk cache in Rust (github.com/foyer-rs)
foyer aims to be an efficient and user-friendly hybrid cache lib in Rust.

Rust, Caching, Software, New Releases, Programming

18 points by tison 113 days ago | 0 comments

Sometimes I cache: implementing lock-free probabilistic caching (cloudflare.com)
HTTP caching is conceptually simple: if the response to a request is in the cache, serve it, and if not, pull it from your origin, put it in the cache, and return it.

Caching, Web Development, Performance, Algorithms, Distributed Systems

5 points by jgrahamc 121 days ago | 0 comments

Thruster – HTTP/2 proxy for Rails apps with built-in Let's Encrypt and caching (github.com/basecamp)
Thruster is an HTTP/2 proxy for simple production-ready deployments of Rails applications.

Rails, HTTP/2, Web Development, Deployment, Caching

17 points by jbverschoor 121 days ago | 3 comments

Turning Off Zen 4's Op Cache for Curiosity and Giggles (chipsandcheese.com)
CPUs start executing instructions by fetching those instruction bytes from memory and decoding them into internal operations (micro-ops). Getting data from memory and operating on it consumes power and incurs latency. Micro-op caching is a popular technique to improve on both fronts, and involves caching micro-ops that correspond to frequently executed instructions.

CPUs, Performance Optimization, Hardware, Caching

68 points by mfiguiere 136 days ago | 10 comments

Making AWS News stupid fast with smart caching (lucvandonkersgoed.com)
As I’m typing this, Re:Invent 2024 is only weeks away. In anticipation of https://aws-news.com‘s busiest period of the year, I redesigned the API access patterns to support very effective caching. This resulted in significantly reduced backend load and a much faster frontend.

AWS, Caching, Web Development, Performance Optimization

50 points by tatersolid 148 days ago | 17 comments

FreeLRU: GC-less, fast and generic LRU hashmap library for Go (github.com/elastic)
FreeLRU allows you to cache objects without introducing GC overhead.

Go, Caching, Performance, Data Structures, Libraries

18 points by ingve 151 days ago | 1 comments

Cache Directory Tagging Specification (2004) (bford.info)
Many applications create and manage directories containing cached information about content stored elsewhere, such as cached Web content or thumbnail-size versions of images or movies.

Caching, Web Development, Specifications

21 points by networked 168 days ago | 8 comments

Nix at work: FlakeHub Cache and private flakes (determinate.systems)
Today, we’re delighted to announce a new chapter for FlakeHub with the general availability of two new features: FlakeHub Cache and private flakes.

Nix, Software, Cloud Computing, Caching

34 points by grhmc 185 days ago | 29 comments

Show HN: Pocache, preemptive optimistic caching for Go (github.com/naughtygopher)
Pocache (poh-cash (/poʊ kæʃ/)), Preemptive optimistic cache, is a lightweight in-app caching package. It introduces preemptive cache updates, optimizing performance in concurrent environments by reducing redundant database calls while maintaining fresh data. It uses Hashicorp's Go LRU package as the default storage.

Go, Caching, Optimization, Software, Open Source

97 points by bnkamalesh 197 days ago | 32 comments

The Simple Magic of Consistent Hashing (2011) (paperplanes.de)
The simplicity of consistent hashing is pretty mind-blowing. Here you have a number of nodes in a cluster of databases, or in a cluster of web caches. How do you figure out where the data for a particular key goes in that cluster?

Data Structures, Distributed Systems, Caching

31 points by tosh 216 days ago | 3 comments

Cache Me Not, Cache Me, Cache Me Not (hazelweakly.me)
Caching is hard. So hard. But also, we are so fucking bad at it. Every time I have to use a public wifi setup I have a joker moment. Does absolutely nobody test shit on anything less than wired symmetric gigabit anymore?

Networking, Caching, Software, Technology

57 points by mooreds 218 days ago | 21 comments

Telum II at Hot Chips 2024: Mainframe with a Unique Caching Strategy (chipsandcheese.com)
Mainframes still play a vital role in today, providing extremely high uptime and low latency for financial transactions.

Mainframes, Caching, Computer Architecture, Hot Chips

78 points by mfiguiere 230 days ago | 49 comments

Setting up a cache server for apt packages (qmacro.org)

Caching, Linux, Software, Networking, Package Management

30 points by todsacerdoti 235 days ago | 5 comments

Speeding Up Your Website Using Cloudflare Cache (pillser.com)

Website Optimization, Cloudflare, Caching

83 points by lilouartz 244 days ago | 25 comments

Row Embedded Cache: Experimenting with a new pattern of caching (zarar.dev)

Caching, Software Development, Performance

31 points by recroad 261 days ago | 7 comments

Sieve: Cache eviction can be simple, effective, and scalable (usenix.org)