Understanding Automatic Differentiation in Jax: A Deep Dive (ispeakcode.substack.com)
Welcome to the world of JAX, where differentiation happens automatically, faster than a caffeine-fuelled coder at 3 a.m.! In this post, we’re going to delve into the concept of Automatic Differentiation (AD), a feature at the heart of JAX, and we’ll explore why it’s such a game changer for machine learning, scientific computing, and any other context where derivatives matter. The popularity of JAX has been increasing lately, thanks to the emerging field of scientific machine learning powered by differentiable programming.