Implementing LLaMA3 in 100 Lines of Pure Jax(saurabhalone.com) In this post, we'll implement llama3 from scratch using pure jax in just 100 lines of code. Why jax? Because I think it has good aesthetics. Also jax looks like a NumPy wrapper but it has some cool features like xla; a linear algebra accelerator, jit, vmap, pmap etc., which makes your training go brr brr.
RPython Compilation Quick Reference(tilde.town) Well first things first, this is way more ram hungry than you'd expect, and you're restricted to python 2. BUT, you do end up with nice fast binaries at the end. So let's proceed!
A tail calling interpreter for Python (already landed in CPython)(reverberate.org) It’s been nearly four years since I published Parsing Protobuf at 2+GB/s: How I Learned To Love Tail Calls in C. In that article, I presented a technique I co-developed for how to write really fast interpreters through the use of tail calls and the musttail attribute.
Sets and Bitsets, from Python to Zig(eno-writer.com) It's been over a year since I switched from programming in high level languages (python and javascript) to programming in a low level language (zig). Supposedly, high level languages are much easier to work with than low level languages, but I've been surprised by how infrequently I've felt myself longing for the expressiveness of python. In fact, last week was the first time I actually found myself having to switch to python to figure something out.
Building an "Easy" Web Application(rudyfaile.com) I decided to spend my Fourth of July weekend transforming a small Python utility I wrote a couple of years ago for work. The idea was simple: make the tool more accessible for co-workers who use it by turning it into a web application.
Ask HN: Learning PySpark and Related Tools(ycombinator.com) Hey HN,<p>I have been working in the data-science and machine-learning domain for the past 8 years or so. I have not been exposed to tools such as PySpark etc. which are being asked frequently in job descriptions.
What resource or certification can I use to get upto par on PySpark?<p>Thanks!
37 points by imaginaryspaces 16 days ago | 8 comments
Decorator JITs: Python as a DSL(thegreenplace.net) Spend enough time looking at Python programs and packages for machine learning, and you'll notice that the "JIT decorator" pattern is pretty popular.
GarminDB(github.com/tcgoetz) Python scripts for parsing health data into and manipulating data in a SQLite database. SQLite is a light weight database that doesn't require a server.