Reservoir Sampling(samwho.dev) Reservoir sampling is a technique for selecting a fair random sample when you don't know the size of the set you're sampling from.
532 points by chrisdemarco 15 days ago | 105 comments
Can LLMs do randomness?(rnikhil.com) While LLMs theoretically understand “randomness,” their training data distributions may create unexpected patterns. In this article we will test different LLMs from OpenAI and Anthropic to see if they provide unbiased results. For the first experiment we will make it toss a fair coin and for the next, we will make it guess a number between 0-10 and see if its equally distributed between even and odd. I know the sample sizes are small and probably not very statistically significant.
A puzzle of two unreliable sensors(wordpress.com) Suppose you are trying to measure a value P and you have two unreliable sensors. Sensor A returns 0.5P + 0.5U, where U is uniform random noise over the same domain as P. Sensor B will return either P or U with 50% likelihood. In other words, sensor A is a noisy measurement of your variable, and B is sometimes the correct value and sometimes pure noise.
Randomness extractors: making fair coins out of biased coins(bytepawn.com) In a previous post titled Fair coin from biased coin, I looked at the problem of creating a uniform random coin given access to a biased coin. I looked at multiple approaches, and determined that they're actually all the same in some sense.