Hacker News with Generative AI: Reproducibility

Paper2Code: Automating Code Generation from Scientific Papers (arxiv.org)
Despite the rapid growth of machine learning research, corresponding code implementations are often unavailable, making it slow and labor-intensive for researchers to reproduce results and build upon prior work.

Machine Learning, Scientific Research, Code Generation, Reproducibility

91 points by Jerry2 11 hours ago | 11 comments

Reproducibility project fails to validate dozens of biomedical studies (nature.com)
In an unprecedented effort, a coalition of more than 50 research teams has surveyed a swathe of Brazilian biomedical studies to double-check their findings — with dismaying results.

Biomedical Research, Reproducibility, Science, Research

152 points by rntn 12 hours ago | 84 comments

Fedora change aims for 99% package reproducibility (lwn.net)
The effort to ensure that open-source software is reproducible has been gathering steam over the years, and gaining traction with major Linux distributions.

Linux, Open Source, Reproducibility, Software Development

436 points by voxadam 15 days ago | 216 comments

New Python lock file format will specify dependencies (infoworld.com)
Python’s builders have accepted a proposal to create a universal lock file format for Python projects that would specify dependencies, enabling installation reproducibility in a Python environment.

Python, Software Development, Dependency Management, Reproducibility

3 points by birdculture 22 days ago | 3 comments

Python Adopts Standard Lock File Format for Reproducible Installs (socket.dev)
Python has officially standardized a lock file format.

Python, Software, Reproducibility, Package Management

8 points by feross 24 days ago | 0 comments

Binary Distribution Rebuilds (josefsson.org)
I rebuilt (the top-50 popcon) Debian and Ubuntu packages, on amd and arm64, and compared the results a couple of months ago. Since then the Reproduce.Debian.net effort has been launched. Unlike my small experiment, that effort is a full-scale rebuild with more architectures. Their goal is to reproduce what is published in the Debian archive.

Linux Distributions, Debian, Ubuntu, Reproducibility

30 points by JNRowe 26 days ago | 5 comments

Show HN: Localscope–Limit scope of Python functions for reproducible execution (readthedocs.io)
Have you ever hunted bugs caused by accidentally using a global variable in a function in a Jupyter notebook? Have you ever scratched your head because your code broke after restarting the Python kernel? localscope can help by restricting the variables a function can access.

Python, Jupyter Notebooks, Reproducibility, Software Development, Debugging

67 points by tillahoffmann 39 days ago | 31 comments

Stagex – Container-native, full-source bootstrapped, and reproducible toolchain (stagex.tools)
Minimalism and security first repository of reproducible and multi-signed OCI images of common open source software toolchains full-source bootstrapped from Stage 0 all the way up.

Security, Open Source, Containerization, Software Development, Reproducibility

36 points by robinhoodexe 52 days ago | 14 comments

Is NixOS truly reproducible? (luj.fr)
Build reproducibility is often considered as a de facto feature provided by functional package managers like Nix. Although the functional package manager model has important assets in the quest for build reproducibility (like reproducibility of build environments for example1), it is clear among practitioners that Nix does not guarantee that all its builds achieve bitwise reproducibility. In fact, it is not complicated to write a Nix package that builds an artifact non-deterministically:

NixOS, Reproducibility, Build Systems, Functional Programming, Software Development

248 points by pabs3 76 days ago | 122 comments

Mini-R1: Reproduce DeepSeek R1 "Aha Moment" (philschmid.de)

Machine Learning, Deep Learning, Research, Reproducibility

191 points by jonbaer 85 days ago | 15 comments

TinyZero: Reproduction of DeepSeek R1 Zero in countdown and multiplication tasks (github.com/Jiayi-Pan)
TinyZero is a reproduction of DeepSeek R1 Zero in countdown and multiplication tasks. We built upon veRL.

AI, Machine Learning, Software, Reproducibility, Research

226 points by fzliu 91 days ago | 27 comments

Zig Reproduced Without Binaries (jakstys.lt)
I decided to bootstrap Zig without using binaries that are checked in the repository and answer if the resulting zig1.wasm in the latest Zig release (0.13.0) is the same the one bootstrapped without using those binaries.

Programming Languages, Software, Zig, Reproducibility

95 points by todsacerdoti 164 days ago | 6 comments

Statistical challenges and misreadings of literature create unreplicable science [pdf] (stat.columbia.edu)

Science, Statistics, Reproducibility, Research, Literature

67 points by luu 172 days ago | 52 comments

NixOS is not reproducible (linderud.dev)
Okay, sorry for the clickbait.

Operating Systems, Reproducibility, NixOS

112 points by udev4096 182 days ago | 162 comments

Package reproducibility in Python notebooks using uv isolated environments (marimo.io)
One of marimo’s goals is to make notebooks reproducible, down to the packages used in them. To that end, it’s now possible to create marimo notebooks that have their package requirements serialized into them as a top-level comment.

Python, Reproducibility, Jupyter Notebooks, Tools, Software

37 points by mscolnick 221 days ago | 14 comments

PEP 751 – A file format to list Python dependencies for install reproducibility (python.org)

Python, Dependency Management, Software, Reproducibility

12 points by rbanffy 267 days ago | 1 comments

Pixi – rust-based package manager for reproducible scientific workflows (prefix.dev)

Rust, Package Managers, Scientific Computing, Reproducibility

24 points by droelf 270 days ago | 5 comments

Reproducibility in Disguise (fzakaria.com)

Reproducibility, Science, Research, Data Analysis

54 points by setheron 297 days ago | 24 comments

Lessons from the trenches on reproducible evaluation of language models (arxiv.org)