Hacker News with Generative AI: Testing

Show HN: Magnitude – open-source, AI-native test framework for web apps (github.com/magnitudedev)
Magnitude: The open source, AI-native testing framework for web apps

Open Source, AI, Testing, Web Development

152 points by anerli 16 hours ago | 37 comments

AI helped write California bar exam, sparking uproar (arstechnica.com)
On Monday, the State Bar of California revealed that it used AI to develop a portion of multiple-choice questions on its February 2025 bar exam, causing outrage among law school faculty and test takers.

Artificial Intelligence, Law, Education, Testing

22 points by isaacfrond 2 days ago | 2 comments

Unpowered SSD endurance investigation finds data loss and performance issues (tomshardware.com)

SSD, Performance, Hardware, Storage, Testing

123 points by progval 7 days ago | 87 comments

Antithesis Driven Testing (sqlsync.dev)
I want a test system smart enough to discover the bugs I can’t anticipate.

Testing, Software Development, Software Engineering

6 points by wwilson 7 days ago | 0 comments

Streaming Platform for Canadian/American Content (Need Testers) (ycombinator.com)

Streaming, Content, Canada, United States, Testing

8 points by PolarBearIPTV 8 days ago | 3 comments

Test Spies in Haskell (jezenthomas.com)
When testing a web application, you often want to make sure that a certain email would be sent — without actually sending it. How do you test that?

Testing, Haskell, Web Development

11 points by yakshaving_jgt 8 days ago | 4 comments

Unpowered SSD endurance investigation finds data loss, performance issues (tomshardware.com)

SSD, Data Storage, Hardware, Performance, Testing

11 points by lentoutcry 9 days ago | 0 comments

Scenario: Using Agents to Test Your Agents (github.com/langwatch)
Scenario is a library for testing agents end-to-end as a human would, but without having to manually do it. The automated testing agent covers every single scenario for you.

Software, Testing, Artificial Intelligence, Agents

10 points by 0xdeafcafe 11 days ago | 2 comments

Ask HN: How to unit test AI responses? (ycombinator.com)
I am tasked to build a customer support chat. The AI should be trained with company docs. How can I be sure the AI will not hallucinate a bad response to a customer?

AI, Testing, Customer Support

10 points by bikamonki 11 days ago | 7 comments

Local CI. Sign off on your own work (github.com/basecamp)
A GitHub CLI extension for local CI. Run your tests on your own machine and sign off when they pass.

GitHub, Local CI, Software Development, Testing

48 points by lwhsiao 12 days ago | 45 comments

Cargo-mutants:zombie: Inject bugs and see if your tests catch them (github.com/sourcefrog)
cargo-mutants helps you improve your program's quality by finding places where bugs could be inserted without causing any tests to fail.

Software, Testing, Security, Rust, Programming

105 points by todsacerdoti 16 days ago | 17 comments

Try: Test anti-framework via CL Condition System (github.com/melisgl)
Try is an extensible test anti-framework with equal support for interactive and non-interactive workflows.

Testing, Software, Frameworks, Development, GitHub

5 points by todsacerdoti 19 days ago | 0 comments

Setup QEMU Output to Serial Console and Automate Tests with Shell Scripts (2019) (fadeevab.com)
While struggling to automate QEMU guest (communicate and control with the shell scripts), I faced a lot of incomplete, partially working solutions around the Internet. Now, I've got a pretty decent collection of working recipes to tune up a QEMU guest, so I decided to organize all that stuff here, and it could be definitely useful for anyone else.

QEMU, Shell Scripting, Automation, Virtualization, Testing

29 points by transpute 20 days ago | 4 comments

Pytest for Neovim (github.com/richardhapb)
Testing integrated in neovim with pytest. Include Docker support. This project is in progress, I will be adding more features in the future and I open to contributions.

Testing, Neovim, Python, Docker

73 points by richardhapb 21 days ago | 20 comments

Deterministic simulation testing for async Rust (s2.dev)

Rust, Programming, Testing, Asynchronous Programming

107 points by shikhar 22 days ago | 10 comments

You Don't Have Time Not to Test (medium.com)
Testing isn’t a sunk cost. It’s a compounding return that shapes better code and ultimately accelerates your team.

Software Development, Testing, Agile, Productivity

48 points by attila226 23 days ago | 73 comments

The right way to do data fixtures in Go (brandur.org)
Every test suite should start early in building a strong convention to generate data fixtures. If it doesn’t, data fixtures will still emerge (they’re that necessary), but in a way that’s poorly designed, with no API (or a poorly designed one), and not standardized.

Go, Testing, Software Development, Best Practices

3 points by DaGardner 29 days ago | 0 comments

Our own worst best customer (antithesis.com)
At Antithesis, our job is to break software before it breaks in production – ours included. We’ve spent years stress-testing our systems with property-based testing and deterministic simulation, not just because it makes our software more reliable, but because it actually makes us faster.

Software, Testing, Development

12 points by matesz 30 days ago | 0 comments

Show HN: Donobu – Mac app turns prompts into deterministic browser tests (ycombinator.com)
Hi HN, we’re Vasusen and Justin, and we’re building Donobu (https://www.donobu.com), a Mac desktop app. It turns prompts like “ensure onboarding works” into reliable browser tests, with optional AI (BYOK). It’s local-first, privacy-focused, and built with insights from our Coursera days—where testing hundreds of features across thousands of pages was a nightmare.

Software, Testing, Mac Apps, User Interfaces

13 points by vasusen 31 days ago | 0 comments

Just write a test for it (kobzol.github.io)
This is a short appreciation post about Rust continuously guiding me towards doing The Right Thing™.

Rust, Programming, Testing, Software Development

72 points by dmit 31 days ago | 61 comments

Testing Without Mocks: A Pattern Language (2023) (jamesshore.com)

Software Development, Testing, Programming, Patterns

90 points by jcartw 32 days ago | 62 comments

Dead Simple Snapshot Testing in Zig (kristoff.it)
I’ve recently added snapshot testing support to Zine, my static site generator, and I’ll share here how to get a similar setup going for your projects.

Testing, Programming, Zig

5 points by todsacerdoti 37 days ago | 0 comments

Verification-First Development (buttondown.com)
A while back I argued on the Blue Site1 that "test-first development" (TFD) was different than "test-driven development" (TDD). The former is "write tests before you write code", the latter is a paradigm, culture, and collection of norms that's based on TFD. More broadly, TFD is a special case of Verification-First Development and TDD is not.

Software Development, Testing, Methodology

65 points by vinipolicena 39 days ago | 24 comments

Testing Begins for Community Notes on Facebook, Instagram and Threads (about.fb.com)
In January, Meta announced that we will end our third party fact checking program and move to a crowd-sourced Community Notes approach, starting in the United States. On March 18th, we will begin testing this new approach by allowing contributors from our community to write and rate notes on content across Facebook, Instagram and Threads.

Social Media, Fact-Checking, Community, Testing, Meta

6 points by 01-_- 44 days ago | 0 comments

Show HN: Testeranto – the AI driven test framework for TypeScript projects (npmjs.com)
🚧 WARNING: Testeranto is still under development and is not ready for production yet. 🚧

TypeScript, Testing, AI, Software, Open Source

22 points by adamwong246 50 days ago | 0 comments

Problems with New California Bar Exam Enrage Test Takers and Cloud Their Futures (nytimes.com)
Even under normal circumstances, the California bar exam is one final harrowing hurdle before aspiring lawyers can practice. But last week was worse than any other, as they were thrown into limbo by technical glitches, delays and what many said were bizarrely written questions on a revamped test that didn’t match anything in preparation.

Law, Education, California, Technology, Testing

8 points by cardamomo 54 days ago | 0 comments

Demystifying monads in Rust through property-based testing (sunshowers.io)
In programming pedagogy, monads have a place as a mystical object from the functional programming world that’s hard to understand and even harder to explain.

Rust, Functional Programming, Testing, Programming Pedagogy

5 points by lukastyrychtr 56 days ago | 2 comments

Ask HN: Have you written or consumed OpenAPI Arazzo specification? (ycombinator.com)
Hi HN,<p>I recently came across the Arazzo specification within the OpenAPI initiative. It defines a standard to express workflows involving multiple APIs. A couple of main use cases here are automatic API invocation with LLMs and automated tests.<p>I want to auto generate API tests based on these specs and would like to see other examples. Is anyone here writing or consuming Arazzo specs?<p>Reference: https://www.openapis.org/arazzo

API Specifications, OpenAPI, Testing, Generative AI, Workflow Automation

15 points by sb13 61 days ago | 4 comments

Mere weeks after Starship's breakup, the vehicle may soon fly again (arstechnica.com)
A little over a month after SpaceX's large Starship launch ended in an explosion over several Caribbean islands, the company is preparing its next rocket for a test flight.

SpaceX, Starship, Space Exploration, Rocketry, Testing

24 points by amichail 65 days ago | 81 comments

Launch HN: Confident AI (YC W25) – Open-source evaluation framework for LLM apps (ycombinator.com)
Hi HN - we're Jeffrey and Kritin, and we're building Confident AI (https://confident-ai.com). This is the cloud platform for DeepEval (https://github.com/confident-ai/deepeval), our open-source package that helps engineers evaluate and unit-test LLM applications. Think Pytest for LLMs.

Generative AI, Open Source, Evaluation Frameworks, Testing

117 points by jeffreyip 65 days ago | 27 comments