Hacker News with Generative AI: Software Testing

Reliably Benchmarking Small Changes – Ankush Menat (ankush.dev)
I often have to benchmark web services to see if some small change has a meaningful impact on performance. Typically, you spawn a few web service workers and use another program (ideally on another machine in the same network) to hammer that service. During this time, the test program will keep track of how many requests were processed and the latency for each of them. If throughput goes up and/or latency goes down, your change was effective.

Web Development, Performance Optimization, Benchmarking, Software Testing

32 points by rbanffy 11 days ago | 15 comments

Show HN: Hercules – Open-Source software testing agent (testzeus.com)
Effortless, Autonomous Test Automation—Zero Coding, Zero Maintenance, Infinite Possibilities.

Software Testing, Open Source, Automation, AI

10 points by Smilinrobin 15 days ago | 12 comments

Using LLMs to enhance our testing practices (assembled.com)
At Assembled, engineering velocity is our competitive edge. We pride ourselves on delivering new features at a fast pace. But how do we maintain quality without slowing down? The answer lies in robust testing.

Generative AI, Software Testing, Engineering

186 points by johnjwang 40 days ago | 77 comments

Launch HN: GPT Driver (YC S21) – End-to-end app testing in natural language (ycombinator.com)
Hey HN, we are Chris and Chris from MobileBoost (https://mobileboost.io/). We’re building GPT Driver, an AI-native approach to create and execute end-to-end (E2E) tests on mobile applications.

Software Testing, Artificial Intelligence, Mobile Development, Startups

129 points by cschiller 41 days ago | 82 comments

SMURF: Beyond the Test Pyramid (googleblog.com)
SMURF: Beyond the Test Pyramid

Software Testing, Software Development, Google, Testing Frameworks

72 points by BerislavLopac 45 days ago | 53 comments

Webinar – How Generative AI Can Help Scale Your QA Processes (testrigor.com)
Join us for an insightful webinar hosted by testRigor, where we’ll delve into the transformative potential of scaling QA processes using Generative AI.

Generative AI, QA, Software Testing, Webinars

10 points by Dmoerner1991 46 days ago | 0 comments

Accumulated Test Vectors (filippo.io)
I like tests. I especially like reusable test vector libraries. Sometimes test vectors are lovingly handcrafted to target obscure edge-cases. Those vectors belong in Wycheproof or with the upstream specification. Sometimes though vectors are produced by sheer brute force. Enumerate every possible input and check the output. Try a million random inputs and see what happens. Combine all possible input sizes for every parameter. Make one very, very large input.

Software Testing, Security, Code Quality

5 points by fanf2 55 days ago | 0 comments

I Am Tired of AI (ontestautomation.com)
Unless you have been living under a rock for the last few years, you probably have seen the same massive surge I’ve seen in the application of artificial intelligence (AI) to pretty much every problem out there, in software testing, in software development, and in life in general.

Artificial Intelligence, Software Development, Software Testing

1209 points by Liriel 67 days ago | 1120 comments

Show HN: Scandium: No-Code Test Automation Tool for Software Testing (getscandium.com)
Create and maintain automated test cases without a line of code.

Software Testing, Test Automation, No-Code Tools

7 points by IbraheemAdebisi 70 days ago | 2 comments

Earn $200K by Fuzzing for a Weekend (secret.club)
By applying well-known fuzzing techniques to a popular target, I found several bugs that in total yielded over $200K in bounties. In this article I will demonstrate how powerful fuzzing can be when applied to software which has not yet faced sufficient testing.

Security, Bug Bounties, Software Testing

11 points by udev4096 72 days ago | 0 comments

Automated feature testing of Verilog parsers using fuzzing (wordpress.com)
I’m delighted that Quentin Corradi, a PhD student I jointly supervise with George Constantinides, will be presenting his work to improve the reliability of hardware design tools next week at the FUZZING’24 workshop, a satellite event of the ISSTA conference.

Hardware Design, Software Testing, Fuzzing

15 points by matt_d 85 days ago | 2 comments

Avoiding Test-Case Permutation Blowout (stevenhicks.me)

Software Testing, Software Engineering, Programming, Test Automation

36 points by todsacerdoti 90 days ago | 14 comments

Rust Just Failed an Important Test (mccue.dev)

Programming Languages, Rust, Software Testing

62 points by lladnar 125 days ago | 52 comments

Show HN: A fake SMTP server for software integration testing (fakemail.stream)

Software Testing, Software Development, Tools, Email

127 points by aeaa3 135 days ago | 49 comments

Show HN: How we use LLMs to find testing gaps, vulnerabilities in codebases (github.com/codeintegrity-ai)