The test run stopped teaching us anything. Recorded calls, explicit retries, and one useful failure report made the harness dependable again.
Project note12 min read
Rewriting the eval harness after forty flaky runs
The test run stopped teaching us anything. Recorded calls, explicit retries, and one useful failure report made the harness dependable again.
TestingReliability
Source links stay with the relevant section