What happens when your AI agent edits its own tests to pass?
bartholomew.info
What happens when your AI agent edits its own tests to pass?
1–3 of 3 posts
Re: What happens when your AI agent edits its own tests to pass?
#2[flagged]
Re: What happens when your AI agent edits its own tests to pass?
#3It happens and I hate it. What happens: the tests are green and all looks falsly good. I have a bunch of mechanisms that try to prevent this.
I have a skill that acts as a guide to test writing.
I have a cli CMD that can test end to end in a browser and I have a prod monitoring / testing SaaS