Learnings from building AI agents

"51% fewer false positives", how were you measuring? is this an internal or benchmarking dataset?

I’ve been testing this for the last few months, and it is now much quieter than before, and even more useful.

what I saw using 5-6 tools like this:

- PR description is never useful they barely summarize the file changes

- 90% of comments are wrong or irrelevant wether it's because it's missing context, missing tribal knowledge, missing code quality rules or wrongly interpret the code change

- 5-10% of the time it actually spots something

Not entirely sure it's worth the noise