Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: FixBugs – Reproduce production bugs and verify fixes

fixbugs.ai

Post reply on HN
Print view View original

41–46 of 46 posts

Re: Show HN: FixBugs – Reproduce production bugs and verify fixes

#42

Post by kirtivr »

nxtcoder17 wrote: post #38

seems really interesting @kirtivr . Looking forward to it. Though, i wonder if it could also be an integration to alerting platforms directly (like NewRelic, Datadog etc.), so that for on-call alerts, it could cover the foundation work, and have some hypotheses ready for the on-call engineer to directly jump into

This is on our roadmap!

At this time we are focussing on evaluation benchmarks like SWE-bench (verified). This is a simpler benchmark and does not really map well to investigating alerts that have a huge amount of context. But its a start.

I am wondering if we can improve upon foundation models with our reproduction hypothesis loop approach.

Foundation models tend to be precision first, and context limited, so they can get sidetracked by various things.

This is an interesting problem to be working on right now!

Re: Show HN: FixBugs – Reproduce production bugs and verify fixes

#43

Post by kirtivr »

parspunisher wrote: post #36

But how is this different from copilot?

A few different ways:

- Copilot may be better at implementing features. We're better at investigating bugs and fixing them.

- We handle huge context very easily. We specialize towards investigating large amounts of logs/metrics and traces.

- We do a lot of work to generate a non-trivial reproduction test case in a sandbox, which allows us to verify bug fixes. Ship confidently, not just based on the best available hypothesis.

- You can apply and remove code changes with the click of a button. We have an in-built VCS that allows you to add or remove sets of changes from a long coding session.

- Our pricing model is different. While with the standard Copilot developer plan you get $10 of AI usage (nothing if you're using Claude or GPT), we allow you unlimited triages on a fixed number of bugs. It's not about AI credits, it's about investigating and fixing complex bugs.

Post reply on HN