Do people trust these kinds of things to effectively work async and unsupervised? My experience with coding agents leads me to believe using something like this will end up being more noise and work than ROI I suppose it could be effectively the same loop I use in VS Code, but then why would I want an external tool over an integration?
I think that depends on how far out your horizon is. If you're only looking one task out, or maybe a few weeks out, then it's not worth investing the time yet. On the other hand, if you're looking at how your engineering team will work in 3 years time it's definitely worth starting to look at it now.
An example that comes to mind: having a bot that automatically spins up an environment when a library is updated, runs through the tests, and identifies why a codebase doesn't work with the update, and fixes it then opens an appropriate PR that passes all the tests for humans to review would be incredibly useful.