I'm going to say an unpopular opinion here: I think agents are going to turn out mostly useless, even if they worked almost perfectly. How many jobs involve purely clicking things on a computer without human authorities, rules, regulations, permits, spending agreements, privacy laws, security requirements, insurance requirements, or licensing gates? I wager, almost none. The bottleneck in most work isn't "clicking th…
I worked in the fraud department for for a big bank (handling questionable transactions). I can say with 100% certainty an agent could do the job better than 80% of the people I worked with and cheaper than the other 20%.
How many caught attempts will it take for someone to find the right prompt injection to systematically evade LLMs here?
With a random selection of sub-competent human reviewers, the answer is approximately infinity.