Earlier quoted context omitted.
> As a CTO of an Ai first law firm I would like to add that most human lawyers are absolutely terrible This is many people at many jobs. We continue to see this weird thing when AI comes into an industry that suddenly the product being produced by the people was perfect/amazing/whatever. Maybe that's true for the majority of HN who are lucky enough to work with experts in every field, but in the general population th…
The problem is that a layman has no way to know if what the llm told them is better than experts around them, or even just remotely correct. A wrong response and a correct, informative, helpful response look exactly the same, the LLM will express the same level of confidence and will defend them in both cases. So, on one hand you can get an expert take that might be wrong, but is linked to an actual person, with a re…
It is entirely clear that is it not the case when I compare agent generated apps with what contracted software teams have produced.
For medicine it is likely worse.
Doctors do care, but they have to give an advice based on their 15 year old knowledge - they simply can't read through 83 papers in a quick session.
I think it is a matter of time before we see the first insurance companies assign greater risk to human advice (legal, tech, medicine, etc.) than to agentic advice.