Earlier quoted context omitted.
I mean sure, but this is exactly the argument against using a calculator and doing all your math by hand also.
There was a thread about that and gist was: A calculator is a great tool because it's deterministic and the failures are known (mostly related to precision); It eliminates the entire need of doing computation by hand and you don't have to babysit it though the computation process with "you're an expert mathematician..."; Also it's just a tool and you still need to learn basic mathematics to use it. The equivalent to…
With the calculator, it's typically a human error that causes the issue. With AI, it's an AI error. But in practice it's not a different workflow.
Give inputs -> some machine does work much faster than you could -> use your human knowledge to verify outputs -> move forward or go back to step 1.