Regardless of how successful an AI can get at figuring out what the human operator wants, in the end, all it will manage to do is figure out what the human wants or give similar options to what the human asked for. My experience in working with software and being a client for other craftsmen, is that rarely that's what needs done, do what the human wants. The whole idea of a good craftsman is to figure out what the client needs. That was also my job for the past few years, figuring out what my company needs to build next, either as a product, or internal infra, tooling etc. I did end up building the things myself because there are only 4 engineers in my company and I had to do the building bit. An AI will boost my capabilities (automation does that too, but that still needs me to build it...).
Before you tell me that an AI will soon be able to do what I do, we are lifetimes away from that, if it's even possible. That will mean our creation fully understands us, it can understand stupid. If I were religiously inclined, I could even argue that even God failed at such a task.