> After decades of investment, oversight, and standards development, we are not closer to total situational awareness through a computerized brain than we were in the 1970s. Hard to see how that could be true. In just about any field, computers today provide much better situational awareness than was possible in 1970. The article makes the usual complaints about self driving cars: > Despite $16 billion in investment…
FYI, it was written by a woman. I looked up her book, Kill It with Fire, and as a mainframer I have to say it seems pretty interesting.
I think what she alludes to in this essay, though, is more like that AI cannot solve socioeconomic problems of humans. And even humans seem to struggle with it.
Whenever I read stories where the metrics became the targets, and the like, I am reminded of Varoufakis' book Economic Indeterminacy. He doesn't give any answers there, but there is this "strange loop" in rationalism that nobody really understands.
I also think that AI might be a wrong target, because you need to understand the problem before you can solve it, and once humans understand the problem, they don't need AI anymore, they just code the solution as an algorithm. On the other hand, if humans don't fully understand the problem, it's extremely difficult (except artificial circumstances like games) to explain to AI what the problem is, so it would arrive at a "reasonable" solution (and avoided, at the very least, killing all humans).