>
Something is off.Yes. The fundamental assumptions about how brains work are wrong.
I see, far too often, the dismissive interpretation of brains as "A couple crappy cameras tied to a neural network" - which leads to the "Well, we have better cameras and we know how to do neural networks, so it can't be hard!" Throw in some dismissive statements about how awful humans are at driving and such, and you're set for the trap.
Human/animal vision systems are way more optimized than that sort of handwaving dismissal. The "cameras" are well optimized for what's needed, and have some pretty darned impressive scanning features to make a very small central cone of resolution do everything that's needed - without flooding the brain with HD video in places that don't matter. It's an optimized system for making a fairly narrow feed cover everything that's needed.
https://en.wikipedia.org/wiki/Saccade
And, yes, there are some weird quirks of vision systems - optical illusions and such. But once you get past the eyes, the rest of the "Make sense of the 3D world around us" system is insanely optimized, and exceedingly power efficient. It works well enough and reliably enough to handle absolutely absurd changes in the operating environments. Humans did not come born with "supersonic low level flight" built into the system, yet... our brains can work with it. It just takes some learning and brain adjustments.
And the whole rest of the system following is similarly impressive.
There's a typically paired arrogance you also see: "We are like gods in the synthetic world of the internet, because we know code and manage 99.995% API success rates, therefore we can use code to solve reality." Reality is infinitely more creative at throwing wrenches into things than we are at solving them with code, and while it doesn't really matter on the internet, it very much does matter at 75mph.
When you dismiss all that as "crappy cameras and a neural network, we know code, we can do that!" - you end up failing in the predictable ways we see with the self driving cars.