Live data from Hacker News

Generative AI is overrated, long live old-school AI

encord.com

191–192 of 192 posts

Re: Generative AI is overrated, long live old-school AI

#191
post #108
post #85

Earlier quoted context omitted.

> A shell script will do exactly what it has been written to do every time, unless tampered with. Or unless some magic environment variable changes, or one of the runtime dependencies changes, or it is run on a different operating system, or permissions aren't setup right, or one of its tasks errors out. Shell scripts are digital duct tape, the vast majority of shell scripts do not come close to being reliable softwa…

AI proponents are missing the point. Anything you write to make an AI produce something is basically code. Docs are code. You don’t have to feed a developer code or docs, you can give them a high level idea and they’ll figure it out on their own if you want.

What developer working on anything meaningful does not rely on documentation? You certainly have to make the documentation available similar to how you would have to make it "available" to an LLM. I think you might be missing the point about what the potential use-cases for these systems are.

Re: Generative AI is overrated, long live old-school AI

#192
post #16

I m not sure it's overrated, but the concerns are very real. We love the model because it speaks our language as if it's "one of us", but this may be deceiving, and the complete lack of model for truth is disturbing. Making silly poems is fun but the real uses are in medicine and biology, fields that are so complex that they are probably impenetrable to the human mind. Can Reinforcement learning alone create a model…

I am not so sure, there seems to be accumulating evidence that "finding the optimal solutions" means (requires) building a world model. Whether it's consistent with ground truth probably depends on what you mean by ground truth. Given the hypothesis that the optimal solution for deep learning presented with a given training set, is to represent (simulate) the formal systemic relationships that generated that set, by…

> Prediction: a big enough network, well enough trained, is capable of simulating with arbitrary fidelity, an arbitrarily complex system, to the point that lack of fidelity hits a noise floor.

That is a pretty good description of human brains/bodies. You could also say that quantum physics is where our noise floor might be.

Post reply on HN