Live data from Hacker News

What's Going on in Machine Learning? Some Minimal Models

writings.stephenwolfram.com

71–73 of 73 posts

Re: What's Going on in Machine Learning? Some Minimal Models

#71
post #70
post #58

Earlier quoted context omitted.

When an LLM solves a novel problem, it's also reasoning, unless you use some contrived definition of the word "reasoning" that doesn't match how the word is actually used in normal conversation. Also I fully expect the human brain to be encoded in a mathematical model. And if it wasn't obvious, an LLM can string together two words that it had never seen together in the training dataset, it really shows how people ten…

No. It is the AI enthusiasts that use contrived, often entirely random definitions of “reasoning”. AIs do not “think” in any capacity and are therefore incapable of reasoning. However, if you wish to take “thinking” out of the definition, where we allow an AI to try its hand at “novel (for it)” problems, then AIs fail the test horrifically. I agree, they will probably spit something out and sound confident, but sound…

These arguments really make no sense: "it can't reason because it can't think" very comprehensive ahah

Also if you train an AI on how numbers work, like humans do in school, you can tell it how much you want to believe that 2+2=5, it won't believe it, just like humans, it's obvious.

Re: What's Going on in Machine Learning? Some Minimal Models

#72
post #59
post #8

Is a TL;DR available or at least some of the ideas covered? Because after 3 paragraphs it seems the good old "it is actually something resembling a cellular automata" post by Wolfram.

Wolfram explains the basic concepts of neural networks rather well, I think. He trains and runs a perceptron at the beginning und then a simpler network. Then he dwells into replacing the continuous functions they constitute into discrete binary ones — and ends up with cellular automata he thinks emulate neural networks and their training process. While this surely looks interesting all „insight“ he obtains into the…

We know there are infinitely many solutions, it is just hard to find a specific configuration of parameters. The question is, do all those configurations generalize or not.

Re: What's Going on in Machine Learning? Some Minimal Models

#73
post #24
post #17

I can never read comments on any wolfram blog on HN because they're always so mean spirited. I'm seeing a nerdy guy explaining things from a cool new perspective I'm excited to read through. The comments almost always have some lens against him being 'self centered' or obsessing about cellular automata (who cares we all have our obsessions)

Same here on anything Elon. HN is like an uncle who knows a lot and teaches you new things every time you hang out with him… but who also has a few really weird sore spots that you better never mention in his presence.

I have observed that the topic naturally gravitates towards mentioning Elon in every thread where people are confessing their infatuation with grifters.
Post reply on HN