Live data from Hacker News

AI isn’t outthinking mathematicians, it’s out-remembering them

davidepiffer.com

281–290 of 545 posts

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#281

Earlier quoted context omitted.

Yeah, LLMs are great at generating negative results for math-related prompts "We scanned values {a,b,c} from 0-100 and no results" Great..too bad journals will not publish this. But good job, I guess. A negative result is only truly useful if it can be bounded, requiring an actual proof.

> A negative result is only truly useful if it can be bounded, requiring an actual proof. That's at least true for current journals, since they're supposed to be read by actual humans. I suppose one could imagine a sort of "AI" pure data journal that just "publishes" (in actuality aggregates) any sort of partial result. This body of knowledge would be entirely useless to humans, but could serve as a sort of "computat…

> would be entirely useless to humans

why useless? humans can navigate these unsuccessful chains of thoughts to build on top of them or reject completely

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#282
post #246

Earlier quoted context omitted.

And that's the reason she's wrong?

You were the one introducing the argument "they are getting advantages out of it so we should be careful to not take what they say as an impartial view". Same can be told of Hossenfelder (personally, I would say that Hossenfelder has shown more clues that indeed she is not very reliable and would prefer caricatural sensationalistic descriptions, which is not what the typical string theory physicist does).

No, my point was only to refute the idea that people need to be egotistical or moronic (the only two options) to cling to an idea past its expiry date. People could also be “pot-committed” career-wise. Or they could have myriad other reasons (identity, sunk-cost fallacy, etc).

Nowhere did I suggest that “the reason for discrediting string theorists is that they have financial stakes in the idea.” Please try to be more charitable than that.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#283
post #166

Earlier quoted context omitted.

> The entirety of human civilization is human shaped. That's the marketing pitch. A plumbing robot doesn't need to be humanoid, an octopus shape may well be better for all the awkward corners. A robot police officer could be the municipality itself for sensory nodes (essentially the sales pitch of Flock etc.), plus some drones or robot dogs to perform arrests*. The robot vacuum cleaners and lawnmowers we already have…

You are not understanding what humanoid robots are about. Those are specialist robots you are describing. The promise is of course one robot that can do the plumbing, clean your house, do the dishes, build a house, and basically every physical job a human can do. It's extreme lly likely that at least a somewhat humanoid shape is required for that.

My octopus will outperform your humanoid by doing the dishes, fixing the plumbing, and preparing a Caesar salad, all at the same time!

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#284

Earlier quoted context omitted.

I beg to differ because a compiler is deterministic.

Did you check? Do you care if it sometimes does mov ax, 0 or sometimes xor ax,ax? (Forgive my bad memory, it was a long time ago) Would you personally vouch, at your job, for the importance of proper assembly coding standards?

I was more after the fact i can trust the compiler to give me the same result - even though via an optimized path.

Certainly scopes vary, but in my line of work i define memory layout and how this data will be processed myself - thus it's great a compiler might do that, but the result of the computation will not change.

Now in comparison giving an LLM specs ... i a) cannot be sure what the computation will be b) it might be something else on another run.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#285

I suspect that a lot about what we call being very intelligent is ultimately out-remembering people around us. I think of all the times in my software career when I did something that others considered very high performance, it either came down to either having more energy than others at tackling a problem they thought was more trouble than it was worth, or just bringing back random knowledge from previous jobs or se…

Memory is one aspect of intelligence, but hardly the only one. Making new connections, logical deduction, spatial intelligence and creativity are also aspects.

I have fairly poor memory, but I can solve problems that people with better memory can't.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#286

Does it matter? It's going to produce proofs far more intricate than humans can understand, outdoing humans and opening new frontiers. The age of humans comprehending things is coming to an end: our brains just won't have the capacity to make meaningful contributions to science, math, or technology.

Then it's pretty bad that LLMs don't understand anything.

They don't know and can't know. Without an external source of input that corrects them, their output can never be verified.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#287
post #33

Yes. That's how LLMs do programming, mostly. It's also why LLMs don't need abstractions or parsimony as much as humans. They can work on something complicated without simplifying it first. This has major implications that haven't been fully realized yet. On the math side, there are long machine generated proofs. On the code side, there are high volumes of code with similar code not being folded into functions.

LLMs use abstractions a ton in code though: standard library functions, popular libraries, etc. They just dont always make their own abstractions. At least not particularly good ones. LLMs work really well when they have well abstracted pieces to put together.

With good source code they output good code that mimics existing code.

If they don't have good code to mimic, anything goes. They might use libraries or they might start to write their own implementation of a PNG encoder.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#288
I thought this was fairly obvious. I don't consider any of the AI models I've worked with particularly smart, but they've read orders of magnitude more than I ever could in my entire lifetime. They have far better book knowledge than I have, so that's how I use them. I use them for things that I suspect other people out there would know, but I don't. But when I work on something that I suspect is truly new, the models rarely understand what I'm doing, and I've got to do it myself. Although I still poll them for basic principles, best practices, and other advice.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#289

I can't help but think of Michael Nielsen's essay "Augmenting Long-Term Memory" [1]. > Many people's model of accomplished mathematicians is that they are astoundingly bright, with very high IQs, and the ability to deal with very complex ideas in their mind. A common perception is that their smartness gives them the ability to deal with very complex ideas. Basically, they have a higher horsepower engine. > It's true…

> many top mathematicians have, through hard work, internalized many more complex mathematical chunks than ordinary humans

Do you really think an average person can internalize complex math? Them compressing it effectively and then remembering it is a sign of (very) high intelligence.

Re: AI isn’t outthinking mathematicians, it’s out-remembering them

#290

Earlier quoted context omitted.

People have told me I was smart since I was a kid, but I can't remember for shit. I had a thought when I was fairly young that the only reason I was (maybe, sometimes) outperforming others intellectually is that I was habitually compensating for my poor memory by working things out on the fly, while others could rely more on rote memorization. Anyway, takes all kinds I guess!

Same. I have bad "factual" memory, but very good "conceptual" memory. I might not remember exactly what someone told me, but I probably gathered a keyword, and a feeling and idea of what they told me. Almost like it takes what they said then compresses it into my mind in a nice little multi-key lookup table.

Oh man, I have that too. I am always told by my best friend "well, you go it right, but entirely wrong words" -- or something to the effect I got the feeling, notion, or concept right, but the wrong words.

This has affected me a lot though, I know what is going on in songs, but can't ever remember the right words, but still some how end up sining stuff that means the same thing :/

Post reply on HN