The LLM took an entirely different route, using a formula that was well known in related parts of math, but which no one had thought to apply to this type of question. Of course LLMs are still absolutely useless at actual maths computation, but I think this is one area where AI can excel --- the ability to combine many sources of knowledge and synthesise, may sometimes yield very useful results. Also reminds me of th…
Yeah, they're great at interpolation - they'll just never be worth much at extrapolation.
Amateur armed with ChatGPT solves an Erdős problem
71–80 of 607 posts
Re: Amateur armed with ChatGPT solves an Erdős problem
#72The LLM took an entirely different route, using a formula that was well known in related parts of math, but which no one had thought to apply to this type of question. Of course LLMs are still absolutely useless at actual maths computation, but I think this is one area where AI can excel --- the ability to combine many sources of knowledge and synthesise, may sometimes yield very useful results. Also reminds me of th…
Yeah, they're great at interpolation - they'll just never be worth much at extrapolation.
Re: Amateur armed with ChatGPT solves an Erdős problem
#73Earlier quoted context omitted.
What your describing sounds more like the model is lacking awareness than lacking intelligence? Why does it need to know it solved the problem to be intelligent?
We say African Elephants are intelligent for a number of reasons, one of which is because they remember where sources of water are in very dry conditions, and can successfully navigate back to them across relatively large distances. An intelligent being that can't remember its own past is at a significant disadvantage compared to others that can, which is exactly one of the reasons why alzheimers patients often requi…
Re: Amateur armed with ChatGPT solves an Erdős problem
#74Earlier quoted context omitted.
GPT 5.5 Pro is not available to any plan outside of ChatGPT Pro ($100 or $200) tier or the API as far as consumer access.
Yes, but don't we expect GPT 5.5 Pro will eventually be a free tier? Maybe I'm missing something because I only use the free tier. But the free tier has gotten way better over the last few years. I'm pretty sure, based on descriptions on this site from paid subscribers, that the free tier now is better than the paid tier of say 2 years ago. That's the lag I'm wondering about.
Re: Amateur armed with ChatGPT solves an Erdős problem
#75I wonder if the rationalizations people come up with for why this isn't real intelligence will be as creative as ChatGPTs solution.
Some people think that multiplying numbers, remembering a large number of facts, and being good at calculations is intelligence.
Most intelligent people do not think that.
Eventually, we will arrive at the same conclusion for what LLMs are doing now.
Re: Amateur armed with ChatGPT solves an Erdős problem
#76At this point we should make a GitHub repo with a huge list of unsolved “dry lab” problems and spin up a harness to try and solve them all every new release.
Re: Amateur armed with ChatGPT solves an Erdős problem
#77My big question with all these announcements is: How many other people were using the AI on problems like this, and, failing? Given the excitement around AI at the moment I think the answer is: a lot. Then my second question is how much VC money did all those tokens cost .
Re: Amateur armed with ChatGPT solves an Erdős problem
#78Earlier quoted context omitted.
But that’s exactly my point. These are absolutely worth studying, but being what they are, nobody should be dumping massive amounts of money on them. I would not find it persuasive if researchers used LLMs to solve the Collatz conjecture or finally decode Etruscan. These are extremely valuable, but it is unlikely to be worth it for an LLM just grinding tokens like crazy to do it.
Is it worth it to buy a super-yacht?
Re: Amateur armed with ChatGPT solves an Erdős problem
#79Earlier quoted context omitted.
For one, everything its 'intelligence' knows about solving the problem is contained within the finite context window memory buffer size for the particular model and session. Unless the memory contents of the context window are being saved to storage and reloaded later, unlike a human, it won't "remember" that it solved the problem and save its work somewhere to be easily referenced later.
There's humans that have memory issues, or full blown Anterograde amnesia.
Re: Amateur armed with ChatGPT solves an Erdős problem
#80The LLM took an entirely different route, using a formula that was well known in related parts of math, but which no one had thought to apply to this type of question. Of course LLMs are still absolutely useless at actual maths computation, but I think this is one area where AI can excel --- the ability to combine many sources of knowledge and synthesise, may sometimes yield very useful results. Also reminds me of th…
The combinatorial nature of trying things randomly means that it would take millennia or longer for light-speed monkeys typing at a keyboard, or GPUs, to solve such a problem without direction.
By now, people should stop dismissing RL-trained reasoning LLMs as stupid, aimless text predictors or combiners. They wouldn’t say the same thing about high-achieving, but non-creative, college students who can only solve hard conventional problems.
Yes, current LLMs likely still lack some major aspects of intelligence. They probably wouldn’t be able to come up with general relativity on their own with only training data up to 1905.
Neither did the vast majority of physicists back then.