Live data from Hacker News

Amateur armed with ChatGPT solves an Erdős problem

scientificamerican.com

351–360 of 607 posts

Re: Amateur armed with ChatGPT solves an Erdős problem

#351
post #336

Earlier quoted context omitted.

> the AI says things like “Interesting!” My experience of those utterance is that it’s purely phatic mimicry: they lack genuine intuitive surprise, it’s just marking a very odd shift in direction. The problem isn’t the lack of path, is that the rhetorical follow-up to those leaps are usually relevant results, so they stream-of-token ends up rapidly over-playing its own conviction. That’s why it’s necessary (and often…

It’s funny that this is probably due to bias in the training texts, right? Humans are way more likely to publish their “Eureka!” moments than their screwups… if they did, maybe models would’ve exhibit this behavior. Now that AI labs have all these “Nevermind” texts to train on, maybe it’s getting easier to correct? (Would require some postprocessing to classify the AI outputs as successful or not before training)

My understanding is that it’s the result of these companies making sure to keep you engaged/happy less than the result of data these companies train with.

I don’t know if it’s true or not but it certainly tracks given LLMs are way more polite than the average post on the internet lol

Re: Amateur armed with ChatGPT solves an Erdős problem

#352
> “What’s beginning to emerge is that the problem was maybe easier than expected, and it was like there was some kind of mental block.”

Even if AI never progresses past this point, it still seems like a huge win for math research to “clear the deck” of these.

Re: Amateur armed with ChatGPT solves an Erdős problem

#353
post #336
post #265

Earlier quoted context omitted.

What I find fascinating about the shared prompt isn’t just the result, but the visible thinking process. Math papers usually skip all the messy parts and just present the polished proof. But here you get something closer to their notepad. I also find it oddly endearing when the AI says things like “Interesting!” It almost feels like a researcher encouraging themselves after a small progress. It gives me rare feeling…

> the AI says things like “Interesting!” My experience of those utterance is that it’s purely phatic mimicry: they lack genuine intuitive surprise, it’s just marking a very odd shift in direction. The problem isn’t the lack of path, is that the rhetorical follow-up to those leaps are usually relevant results, so they stream-of-token ends up rapidly over-playing its own conviction. That’s why it’s necessary (and often…

Interestingly this is strikingly similar to how my mind would process something I find genuinely interesting.

Re: Amateur armed with ChatGPT solves an Erdős problem

#354
post #336
post #265

Earlier quoted context omitted.

What I find fascinating about the shared prompt isn’t just the result, but the visible thinking process. Math papers usually skip all the messy parts and just present the polished proof. But here you get something closer to their notepad. I also find it oddly endearing when the AI says things like “Interesting!” It almost feels like a researcher encouraging themselves after a small progress. It gives me rare feeling…

> the AI says things like “Interesting!” My experience of those utterance is that it’s purely phatic mimicry: they lack genuine intuitive surprise, it’s just marking a very odd shift in direction. The problem isn’t the lack of path, is that the rhetorical follow-up to those leaps are usually relevant results, so they stream-of-token ends up rapidly over-playing its own conviction. That’s why it’s necessary (and often…

I've somehow managed to train mine out of trying to fluff me up the whole time, its become very factual.

Overall it saves me a lot of time reading when it's just focusing on the details.

Re: Amateur armed with ChatGPT solves an Erdős problem

#355
post #273

Here is the chat: don't search the internet. This is a test to see how well you can craft non-trivial, novel and creative proofs given a "number theory and primitive sets" math problem. Provide a full unconditional proof or disproof of the problem. {{problem}} REMEMBER - this unconditional argument may require non-trivial, creative and novel elements. Then "Thought for 80m 17s" https://chatgpt.com/share/69dd1c83-b164…

I am curious if there is a “harness” for maths out there (like the system prompt and tool collection in Claude code but for maths instead of coding)? Asking the llm to structure its response in plan and implementation, allowing it to call tools like python, sage, lean etc.

Why wouldn't you just use coding agents and ensure you have e.g. Lean and Mathlib in the environment?

Re: Amateur armed with ChatGPT solves an Erdős problem

#357
post #331
post #181

Earlier quoted context omitted.

You don't need to say "Minor aside" either. Thankfully language is a creative endeavour not a scientific one.

Context: parent originally said "you should not say 'worth mentioning', if it's worth mentioning you can just say it". That sentence has now been edited out so my comment looks weird.

Your reply was so rude it convinced me to edit. Your second reply is a distortion of my original message too.

Re: Amateur armed with ChatGPT solves an Erdős problem

#358
If anything, this shows that by shoving all the knowledge we have currently in a blender, that we've actually solved a LOT more than we think.

This LLM prompt didnt create *new* proofs. It used existing human knowledge from other areas that arent well shared, and connected associations to the problem at hand.

It was already mostly solved. The LLM just basically did the usual pattern matching of jigsaw pieces and connected the 2 domains together. We see that with "The LLM took an entirely different route, using a formula that was well known in related parts of math, but which no one had thought to apply to this type of question." in the article.

There's still a TON of stuff that can be done to connect domains together. And that alone is amazingly powerful. But humans are still doing the creative work at the edges. These stochastic word-calculus machines are not yet able to generate new thought, or process absolutely current research. It'll probably get there... but we'll likely need thinking machines. Thats also the hell scenario too.

Re: Amateur armed with ChatGPT solves an Erdős problem

#359

Earlier quoted context omitted.

So this doesn't happen in the paid plans of ChatGPT? But why?

Paid plans give you access to much larger, more intelligent models which have thinking enabled (inference time compute). In the example here you can see GPT Pro taking 20-80 minutes to respond with the proof. All this is far more expensive to serve so it’s locked away behind paid plans.

> thinking enabled (inference time compute)

What do you mean by compute?

Re: Amateur armed with ChatGPT solves an Erdős problem

#360

Here is the chat: don't search the internet. This is a test to see how well you can craft non-trivial, novel and creative proofs given a "number theory and primitive sets" math problem. Provide a full unconditional proof or disproof of the problem. {{problem}} REMEMBER - this unconditional argument may require non-trivial, creative and novel elements. Then "Thought for 80m 17s" https://chatgpt.com/share/69dd1c83-b164…

> "Thought for 80m 17s"

Is there any good rule of thumb for how many kWh of electricity this is?

Post reply on HN