Earlier quoted context omitted.
> there’s no “intelligence” there BUT There is clearly intelligence there. We have no way to recognise intelligence other than the appearance of intelligence and this very clearly displays that. It's also quite clearly different to human intelligence in some notable ways, but not in any that preclude describing it as intelligent. At least for normal non-pedantic definitions of the word.
There is no intelligence. If anything, this just shows that natural language and mathematics are both fields which are structured in a logically computable way. And if you have a machine that can compute symbolic logic, you can process both natural language and mathematics. A second corollary is that rational consciousness and thought is less likely to be contained in language than previously thought, because if lang…
Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
401–410 of 681 posts
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#402Similar to the story of George Dantzig, who was late to class and solved two open problems in statistics because he mistook them for homework, I think the current batch of frontier LLMs are chained up by knowing which problems are supposed to be unsolved. If they're let free (probably via some targeted RLHF) we might get a flurry of solutions to open problems.
But a property of intelligence is to know when to stop, if we treat intelligence as some sort of search and not some a priori intuition of the entire space. Seems kind of hard, if not impossible, to train for specifically that.
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#403Earlier quoted context omitted.
One thing I've repeatedly told people is that chatbots are often the most patient teachers we'll ever get (especially when explaining "stupid" questions) — compared to what we've encountered on StackOverflow or Reddit.
They lack the empathy to understand where and why you're struggling. I've given private math lessons and seen students struggle with ai, even though ai gave the right answers. My intuition is that humans spot xy problems easier when teaching (user ask x but really needs y), whereas llms will oblige writing about x.
What I had in mind (and found personally useful myself) was being able to ask a chatbot to break something down into simpler and simpler concepts, until my weak fundamentals or lack of formal education could grasp some bit of it.
I'm not sure many humans (or colleagues at a workplace) would have the patience to tolerate the stupid questions I've been asking.
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#404Earlier quoted context omitted.
But... what is a ring? What is a formal variable? What is a vector space? What does "algebra over the ring" mean? His point is the terms are dense too
Absolutely agree. All formal statements (like mathematical ones) are going to have some level of assumed background. And as the assumed background expands, the language naturally becomes more information dense. As for your specific questions, I believe Wikipedia does a great job of answering two of them for a layperson: https://en.wikipedia.org/wiki/Ring_(mathematics) https://en.wikipedia.org/wiki/Vector_space For th…
I'm glad you answered them.
It finally makes sense to me, and now I realize I didn't even understand "over" in that context. That Ring wiki page though, um, nope... :D
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#405Earlier quoted context omitted.
> just repeatedly saying "keep going" to ChatGPT For posterity, this indeed works for most problems where an agent might give up. LLMs don't inherently know something is impossible. The phrase I tend to use in my harder prompts to automate this with a sane loop breaker: > **REPEAT THIS PROCESS UNTIL CONVERGENCE AND YOU ARE OUT OF OPTIMIZATION IDEAS.** You have permission to keep iterating.
I’m a bit surprised OpenAI isn’t finding these big results far faster than the product’s user base. With no limits on runtime, access to dev models, custom tuning, and top talent, you’d think there’d be a constantly running internal project with the goal of solving famous math problems. And who knows, perhaps there is, but it would be interesting to compare the rate of success per unit “effort” of the internal mathem…
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#406Earlier quoted context omitted.
They will have decades of experience with AI and they will be able to guide them by sniffing their hallucinations from single words.
Hopefully in decades hallucinations will be largely solved.
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#407Earlier quoted context omitted.
> just repeatedly saying "keep going" to ChatGPT For posterity, this indeed works for most problems where an agent might give up. LLMs don't inherently know something is impossible. The phrase I tend to use in my harder prompts to automate this with a sane loop breaker: > **REPEAT THIS PROCESS UNTIL CONVERGENCE AND YOU ARE OUT OF OPTIMIZATION IDEAS.** You have permission to keep iterating.
I’ll have to try this exact phrasing. I had a lot of trouble with GPT 5.5 more or less completely ignoring similar prompts and instructions and entering a sort of “doom loop” or just consistently trying to prematurely end the chat. I would love any tips for other folks who have successfully used similar approaches.
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#408Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#409Earlier quoted context omitted.
But... what is a ring? What is a formal variable? What is a vector space? What does "algebra over the ring" mean? His point is the terms are dense too
> But... what is a ring? What is a formal variable? What is a vector space? What does "algebra over the ring" mean? All these terms were taught to computer science (and of course math, physics, ...) students as part of getting their degree in computer science, because these concepts are important for many algorithms.
Re: Terence Tao's ChatGPT conversation about the Jacobian Conjecture counterexample
#410This is the second ChatGPT shared conversation I've seen today that is truly fascinating. The first one was someone proving another conjecture false by just repeatedly saying "keep going" to ChatGPT: https://x.com/DmitryRybin1/status/2079904005652893709 What a world we live in.
I'll have a third for you soon, here's the obligatory result in a tweet. A detailed post about it is in the works.