Live data from Hacker News

Terence Tao: At the Erdos problem website, AI assistance now becoming routine

mathstodon.xyz

41–50 of 96 posts

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#41

Also interesting that the responses include anti-Lean material.

I'm not a mathematician, but how credible is that anti-Lean material? Are they marketing an alternative programmatic approach, as in they're anti-lean because "I got something else" or are they philosophically anti-Lean and have valid arguments?

It seems pretty obviously machine generated, and the appearance of the word "metaphysics" in the output suggests the prompt author didn't know what they were talking about to begin with.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#42

Having the ability to throw math heavy ML papers at the assistants and get simplified explanations / pseudocode back is absolutely amazing, as someone who's forgot most of what I learned in uni, 25+ years back and never really used it since.

Math notation is high context, so it's great to just ask llm's to print out the low context version in something like lisp where I can read and decompose it quickly.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#43
post #36

I was driving around tonight doing errands and while I was doing so, had a great conversation with chatgpt as to the intimate details of the llvm and GCC pipeline schedulers. It's a huge productivity boost. It has now taken notes for me for some compiler stuff I'm experimenting with. This would previously have been impossible.

Based on my experience, I would expect that the LLM was wrong about some of those details. Of course, your mileage (see what I did there?) may vary.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#44
post #24

Erdős I was told by a hungarian, that hungarian written spelling and spoken pronunciation is pretty precisely aligned compared to, say, english. Except when it comes to names when it gets a bit random! Why not do the bloke the decency to spell his name correctly? Those diacritics are important. Anyway, I was told that Paul's name is very roughly pronounced by an anglophone as: "airdish".

Irrelevant. Cf. Diogenes on death

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#45
post #27

Earlier quoted context omitted.

This is where LLMs shine for learning imo: throwing a paper in Claude and getting an overview then being able to ask questions. Especially for fields that I didn’t study at the Bachelors or Masters level, like biology. Getting to engage with deeper research with a knowledgeable tutor assistant has enabled me to go deeper than I otherwise could.

Isn't there a risk that you're engaging with an inaccurate summarization? At some point inaccurate information is worse than no information. Perhaps in low stakes situations it could at least guarantee some entertainment value. Though I worry that folks will get into high stakes situations without the tools to distinguish facts from smoothly worded slop.

Yes. I usually test AI assistants by giving them my own work to summarize, and have nearly always found errors in their interpretation of the work.

The texts have to be short and high-level for the assistants to have any chance of accurately explaining them.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#46
post #45

Earlier quoted context omitted.

Isn't there a risk that you're engaging with an inaccurate summarization? At some point inaccurate information is worse than no information. Perhaps in low stakes situations it could at least guarantee some entertainment value. Though I worry that folks will get into high stakes situations without the tools to distinguish facts from smoothly worded slop.

Yes. I usually test AI assistants by giving them my own work to summarize, and have nearly always found errors in their interpretation of the work. The texts have to be short and high-level for the assistants to have any chance of accurately explaining them.

I can probably process anything short and highlevel by myself in a reasonable time, and if I can’t, I will know, while the LLM will always simulate perfect understanding.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#47
post #27

Earlier quoted context omitted.

This is where LLMs shine for learning imo: throwing a paper in Claude and getting an overview then being able to ask questions. Especially for fields that I didn’t study at the Bachelors or Masters level, like biology. Getting to engage with deeper research with a knowledgeable tutor assistant has enabled me to go deeper than I otherwise could.

Isn't there a risk that you're engaging with an inaccurate summarization? At some point inaccurate information is worse than no information. Perhaps in low stakes situations it could at least guarantee some entertainment value. Though I worry that folks will get into high stakes situations without the tools to distinguish facts from smoothly worded slop.

There is, but there is an equal risk if you were to engage about any topic with any teacher you know. Everyone has a bias, and as long as you dont base your worldview and decisions fully on one output you will be fine.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#48

Earlier quoted context omitted.

The embarrassing failures or misconceptions of math experts with regards to research level mathematics? Definitely a serious problem. Though by your "Perelman and Wiles didn't need "AI" assistance" comment, you'd surely be there on the sidelines to ridicule them for each and every single one. I guess maybe that's where your concerns are coming from? I can practically see how these concerns of yours would suddenly eva…

If mathematicians aren't occasionally saying something that's obviously wrong to a 300-level student, are they really pushing the envelope? I'm just a programmer, but I find that my, and my coworkers, biggest insights always come right after we've said something seriously dumb.

"Progress by crashing into things then putting the broken pieces back together" is surprisingly effective.

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#49
post #24

Erdős I was told by a hungarian, that hungarian written spelling and spoken pronunciation is pretty precisely aligned compared to, say, english. Except when it comes to names when it gets a bit random! Why not do the bloke the decency to spell his name correctly? Those diacritics are important. Anyway, I was told that Paul's name is very roughly pronounced by an anglophone as: "airdish".

I take it that that's a palatalized ending? I read your comment at first and was like "airdish" wtf? Then I palatalized the 'os' ending and realized oh yeah... that does sound kind of like airdish!

Re: Terence Tao: At the Erdos problem website, AI assistance now becoming routine

#50
post #24

Erdős I was told by a hungarian, that hungarian written spelling and spoken pronunciation is pretty precisely aligned compared to, say, english. Except when it comes to names when it gets a bit random! Why not do the bloke the decency to spell his name correctly? Those diacritics are important. Anyway, I was told that Paul's name is very roughly pronounced by an anglophone as: "airdish".

I could be wrong, but FWIW I doubt Hungarians include diacritics that don’t exist in Hungarian (like ñ) when writing foreign names.

Depends. There are names that are "romanized" to Hungarian pronunciation rules, like Dosztojevszkij (Dostoevsky), or Kolumbusz Kristóf (Cristoforo Colombo - Hungarian puts the family name first), though it is no longer the practice, it's mostly used for historic names only. That is, Trump is written like that, and not as we would pronounce (something like "Trámp")

In general, if the source language has a latin alphabet, we try to stick to the original spelling in most cases, but it is not uncommon to replace non-Hungarian letters with the closest one. It's a bit more complicated in case of non-latin alphabets, especially Cyrillic due to a lot of shared history.

Post reply on HN