Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ten advances in mathematics and theoretical computer science

openai.com

Post reply on HN
Print view View original

411–420 of 1001 posts

Re: Ten advances in mathematics and theoretical computer science

#411

Post by obidan »

enraged_camel wrote: post #377
slashdave wrote: post #212

Earlier quoted context omitted.

> we are also seeing incredible advances in software performance Incredible? > open ai announced like 15% improvement by fixing gpu kernel issue That is... ordinary software optimization.

There's nothing ordinary about downloading a new GPU driver and having performance go up by 15%.

This is untrue. It is very ordinary. How much do you know about GPU drivers that you state this so assuredly? Drivers are software. Software can be improved. Do you believe there are no prior examples of GPU drivers being improved such that particular compute patterns go up in performance by more than 15%? This driver improved Total War performance by 71% https://www.nvidia.com/download/driverResults.aspx/74714/en-... Also note you can go ahead and improve any open source driver right now, most likely. Compile it for your specific card and remove all other architecture specific if-cases and you can get an improvement.

Edit: also here’s a opencl 30% compute perf increase documented here : https://m.hexus.net/tech/news/graphics/74425-haswell-systems... that i just googled for

Re: Ten advances in mathematics and theoretical computer science

#412

Post by claytongulick »

evenhash wrote: post #408
DrBazza wrote: post #96

Replace philosophers for mathematicians and Douglas Adams was spot on again. Whilst current models can't 'intuit' and come up with conjectures, they can certainly disprove some of them very quickly through the kind of grind that humans can't do. I suppose there really are some mathematicians out there today, whose last few years of study, have just been up-ended by this. -- "Yes we are," insisted Majikthise. "We are…

> Whilst current models can't 'intuit' and come up with conjectures People keep saying this. Why? Surely the AI can complete the prompt “Generate new research questions based on these observations”? When I read the reasoning traces of coding models they are constantly asking themselves questions and attempting to answer them.

> People keep saying this. Why?

For the same reason that you can't draw a 15 of Diamonds from a regular card deck.

Re: Ten advances in mathematics and theoretical computer science

#413

Post by hollowcelery »

kcexn wrote: post #308
simianwords wrote: post #162

Earlier quoted context omitted.

> However, I am worried that the language they are using in this blog post is exaggerating for the sake of marketing Your worry.... is because they used the word advanced? For marketing? The word is used very appropriately here. There were PhD's who spent a big part of their career tackling these problems.

I have no idea how many PhD's have spent how much time of their careers tackling these very specific problems, and I doubt you do either. I'm trying to understand if these specific problems were the kinds of problems that would have justified an expert investing weeks or months to solve. Or if they were the kinds of problems that would normally have been given to students to investigate.

They are significant problems which experts have spent months or years studying. I heard a mathematician say that resolving non-sofic groups and Connes's rigidity would be career-defining for a mathematician.

Re: Ten advances in mathematics and theoretical computer science

#414

Post by bryan0 »

I think there's another interesting story here about how this was apparently moderately flagged and triggered the flame-war detector which kept the story off the front page of HN 2 days ago[0]. I think people are having a hard time processing this information rationally(?)

What can we do to make conversations around these incredibly exciting and important topics more constructive? HN is where I expect to read expert comments on these topics, has this style of conversation moved elsewhere?

[0]: https://news.ycombinator.com/item?id=49157930#49132926

Re: Ten advances in mathematics and theoretical computer science

#415

Post by variadix »

kypro wrote: post #373

I want to iterate the most important thing about this is that it's yet more evidence of AI's accelerating competency in solving math and comp sci problems, and suggests we're now getting close to the point where you could throw AI at AI research challenges (which are largely just math and comp sci problems) and potentially find very real algorithm improvements. AI development is likely to be more compute bottlenecked…

I’m starting to think the probability of RSI within 12 months is more like 99%

I’m not sure it will be FOOM, maybe it will require AIs to iterate on hardware to get orders of magnitude more compute/storage/energy which would more likely require months/years, but algorithmic progress would likely saturate quickly. I guess it depends on how much you think further AI progress depends on hardware vs. software.

Re: Ten advances in mathematics and theoretical computer science

#416

Post by scarmig »

8note wrote: post #387
enraged_camel wrote: post #371

Earlier quoted context omitted.

>> The motte is "AI useful". The bailey is "Singularity is nigh". But there are people like Ed Zitron, frequently posted and cited here, who disagree even with the former.

to an extent zitron is saying its not useful, but as a more nuanced opinion, "ai is not cost effective, nor is it improving profits or revenue"

From a random article I grabbed of his (https://www.wheresyoured.at/subprimeai/):

"it isn't clear whether generative AI actually provides much business value at all"

"cannot seem to find a product that people will pay for, in part because the results are so mediocre"

"Last week, we got our first real, definitive glimpse of what’s around that corner that future. And boy, was it underwhelming."

"OpenAI claims that o1 “performs similarly to PhD students on challenging benchmark tasks in physics, chemistry, and biology.” Just not in geography, it seems. Or basic elementary-level English language tests. Or math. Or programming. "

"Worse still, it's kind of hard to explain why anybody should give a shit about o1."

"o1 shows that OpenAI is both desperate and out of ideas."

"the software is not becoming more useful"

Honestly, every other line is quotable in this context.

Re: Ten advances in mathematics and theoretical computer science

#417

Post by Ar-Curunir »

kcexn wrote: post #307
Ar-Curunir wrote: post #177

Earlier quoted context omitted.

The problems from CS (CVP and circuit complexity) are very important problems that have been worked on by top researchers for 30-40 years. Some of these researchers include Turing Award winners. A solution to them would be a best-paper award at many top CS conferences.

I assume you're talking about No. 5, the arithmetic circuit complexity bound? The existence of a lower bound than state-of-the-art is certainly a significant result and worth publishing. But the wording of the result makes it sound like we don't know what the lowest possible complexity bound might be. So, prior to this result did we think there couldn't be a lower possible bound? Or did the arithmetic circuit communi…

Circuit complexity lower bounds (and lower bounds in general) are notoriously difficult to come across.

For example, despite our best efforts, the state of the art lower bounds on time complexity of algorithms for solving 3SAT is O(n). In contrast, our best algorithms for the task run in time roughly O(2^n). That’s an exponential gap. This is despite decades of trying to find lower bounds.

Re: Ten advances in mathematics and theoretical computer science

#418

Post by pavpanchekha »

skybrian wrote: post #407
ultimatefan1 wrote: post #118

one of the early premises of how ai takeoff would go was that a system that could solve open problems in advanced mathematics would also discover novel advances in math and computer science that directly unlock drastically better software performance. we are seeing frontier level math breakthroughs (ie performance that would put it in the top 100 or 1000 mathematicians in the world if it were a human, meaning top .00…

This will depend on the problem; I expect big algorithmic performance improvements in AI since the algorithms are still new, inefficent, and constantly being improved. But maybe not for sorting, fast fourier transforms, or other well-studied basic algorithms?

A lot of algorithmic improvement in AI is ultimately bottlenecked by compute. It is very easy to come up with ideas that could improve models! But to prove that they do, especially at scale, is expensive and takes a long time.

Re: Ten advances in mathematics and theoretical computer science

#419

Post by treis »

claytongulick wrote: post #412
evenhash wrote: post #408

Earlier quoted context omitted.

> Whilst current models can't 'intuit' and come up with conjectures People keep saying this. Why? Surely the AI can complete the prompt “Generate new research questions based on these observations”? When I read the reasoning traces of coding models they are constantly asking themselves questions and attempting to answer them.

> People keep saying this. Why? For the same reason that you can't draw a 15 of Diamonds from a regular card deck.

Of course you can. Tape a 7 and 8 of diamonds together and boom 15 of diamonds

Re: Ten advances in mathematics and theoretical computer science

#420

Post by GolfPopper »

Chance-Device wrote: post #406
c7b wrote: post #374

Earlier quoted context omitted.

And what does taking it seriously entail?

In the near term handling the transition. Jobs will be lost, careers ended, people won’t be able to reskill quickly enough. At the same time AI is an enormous opportunity to uplift living standards, but nobody has the logistics of this figured out. We need to figure out how to restructure the global economy. How does UBI work internationally, if the AI companies are taking revenue in the US? What’s the tax base for i…

[flagged]
Post reply on HN