Live data from Hacker News

Ten advances in mathematics and theoretical computer science

openai.com

671–680 of 1001 posts

Re: Ten advances in mathematics and theoretical computer science

#671
post #25

Earlier quoted context omitted.

A better analogy would be a manufactured object, say 3d printed for simplicity. The 3d printer is given an input, and an object manifests itself after some time. We say that the creator of the object is the person turning on the machine, sending the data, and collecting the object. Not the machine itself.

I'd say the creator is the one who created the 3d model, not the one who pushed the print button.

True story: I have a moisture issue in my furnace, such that it needs vacuuming out. This involved detaching a length of tubing, but that puts stress on said tubing, sometimes knocks other things out of alignment, and involves completing the seal between the wetvac and the tubing with my hand.

I also have a 3D printer. I also have a ChatGPT subscription, and some OpenSCAD chops. I came up with a part which would go into the top of the down tube to the drainage pump, and mostly-seal the down tube itself, with an opening on the side to vacuum out the moisture. This was purely prooompted, I took some measurements, printed bits of the part, refined the shape, and you know what?

It works! I can stick it down there, turn on the (very loud) wet vac, and go upstairs. On a 1.5Ah battery it sucks for a bit less than ten minutes, which turns out to be plenty of time.

So: who made that?

Don't care. I'm waking up warm at night.

Also: me, obviously. ChatGPT doesn't have a fucking furnace.

Re: Ten advances in mathematics and theoretical computer science

#672
Any computable problem will eventually fall to computers.

LLMs have made math proofs more computable, in the sense that a computer can both generate potential solutions and check the validity of its solutions on its own, with a reasonable chance of converging on something correct. I assume this was already doable to some extent, but it seems like it’s now exponentially easier. That still doesn’t mean that all math is automatically solved.

This is somewhat similar to things like molecular dynamics or protein folding or finite element simulations, etc. Some problems that were previously intractable via computation became tractable. Others - the vast majority of other problems - remain unsolvable by these computational techniques, because the scale of compute required is beyond imagination. These are simple things like simulating the dynamics of a cubic millimeter of water molecules for 1 second. Unfathomably beyond current capabilities (and LLMs aren’t going to change that).

I think LLMs are great, I use them every day and I think they have a ton of value. But if these things were as revolutionary as people promote/fear them to be, you should immediately point them at the highest value math problems and see progress. Like the Millenium Prize problems. Haven’t seen a solution to those.

So there are limits - but we’re about to learn a lot about the new normal of what constitutes a layup math proof vs the truly difficult.

Re: Ten advances in mathematics and theoretical computer science

#673
post #660

Earlier quoted context omitted.

Sigmoidal, not exponential. It would be insane to assume an exponential curve

this gets more nuanced because "the sigmoids won't save you": https://www.astralcodexten.com/p/the-sigmoids-wont-save-you

If the sigmoid is incorrect it's certainly more correct than the exponential.

> https://www.astralcodexten.com/p/the-sigmoids-wont-save-you

The conclusion of this article seems to be "you should give ai the benefit of the doubt against all reason". Barf

Re: Ten advances in mathematics and theoretical computer science

#674

Earlier quoted context omitted.

The models are frequently getting worse at items that they aren’t being benchmarked for — and that’s happening more and more over time! Other people in other fields aren’t idiots, they are accurately perceiving the fact that these models are being hyper optimized for our industry, and are becoming less capable in other domains over time. Models of the same scale are massively worse at writing a broad variety of style…

So your answer is: ignore the progress, it’s not really happening, actually it’s getting worse. That’s not a credible position, but there isn’t anything that I or anyone else can say to someone who simply doesn’t want to believe something.

It sounds like they are making a clear argument: models are getting worse for certain domains even while they are getting better at others.

I don't know if I agree with that but it doesn't seem like an irrational claim and does seem credible to me.

Re: Ten advances in mathematics and theoretical computer science

#675

Earlier quoted context omitted.

In the near term handling the transition. Jobs will be lost, careers ended, people won’t be able to reskill quickly enough. At the same time AI is an enormous opportunity to uplift living standards, but nobody has the logistics of this figured out. We need to figure out how to restructure the global economy. How does UBI work internationally, if the AI companies are taking revenue in the US? What’s the tax base for i…

Everything you're saying is oddly simultaneously specific and hand-wavy at the same time. I say this because I'm not sure a lot of these things are solvable or, if they are, it's going to take lifetimes. For example: > How do we replace the work ethic that tells us we are our jobs and idleness is immoral? For many people it has nothing to do with morality, it's hardwired into their instincts. They want to work, and t…

Beautifully put. This exactly summarizes my feelings about this particular tech. I actually find it hugely useful. But I fear we lack the wisdom to use this in a way that won't destroy us.

Re: Ten advances in mathematics and theoretical computer science

#676

one of the early premises of how ai takeoff would go was that a system that could solve open problems in advanced mathematics would also discover novel advances in math and computer science that directly unlock drastically better software performance. we are seeing frontier level math breakthroughs (ie performance that would put it in the top 100 or 1000 mathematicians in the world if it were a human, meaning top .00…

I don’t really like AI but let’s stop kidding ourselves, no human mathematician could make progress on a dozen major open problems in a week or two. If you’re measuring it against humans then it is by far the best mathematician to ever live.

I guess it depends on how to measure a single "person"? If you spun up 2000 copies of Terrance Tao, I wouldn't be surprised if you found a few new discoveries at the end of it.

Re: Ten advances in mathematics and theoretical computer science

#677
post #379

Earlier quoted context omitted.

[flagged]

> We are now at the point where RSI is feasible What can be asserted without evidence can also be dismissed without evidence. - Hitchen's Razor

Did you read the article?

AI is a math & computer science problem. If AI can do advanced maths and computer science research, then it can begin to suggest useful algorithmic optimisations.

Right now I'm sure the vast majority of these will be junk, but occasionally, even with current limitations, they might occasionally stumble on something.

It's not really whether RSI is or isn't possible, it's really just whether it's the most efficient way for labs to improve their models today given they have limited compute to run AI-generated experiments and access to very intelligent humans who might have a better hit/miss ratio.

Do you disagree with anything I'm saying here? Do you not think current AIs can suggest algorithmic improvements or something?

Re: Ten advances in mathematics and theoretical computer science

#678

How do we know that these solutions don't exist in the training data? It is open secret that they have used pirated materials for training. Perhaps it plagiarized solutions from works of some obscure Belgian mathematician from the sixties, who did not get mainstream acceptance. I wouldn't be surprised if they also got access to mathematics done in the "defense contractor" setting from various three letter agencies. W…

upvoted for fair point .. its possible an LLM AI could be put to work to search widely for attribution / similar results.

eg. "we spent another 2k on searching for pre-existing proof but found only the weaker result xyz by abc in 1972" would be in the spirit of academics quoting prior work.

Re: Ten advances in mathematics and theoretical computer science

#679
post #634

Looking at this thread, I can see that a lot of technical people have ambivalent to negative feelings towards AI, but with each new generation, I become more and more convinced that they're missing out on something interesting. It is indeed true that all models are, at their core, predictors of what occurs next in a sequence. But I think it's worth exploring the implication of what that means. Because when fed tiny p…

> I can see that a lot of technical people have ambivalent to negative feelings towards AI My negative feelings towards AI are about energy use and inequalities, that kind of stuff. It undeniably works well, but whether or not it is better for society or the planet is a lot less clear.

Same. Even the most basic versions of LLM are magical to me. To encode meaning from language like that, and to then form relationships based on it, and use it to solve problems. It's an amazing technical achievement.

But I want to be reading about that from the comfort of a home, with a full belly.

Re: Ten advances in mathematics and theoretical computer science

#680

Can’t wait for this stuff to have quality of life increases for the average person. So far all I see is that AI has made owning a computer more expensive, made some jobs redundant, increased spam and distrust with questionable authenticity of content and of course made some Americans very rich.

It has had significant quality of life increases for me. I use LLMs for everything from:

- travel and restaurant recommendations. my last few outings have been entirely LLM-advised and they turned out excellent. LLMs seem to have ingested every single Google review, photo, and menu of every business on Earth and can answer very nuanced questions like "is the garlic chicken at garnished with coriander?"

- fitness, nutrition, accounting, therapy, medical, legal, immigration advice (sure it's not a real professional but you know what, it's pretty fucking close, and any capability gap is made up by having perfect two-way communication which you don't get when talking with a human)

- coding (work, side projects, personal tools, documentation & pricing questions, "review this code", etc).

- I start reading most articles with the prompt "Summarize this article: ". I just started a non-fiction book by pasting into Claude: "There are 12 chapters in the book . Can you give me a 2 sentence synopsis of each chapter?". It reduces the "activation energy" hump and screens if it's worth reading at all.

- I use the LLM in my Tesla for on-the-fly advice for parking and other things. You can simply ask "what's the best Boba place around here?" and it will give you a decent recommendation. You can also follow up with "does this place have ample parking?".

- I use the LLM in YouTube to summarize videos and ask specific questions and/or get timestamps to the parts I care about.

If your critical thinking skills are strong then LLM is a literal superpower.

Post reply on HN