Live data from Hacker News

OpenAI considers slowing advanced AI development, Sam Altman tells employees

bloomberg.com

51–60 of 103 posts

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#51

When the Chinese model drops that tops a paused Anthropic and OpenAI in all benchmarks how low will their valuations go?

Claude will release another employee ballast, the valid but in-conceived alarmism will surely reach POTUS ears.

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#54
post #30

Earlier quoted context omitted.

It is a convenient time, just as coding capability seems to reach the upper end of the S curve.

? What world are you living on.

Let me ask you, have you noticed that all the major labs are releasing models very similar in gains and performance? How do you explain that other than juicing the max out of the current architecture and processes.

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#55

Perhaps it's getting more difficult to move the 'goal posts'?

- Train LLMs on texts -> OMG AI can write!

- Train LLMs on code -> OMG AI can code!

- Train LLMs on images -> OMG AI can generate images!

- Train LLMs on video -> OMG AI can generate videos!

- Train LLMs on math -> give free access to 100,000 researchers/scientists/mathematicians -> invest resources into Lean -> OMG AI can solve math problems!

I say 'goal posts' because that's a common argument, but the perspective that seems to not be considered is that the LLMs are doing the same thing over and over again in different domains while be fine-tuned by labeling and human review.

The emergent behavior argument is a separate consideration, but I can imagine an AI being given a list of words (a harness) that guides how it operates--not the other way around--and the difficult problem is narrowing down and filtering all the associations with the words/harness to properly align it.

And perhaps the recursive looping being discussed creates incredibly difficult (impossible) to predict behavior? If the AI could modify it's own harness, is that AGI? If we fully understood what happens in high dimensional space, and could predict the output of any combination of input tokens, then is it not AGI?

Or perhaps I just tell myself this to stop worrying about a future involving ASI (:

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#56

Why do you on HN want AI to slow down (mainly OpenAI and Anthropic from what I see in the comments)? What's the driving force behind your opinions on this?

"The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear. No other human activity poses this level of danger." - https://x.com/hilbertspaess/status/2097476196791709843#m

"Development of superhuman machine intelligence (SMI) is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could." - Sam Altman

"If Anyone Builds It, Everyone Dies": https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#58
post #45

Why do you on HN want AI to slow down (mainly OpenAI and Anthropic from what I see in the comments)? What's the driving force behind your opinions on this?

More time to proceed more cautiously in building this entity that will be faster and more effective at steering outcomes in the world than any human or, soon after, the entirety of humans combined.

Do you want the Chinese to stop as well?

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#59

When the Chinese model drops that tops a paused Anthropic and OpenAI in all benchmarks how low will their valuations go?

It remains to be seen whether the Chinese AI labs actually are capable of improving on their own or if they just distilled the US frontier models.

Re: OpenAI considers slowing advanced AI development, Sam Altman tells employees

#60
post #36

Why do you on HN want AI to slow down (mainly OpenAI and Anthropic from what I see in the comments)? What's the driving force behind your opinions on this?

Humans not dying would be an excellent feature for the future to have. Not a hard requirement though, we'll see if there are some story points left in the sprint.

I've got bad news for you on the whole humans dying thing. Seems like actually literally everyone is going to die. Turns out that this has actually been happening for a really long time - possibly since day one - and we've got no idea how to fix it.
Post reply on HN