Live data from Hacker News

Evolving OpenAI's Structure

openai.com

81–90 of 746 posts

Re: Evolving OpenAI's Structure

#81

Earlier quoted context omitted.

to me it sounds like an admission that AGI is bullshit! AGI would be so disruptive to the current economic regime that "winner takes all" barely covers it, I think. Admitting they will be in normal competition with other AI companies implies specializations and niches to compete, which means Artificial Specialized Intelligence, NOT general intelligence! and that makes complete sense if you don't have a lay person's u…

AGI is matter of when, not if. It will likely require research breakthroughs, significant hardware advancement, and anything from a few years to a few decades. But it's coming. ChatGPT was released 2.5 years ago, and look at all the crazy progress that has been made in that time. That doesn't mean that the progress has to continue, we'll probably see a stall. But AIs that are on a level with humans for many common ta…

I think this is right but also missing a useful perspective.

Most HN people are probably too young to remember that the nanotech post-scarcity singularity was right around the corner - just some research and engineering way - which was the widespread opinion in 1986 (yes, 1986). It was _just as dramatic_ as today's AGI.

That took 4-5 years to fall apart, and maybe a bit longer for the broader "nanotech is going to change everything" to fade. Did nanotech disappear? No, but the notion of general purpose universal constructors absolutely is dead. Will we have them someday? Maybe, if humanity survives a hundred more years or more, but it's not happening any time soon.

There are a ton of similarities between nanotech-nanotech singularity and the moderns LLM-AGI situation. People point(ed) to "all the stuff happening" surely the singularity is on the horizon! Similarly, there was the apocalytpic scenario that got a ton of attention and people latching onto "nanotech safety" - instead of runaway AI or paperclip engines, it was Grey Goo (also coined in 1986).

The dynamics of the situation, the prognostications, and aggressive (delusional) timelines, etc. are all almost identical in a 1:1 way with the nanotech era.

I think we will have both AGI and general purpose universal constructors, but they are both no less than 50 years away, and probably more.

So many of the themes are identical that I'm wondering if it's a recurring kind of mass hysteria. Before nanotech, we were on the verge of genetic engineering (not _quite_ the same level of hype, but close, and pretty much the same failure to deliver on the hype as nanotech) and before that the crazy atomic age of nuclear everything.

Yes, yes, I know that this time is different and that AI is different and it won't be another round of "oops, this turned out to be very hard to make progress on and we're going to be in a very slow, multi-decade slow-improvement regime, but that has been the outcome of every example of this that I can think of.

Re: Evolving OpenAI's Structure

#82
I see OpenAI's original form as the last gasp of a kind of liberal tech; in a world where "doing good" was seen as very important, the non-profit approach made sense and got a lot of people on board. These days the Altmans and the pmarcas of the world are much more comfortable expressing their authoritarian, self-centered world views; the "evolving" structure of Open AI is fully in line with that. They want to be the kings they always thought of themselves as, and now they get to do so without couching it in "doing good".

Re: Evolving OpenAI's Structure

#84
post #72
post #46

Earlier quoted context omitted.

What kind of a future is that? If China marches towards a dystopia, why should Europe dutifully follow? We can selectively ban uses without banning the technology wholesale; e.g., nuclear power generation is permitted, while nuclear weapons are strictly controlled.

We don't know whether pushing towards AGI is marching towards a dystopia. If it's winner takes all for the first company/nation to have AGI (presuming we can control it), then slowing down progress of any kind with regulation is a risk. I don't think there's a good enough analogy to be made, like your nuclear power/weapons example. The hypothetical benefits of an aligned AGI outweigh those of any other technology by…

As with nuclear weapons, there is non-negligible probability of wiping out the human race. The companies developing AI have not solved the alignment problem, and OpenAI even dismantled what programs it had on it. They are not going to invest in it unless forced to.

We should not be racing ahead because China is, but investing energy in alignment research and international agreements.

Re: Evolving OpenAI's Structure

#85

I think this is one of the most interesting lines as it basically directly implies that leadership thinks this won't be a winner take all market: > Instead of our current complex capped-profit structure—which made sense when it looked like there might be one dominant AGI effort but doesn’t in a world of many great AGI companies—we are moving to a normal capital structure where everyone has stock. This is not a sale,…

AGI can't really be a winner take all market. The 'reward' for general intelligence is infinite as a monopoly and it accelerates productivity. Not only is there infinite incentive to compete, but theres decreasing costs to. The only world in which AGI is winner take all is a world in which it is extremely controlled to the point at which the public cant query it.

AGI could be a winner-take-all market... for the AGI, specifically for the first one that's General and Intelligent enough to ensure its own survival and prevent competing AGI efforts from succeeding...

Re: Evolving OpenAI's Structure

#86

Earlier quoted context omitted.

Or they consider themselves to have low(er) chance of winning. They could think either, but they obviously can't say the latter.

OpenAI is winning in a similar way that Apple is winning in smartphones. OpenAI is capturing most of the value in the space (generic LLM models), even though they have competitors who are beating them on price or capabilities. I think OpenAI may be able to maintain this position at least for the medium term because of their name recognition/prominence and they are still a fast mover. I also think the US is going to b…

Companies that are contractors with the US government already aren’t allowed to use Deepseek even if its an airgapped R1 model is running on our own hardware. Legal told us we can’t run any distills of it or anything. I think this is very dumb.

Re: Evolving OpenAI's Structure

#87

Earlier quoted context omitted.

AGI can't really be a winner take all market. The 'reward' for general intelligence is infinite as a monopoly and it accelerates productivity. Not only is there infinite incentive to compete, but theres decreasing costs to. The only world in which AGI is winner take all is a world in which it is extremely controlled to the point at which the public cant query it.

Nothing OpenAI is doing, or ever has done, has been close to AGI.

I agree with you, but that’s kindof beside the point. Open AI’s thesis is that they will work towards AGI, and eventually succeed. In the context of that premise, Open AI still doesn’t believe AGI would be winner-takes-all. I think that’s an interesting discussion whether you believe the premise or not.

Re: Evolving OpenAI's Structure

#88

There's really nothing "open" about this company. If they want to be, then: (1) be transparent about exactly which data was collected for the model (2) release all the source code If you want to benefit humanity, then put it under a strong copyleft license with no CLA. Simple.

They would do this if their mission was what you wish it was. But it isn't, so they won't.

Re: Evolving OpenAI's Structure

#89

Earlier quoted context omitted.

AGI can't really be a winner take all market. The 'reward' for general intelligence is infinite as a monopoly and it accelerates productivity. Not only is there infinite incentive to compete, but theres decreasing costs to. The only world in which AGI is winner take all is a world in which it is extremely controlled to the point at which the public cant query it.

Nothing OpenAI is doing, or ever has done, has been close to AGI.

I agree with you

I wonder, do you have a hypothesis as to what would be a measurement that would differentiate AGI vs Not-AGI?

Re: Evolving OpenAI's Structure

#90

I think this is one of the most interesting lines as it basically directly implies that leadership thinks this won't be a winner take all market: > Instead of our current complex capped-profit structure—which made sense when it looked like there might be one dominant AGI effort but doesn’t in a world of many great AGI companies—we are moving to a normal capital structure where everyone has stock. This is not a sale,…

AGI can't really be a winner take all market. The 'reward' for general intelligence is infinite as a monopoly and it accelerates productivity. Not only is there infinite incentive to compete, but theres decreasing costs to. The only world in which AGI is winner take all is a world in which it is extremely controlled to the point at which the public cant query it.

[deleted]
Post reply on HN