Earlier quoted context omitted.
More than these egregious gag contracts, OpenAI benefits from the image that they are on the cusp of world-destroying science fiction. This meme needs to die, if AGI is possible it won't be achieved any time in the foreseeable future, and certainly it will not emerge from quadratic time brute force on a fraction of text and images scraped from the internet.
Clearly we don’t know when/if AGI would happen, but the expectations of many people working in the field is it will arrive in what qualifies as ‘near future’. It probably won’t result from just scaling LLMs, but then that’s why there’s a lot of researchers trying to find the next significant advancement, in parallel with others trying to commercially exploit LLMs.
OpenAI departures: Why can’t former employees talk?
861–870 of 1001 posts
Re: OpenAI departures: Why can’t former employees talk?
#862Earlier quoted context omitted.
He doesn't seem have much of a filter because of his aspergers, but I think he genuinely believed those things. And they are more on the level of calling people names on the playground anyway. In the grand scheme of things, those are pretty shallow "lies".
I have multiple relatives on the spectrum. None of them baselessly accuse strangers of being pedophiles. It's not Musk's lack of filter that makes him unhinged and dangerous. It's that he's deeply stupid, insecure, racist, enamored of conspiracy theories, and powerful.
Re: OpenAI departures: Why can’t former employees talk?
#863In my experience, and that of others I know, agreements of this kind are generally used to hide/cover-up all kinds of malfeasance. I think that agreements of this kind are highly unethical and should be illegal. Many year ago I signed a NDA/non-disparagement agreement as part of a severance package when I was fired from a startup for political reasons. I didn't want to sign it... but my family needed the money and I…
Re: OpenAI departures: Why can’t former employees talk?
#864In my experience, and that of others I know, agreements of this kind are generally used to hide/cover-up all kinds of malfeasance. I think that agreements of this kind are highly unethical and should be illegal. Many year ago I signed a NDA/non-disparagement agreement as part of a severance package when I was fired from a startup for political reasons. I didn't want to sign it... but my family needed the money and I…
> this is turning into huge power/money grab The power grab happened a while ago (the shenanigans concerning the board) and is now complete. Care for humanity was just marketing or a cute thought at best. Maybe humanity will survive life long enough that a company "caring about humanity" becomes possible, I'm not saying it's not worth trying or aspiring to such ideals, but everyone should be extremely surprised if an…
One could argue it would mean pampering it.
One could also argue it could be a Skynet—analog doing the equivalent of a God Emperor like Golden Path to ensure humanity is never going to be dumb enough to allow an AGI the power to do that again.
Assuming humanity survives the second one, it has a lot higher chance of actually benefiting humanity long term too.
Re: OpenAI departures: Why can’t former employees talk?
#865Earlier quoted context omitted.
More than these egregious gag contracts, OpenAI benefits from the image that they are on the cusp of world-destroying science fiction. This meme needs to die, if AGI is possible it won't be achieved any time in the foreseeable future, and certainly it will not emerge from quadratic time brute force on a fraction of text and images scraped from the internet.
Clearly we don’t know when/if AGI would happen, but the expectations of many people working in the field is it will arrive in what qualifies as ‘near future’. It probably won’t result from just scaling LLMs, but then that’s why there’s a lot of researchers trying to find the next significant advancement, in parallel with others trying to commercially exploit LLMs.
they think this because it serves their interests of attracting an enormous amount of attention and money to an industry that they seek to make millions of dollars personally from.
My money is well on environmental/ climate collapse wiping out most of humanity in the next 50-100 years, hundreds of years before anything like an AGI possibly could.
Re: OpenAI departures: Why can’t former employees talk?
#866In my experience, and that of others I know, agreements of this kind are generally used to hide/cover-up all kinds of malfeasance. I think that agreements of this kind are highly unethical and should be illegal. Many year ago I signed a NDA/non-disparagement agreement as part of a severance package when I was fired from a startup for political reasons. I didn't want to sign it... but my family needed the money and I…
Re: OpenAI departures: Why can’t former employees talk?
#867Earlier quoted context omitted.
> this is turning into huge power/money grab The power grab happened a while ago (the shenanigans concerning the board) and is now complete. Care for humanity was just marketing or a cute thought at best. Maybe humanity will survive life long enough that a company "caring about humanity" becomes possible, I'm not saying it's not worth trying or aspiring to such ideals, but everyone should be extremely surprised if an…
Well, one problem is what does ‘caring for humanity’ even mean, concretely? One could argue it would mean pampering it. One could also argue it could be a Skynet—analog doing the equivalent of a God Emperor like Golden Path to ensure humanity is never going to be dumb enough to allow an AGI the power to do that again. Assuming humanity survives the second one, it has a lot higher chance of actually benefiting humanit…
Re: OpenAI departures: Why can’t former employees talk?
#868For a company that is actively pursuing AGI (and probably the #1 contender to get there), this type of behaviour is extremely concerning. There’s a very real/significant risk that AGI either literally destroys the human race, or makes life much shittier for most humans by making most of us obsolete. These risks are precisely why OpenAI was founded as a very open company with a charter that would firmly put the needs…
More than these egregious gag contracts, OpenAI benefits from the image that they are on the cusp of world-destroying science fiction. This meme needs to die, if AGI is possible it won't be achieved any time in the foreseeable future, and certainly it will not emerge from quadratic time brute force on a fraction of text and images scraped from the internet.
I don’t know if you’re conflating capability with consciousness but frankly it doesn’t matter if the thing knows it’s alive if it still makes everyone obsolete.
Re: OpenAI departures: Why can’t former employees talk?
#869So part of their compensation for working is equity, and when they leave thay have to sign an additional agreement in order to keep their previously earned compensation? How is this legal? Mine as well tell them they have to give all their money back too. What's the consideration for this contract?
The thing is that this is a private company, so there is no public market to provide liquidity. The company can make itself the sole source of liquidity, at its option, by placing sell restrictions on the grants. Toe the line, or you will find you never get to participate in a liquidity event. There's more info on how SpaceX uses a scheme like this[0] to force compliance, and seeing as Musk had a hand in creating bot…
Re: OpenAI departures: Why can’t former employees talk?
#870Extra respect is due to Jan Leike, then: https://x.com/janleike/status/1791498174659715494
Reading that thread it’s really interesting to me. I see how far we’ve come in a short couple of years. But I still can’t grasp how we’ll achieve AGI within any reasonable amount of time. It just seems like we’re missing some really critical… something… Idk. Folks much smarter than I seem worried so maybe I should be too but it just seems like such a long shot.
Nobody defines what they’re trying to do as “useful AI” since that’s a much more weasily target, isn’t it?