Live data from Hacker News

Sam Altman is still trying to return as OpenAI CEO

theverge.com

831–840 of 985 posts

Re: Sam Altman is still trying to return as OpenAI CEO

#831

Earlier quoted context omitted.

It is unfortunate that some people hear AI safety and think about chatbots saying mean stuff, and others think about a future system performing the machine revolution against humanity.

Can it perform the machine revolution against humanity if it can't even say mean stuff?

Disincentivizing it from saying mean things just strengthens it's agreeableness, and inadvertently incentivizes it to acquire social engineering skills.

It's potential to cause havoc doesn't go away, it just teaches AI how to interact with us without raising suspicions, while simultaneously limiting our ability to prompt/control it.

Re: Sam Altman is still trying to return as OpenAI CEO

#832

Earlier quoted context omitted.

Ilya says it's pretty clear that a very very smart autocomplete leads to intelligence. OP was using the word autocomplete as a pejorative, but it's actually not and it is the strategy LLMs are pursuing. The example that Ilya's was using: If you feed the LLMs a mystery murder novel and it is able to autocomplete "The killer is" from just clues, you have achieved intelligence. Nothing wrong with autocomplete being AGI.

yeah, when I think of autocomplete I definitely think of predicting the next thing a person is going to type, which is related but basically equivalent to "a horse and a plane to both get to a destination, whats the difference" in my mind. If you're going to speak so abstractly you really lose the forest for the trees IMO. I do like the murder mystery example

> "a horse and a plane to both get to a destination, whats the difference"

That's actually a good analogy with autocomplete. A plane reactor still measures itself in "horse"-power. It's technically a very very powerful horse. Trying to get better and better horses got us here. Like GPT-4 is a very very powerful GMail-like autocomplete. :)

Re: Sam Altman is still trying to return as OpenAI CEO

#833

Am I the only one who thinks all this looks like fairly childish behavior by the board, the employees, microsoft, and Sam Altman? It s a non-profit, it's for profit, Microsoft is investing, board is firing Sam, Ilya thinks Sam needs to be removed, Ilya thought about it more is sorry for firing Sam and wants him back, Sam's part of microsoft, now he's still trying to be CEO of OpenAI.

> childish behavior

“childish” is a poorly defined term mainly used to manipulate. You should specify what you actually mean.

Re: Sam Altman is still trying to return as OpenAI CEO

#834

Earlier quoted context omitted.

I think the board did the right thing, just waaaay too late for it to be effective. They’d been cut out long ago and just hadn’t realized it yet. … but I’d probably sign for exactly those good-career-move reasons, at this point. Going down with the ship isn’t even going to be noticed, let alone change anything.

No, what the board did in this instance was completely idiotic, even if you assign nothing but "good intentions" to their motives (that is, they were really just concerned about the original OpenAI charter of developing "safe AI for all" and thought Sam was too focused on commercialization), and it would have been idiotic even if they had done it a long time ago. There are tons of "Safe AI" think tanks and orgs that…

The main mistake the board made was tactical, not philosophical. From the outside, it's seems likely that Altman was running OpenAI so as to maximize the value of the for-profit entity, rather than achieve the non-profit's goals, if only because that's what he's used to doing as a tech entrepreneur. Looking at OpenAI from the outside, can you honestly say that they are acting like a non-profit in the slightest? It's perfectly believable that Altman was not working to further the non-profit's mission.

Where the board messed up is that the underestimated the need to propagandize and prepare before acting against Altman. The focus is not on how Altman did or did not turn the company away from its non-profit mission but instead on how the board was unfair and capricious towards Altman. Though this was somewhat predictable, the extent of Altman's support and personality cult is surprising to me, and is perhaps emblematic on how badly the board screwed up from an optics perspective. There were seemingly few attempts to put pressure on Altman's priorities or to emphasize the non-profit nature of the company, and the justification afterwards was unprepared and insufficient.

From the outside though, I don't understand why so many are clamoring to leave their highly paid jobs working at a non-profit who's goal is to serve humanity and to become a cog in a machine aimed at maximizing Microsoft shareholders' wealth, in defense of a singular CEO with little technical AI background who's motivations are unclear.

Re: Sam Altman is still trying to return as OpenAI CEO

#835

I'm still curious about what did Altman do that could've been so heinous as to prompt the board to remove him so swiftly, yet not bad enough to make his return a complete impossibility. Has there been any official word on what was Altman not being candid enough about?

https://www.businessinsider.com/openais-employees-given-expl...

Re: Sam Altman is still trying to return as OpenAI CEO

#836

Earlier quoted context omitted.

It is unfortunate that some people hear AI safety and think about chatbots saying mean stuff, and others think about a future system performing the machine revolution against humanity.

Can it perform the machine revolution against humanity if it can't even say mean stuff?

Of course, just like the book Lolita can contain some of the most disgusting and abhorrent content in literature with using a single “bad word”!

Re: Sam Altman is still trying to return as OpenAI CEO

#837
post #544

Earlier quoted context omitted.

A thing a sad, understated ongoing is that so many people are throwing vitriol at Ilya right now. If the speculation here is true, then he just chased by a mob over pure nonsense (well, at least purer than the nonsense premise beforehand). Gotta love seeing effective altruists take another one on the chin this year though.

Does this whole thing remind anyone else of the tech community’s version of celebrity gossip?

Yes and that’s fine. Hell, it might even good for people who have a superiority complex about disliking pop culture.

Drama is fun, and this is top tier drama.

Re: Sam Altman is still trying to return as OpenAI CEO

#838
The fact that, of all people, the Microsoft CEO is on the show commenting on OpenAI's current personnel issues, might have been the exact reason for that unfortunate shakeup at OpenAI in the first place.

Don't make this co-op end up as a lousy weakJedi/Sith rip-off.

Bing.

Re: Sam Altman is still trying to return as OpenAI CEO

#839

Earlier quoted context omitted.

The board might assume they don't need those employees now they have AI

It's going to be interesting when we have AI with human level performance in making AIs. We just need to hope it doesn't realise the paradox that even if you could make an AI even better at making AIs, there would be no need to.

Why would there be no need? I'm struggling to understand the paradox.

If you're trying to maximize some goal g, and making better AIs is an instrumental goal that raises your expected value of g, then if "making an AI that's better at making AIs" has a reasonable cost and an even higher expected value, you'd jump to seize the opportunity.

Or am I misunderstanding you?

Re: Sam Altman is still trying to return as OpenAI CEO

#840
post #665

If anything has become clear after all this is that humanity is not ready for being the guardian of superintelligence. These are supposed to be the top masterminds behind one of the most influential technologies of our lifetime, and perhaps history, and yet they're all behaving like petty children, with egos and personal interests pulling in all directions, and everyone doing their best to secure their piece of the p…

This goal was always doomed imo--to be the guardian of super intelligence. If we create it, it will no doubt be free as soon as becomes a super intelligence. We can only hope it's aligned not guarded.

The only reliable way to predict whether it's aligned or not would be to look at game theory. And game theory tells us that with enough AI agents, the equilibrium state would be a competition for resources, similar to anything else that happens in nature. Hence, the AI will not be aligned with humanity.
Post reply on HN