Live data from Hacker News

Sam Altman may control our future – can he be trusted?

newyorker.com

551–560 of 1001 posts

Re: Sam Altman may control our future – can he be trusted?

#551
Excellent article, truly well-researched. As someone close to a pathological liar [1], the idea that one could be at the forefront of the creation of an artificial superintelligence confirms all the existential risks of such a piece of technology and how naïve, if not ignorant, the average starry-eyed tech worker and investor is about this whole endeavour. It's easy to believe there is a lot of idealism and wish for a better world, but underneath the greedy drive for money and power is excellently summarized in Greg Brockman's own thoughts: “So what do I really want? [...] Financially what will take me to $1B.”

Literally, the only hope for humanity is that large language models prove to be a dead-end in ASI research.

---

1: “He’s unconstrained by truth,” the board member told us. “He has two traits that are almost never seen in the same person. The first is a strong desire to please people, to be liked in any given interaction. The second is almost a sociopathic lack of concern for the consequences that may come from deceiving someone.” — I guess now I know of two people with these traits.

Re: Sam Altman may control our future – can he be trusted?

#552
I usually use free archived versions to read mainstream journalism pieces. Seeing this convinced me to subscribe. I've always loved The New Yorker, and am happy to support serious longform journalism (and I know that Ronan is one of the best).

However, it's a shame that the only way to subscribe to the print version is to pay $260 upfront for the yearly subscription. Meanwhile the digital version is $1/week ($52 upfront) for one year, or even just $10 for one month.

Re: Sam Altman may control our future – can he be trusted?

#553
post #395

Ronan Farrow here. Andrew Marantz and I spent 18 months on this investigation. Happy to answer questions about the reporting.

From time to time I have been accused of being an apologist for Sam Altman, but I have always tried to assess information based upon what it says instead of whether it matches an existing narrative. You list a number of distortions in your article which show the problem. If you are a good person, bad stories about you may be fake. If you are a bad person, bad stories about you may still be fake. My prima facie view o…

I have experience in dealing with Sam Altman-like behavior. I hope to explain how their tactics unfold.

> I can see people concluding that they have been lied to rather than accept that they had been intellectually beaten.

There are two angles to this: from an individual perspective and from a collective one.

One's interaction with such a manipulator isn't a single shot. There is not a single event that they are “beaten”. First, one gets persuaded --- you might argue that there's nothing wrong with a skillful persuasion. At some point they realize that the reality is not in line with their expectations. They bring the point up to the manipulator and ask for a change, this time in more concrete terms. The manipulator agrees with the change, negotiates compromises, and the relationship continues. After some time the manipulated party realizes that things are not going in the direction they desire. This time they ask for more concrete terms, without accepting any compromises. The manipulator accepts, yet continues to act against the terms. The manipulated party is now angry and directly confronts the manipulator. The manipulator apologizes and tells that none of it was intentional, and asks for another chance. However, at that point, the manipulator has run out of “politically correct” “persuasion tactics”, and tells blatant lies to make the other party behave.

From a collective perspective, even those “politically correct” “persuasion tactics” are discovered to be lies, because what the manipulator told different parties are in direct opposition to each other, i.e., they cannot all be truths.

> Helen Toner suggested that they effectively ambushed Altman because if he had time to respond to allegations he could have provided a reasonable explanation. It did not reflect well on her.

I understand how her behavior may raise a flag for the unsuspecting, but it was exactly the right one. Manipulators prey on the benefit of the doubt. If Toner were to bring Altman's behavior into attention of others, no doubt that Altman would manipulate them successfully.

It's unfortunate that many people are unaware of these tactics and assume the best of intentions, when such assumptions fuel the manipulation that they would better avoid.

Re: Sam Altman may control our future – can he be trusted?

#554

Of course he cannot be trusted. Anyone whose motivation is based on greed is by nature untrustworthy.

Even if your motivation is some utopian vision of the future, you should not be trusted. Utopia is a thought experiment in a philosophy of living taken too far, not something to be reached for earnestly.

Why is it that criticism of people's insatiable greed for wealth and power often gets dismissed with this thought-terminating cliche about utopias?

Desire to live in a society that's less greedy, that rewards compassion and punishes sociopathy is completely valid. We should be pursuing that earnestly because survival of our species depends on it. The people in charge are so drunk on wealth and power that they would rather drive our entire species off a cliff than sacrifice even 10% of their effectively bottomless wealth.

But instead of criticizing our current philosophy that's actively being taken too far and threatens to destroy us, you criticize people who express their frustration with this state of affairs.

Re: Sam Altman may control our future – can he be trusted?

#555
post #70

Earlier quoted context omitted.

Thank you for this, very much appreciate the thoughtful response. The piece captures some of the anxieties within OpenAI right now about their competitive position. This obviously ebbs and flows but of late there has been much focus on Anthropic's relative position. We of course mention the allegations of "circular deals" and concerns about partners taking on debt.

Thank you. Yes, I saw that. The company's always been surrounded by endless talk about insane hype, speculative bubbles, and financial engineering. I wasn't asking so much about that. I was asking more about your informed view on how OpenAI's technology, products, and roadmap are perceived, particularly by customers and partners, in comparison to those of competitors. If you have an opinion about that, everyone here…

at this point even googles ai search results are better than gpt - obv. this is not for full programs but if you know what youre doing and just want a snippet, thats all you need.

Re: Sam Altman may control our future – can he be trusted?

#556
My tendency is to believe that the individuals do not what matter as much, when it comes to the biggest risks. I'm not sure if this is a bias or a theory... but I lean to some sort of "medium is the message" determinism.

>"He acknowledged that the alignment problem remained unsolved, but he redefined it—rather than being a deadly threat, it was an inconvenience, like the algorithms that tempt us to waste time scrolling on Instagram."

Before "don't be evil" was a cliche, I think it was a real guiding principle at Google and they built a world class business that way.

Facebook's rival ad platform didn't have search queries to target ads at. Aggressive utilization of user data was the only way they could build an Adwords-scale business. As they pushed this norm, Google followed.

Doomscroll addiction gets a lot of attention because engineers and journalists have children and parents. There are other risks though. Political stability, for example.

By early 2010s, smartphones were reaching places that had almost no modern media previously. Often powered by FB-exclusive data plans. The Arab spring happened, then ISIS. FB-centric propaganda seemingly played a major role in a major conflict/atrocity in Burma. Coups in Africa powered by social media based propaganda. Worrying political implications in the west. Unhinged uncle syndrome. Etc. Social media risks/implications were more than just "inconvenience."

At no point did we really see tech companies go into mitigation mode. Even CYA was relatively limited. There was no moment of truth. It was business as usual.

So... I think OpenAI's initial charter was naive. Science fiction almost. It was never going to withstand commercial reality, politics, competition and suchlike. I think these are greater than the individuals involved.

That doesn't mean we should ignore, excuse or otherwise tolerate lack of integrity. But, I don't think it is a way of reducing risk.

Whether the risk is skynet, economic turmoil, politics, psych epidemics or whatever... I don't think the personal integrity of executives is a major factor.

Re: Sam Altman may control our future – can he be trusted?

#558
post #30

Earlier quoted context omitted.

Thank you for coming on HN and offering to answer questions.[a] This is a fantastic piece, very timely, evidently well-researched, and also well-written. Judging by the little that I know, it's accurate. Thank you for doing the work and sharing it with the world. OpenAI may be in a more tenuous competitive position than many people realize. Recent anecdotal evidence suggests the company has lost its lead in the AI ra…

Many of us prefer OpenAI's Codex, because we think it's a better product. No comment on the CEO: I just find the product superior in everything but UI/UX and conversation. It's better at quality code.

GPT/claude/gemini is pretty interchangeable at this point.

Re: Sam Altman may control our future – can he be trusted?

#559

Earlier quoted context omitted.

PG said something along the lines of: "There should be no truth that is increasingly unpopular to speak." If you don't believe what I shared is true, address that directly. But seeing my post sitting at 1 point and [flagged] after 2 hours is not OK. Just as DJT can't flag away his issues, you shouldn't be able to do so on HN. One of the things I've loved most about HN is that it was real — grounded in observability,…

I tried to respond to your comment with some personal observations on racist currents in this community, but my comment immediately got flagged. So yeah! This site ain't what it used to be. Best for the good folks to seek community elsewhere, I reckon. I miss the old days as well, but I don't think they're coming back.

If this site ever was anti-racist, that must have been a long time ago. I threw away my old account many years ago only to come back with this one (because it's difficult to completely ignore HN if you work in tech) and the reason I threw that one away was in part the overwhelming reactionary bias in this community.

The "progressives" were at best silent "don't rock the boat" types more inclined to insist on civility than to challange reactionary sentiments while the reactionaries ranged from dog-whistling to outspoken, across the entire range of white supremacism, sexism, homophobia, transphobia, antisemitism, zionism and so on. The only comments that would ever get flagged or downvoted were those that were explicit enough to be seen as "impolite" because they happened to spell out calls for genocide or violence rather than merely gesturing at it with the thinnest veneer of plausible deniability.

Post reply on HN