Live data from Hacker News

Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

anthropic.com

111–117 of 117 posts

Re: Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

#111

Earlier quoted context omitted.

I use open models all the time, but they are anything but "safe". no amount of lab work can prevent someone from finetuning the released model to do unethical stuff (and its really easy to do this https://arxiv.org/abs/2502.17424 )

Being able to finetune is part of 'the gains of AI shared globally', so it's ok.

> the gains of AI shared globally

but does that give the right for people to use their "gains" to take away from those of others? I think its totally fine for smaller models like now, but a mythos-class system probably shouldn't be open weights. At some point systems cant even be used by most people because of the hardware they need.

Re: Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

#114

> AI development is concentrated in a handful of wealthy nations. How can we ensure the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem Kind of ironic given almost every AI lab except the one you started and work for actually done model releases to the public, some more "open" than others, but still something. Look around at what other companies are doing, Qwen/Alibaba…

You have a good point, and it is important to point out. I'm sure Chris would respond that it is due to those incentives he was talking about that affect all AI companies. However, I do wonder what the actual practical benefit of (let's say) older versions of claude having their weights released would be. If we're talking about the people of poorer nations, how are they going to use these? Aside the top 1% of those n…

This is the biggest part that confuses me:

> How can we ensure the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem

Sure, Anthropic might feel like it "isn't worth releasing old stuff for free" or whatever, but to claim that this is an unsolved problem, or there is zero mechanisms available for sharing the usefulness of AI is straight up bullshit, or said by someone who didn't take five minutes to look around themselves to see what others are doing.

> The average person, even in richer nations cannot afford a computer that can run claude sonnet 4 for instance.

Currently this is true, absolutely, since everything Anthropic is doing is closed-source, compared to OpenAI or pretty much lab out there. And who knows what would happen if they actually made Sonnet available to the public, might be there are resource-constrained people out there who could make it run on smaller hardware, we've seen that happen time and time again. Even the smaller models released today were unthinkinkable to have running locally just a year ago, I'm sure there are a lot of nifty people out there that simply don't have access today, and not because of the hardware.

Re: Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

#115

> And what has grown is far more subtle, odd, and beautiful than science fiction prepared us for. They are not the cold, calculating robots we were promised. They are made from us, from our words—and, as the Holy Father observes, they remain in important ways mysterious even to those of us who train them I love how he's framing AI as some new and fascinating form of consciousness... when in fact it is a cold, calcula…

I'll never understand it when people quote a primary source and then summarize it in a way that completely ignores the original quote. Olah's quote (edit - originally misidentified this as Pope Leo's) makes a lot of sense to me. He is saying, accurately, that modern AI (i.e. primarily LLMs) is created as essentially a mashup of our own language, and they are still a bit of a black box (or at least a gray box) to even…

[dead]

Re: Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

#116

Earlier quoted context omitted.

I’m not sure what you mean, there’s a lot of people talking about farming automation and its effects on working farmers.

The poorest of the poor, subsistence farmers are barely producing enough to feed themselves; they trade and barter the little bit they can manage but it is not much and has little impact that goes beyond a tiny village-level radius. Nobody is displacing that because nobody needs to compete with that.

Very commonly governments will displace these poor to build factories or expand large scale farming practices with international development deals. The land gets taken from the poor and they are left with little choice but to work in these new factories often in abusive conditions.

Re: Anthropic Cofounder Chris Olah's Remarks on Pope Leo XIV's "Magnifica Humanitas"

#117

Earlier quoted context omitted.

i don't know if it's intentional lying for hype or if they're just lost in the cult of AI sauce

Yeah I can't figure it out either. It's like watching pure madness unfold in front of you and there's nothing you can do to talk sense. I sometimes wonder if they're suffering from the exact same AI overexposure psychosis we've seen in some vulnerable people all along. They've anthropomorphized (or worse - they've deified) and are now living inside of the story rather than reality. I've never seen anything so bafflin…

If you're willing to go back to the 13th century, Aquinas and the blindness of the mind provide a timeless explanation. They literally cannot see the truth... it's baffling until you realise this and then pity them. They’re in a mini hell of their own making where the LLM is really alive and they’re both awed and terrified of it simultaneously.
Post reply on HN