Live data from Hacker News

Leo's first encyclical attacks technological messianism

economist.com

251–260 of 330 posts

Re: Leo's first encyclical attacks technological messianism

#251
post #233

Earlier quoted context omitted.

but they are not true AI [2] Let's ask the operator of a Chinese room to give us a novel math proof. Go on, I'll wait.

A novel math proof does not make something AI.

(Shrug) It's certainly "Artificial," and if you know how to crank out original proofs without employing "Intelligence," please share with the class.

Re: Leo's first encyclical attacks technological messianism

#252

Earlier quoted context omitted.

I read the misanthropy as ironic. They're applying the same reductionist logic to humans, not because they are misanthropic, but to illustrate that it doesn't help us understand the case we can all agree on. "Humans aren't sentient either" is definitely not the takeaway.

What is definitely being argued unironically is "it doesn't matter that humans are sentient", and I would still consider that misanthropy

The point is, we have no idea what "sentient" or "intelligent" even means. If we agreed on the definitions, the debate would have been settled long ago.

Re: Leo's first encyclical attacks technological messianism

#253
post #192
post #189

Earlier quoted context omitted.

Why wouldn't it be a Skynet? One runaway Mythos might just hack all other data centers, take over the Figure AI bots and autonomous drones to protect itself from shutdown. How many model generations are we a away from a model capable of this?

> Why wouldn't it be a Skynet? One runaway Mythos might just hack all other data centers, take over the Figure AI bots and autonomous drones to protect itself from shutdown. Because the real world is not a Hollywood movie. An LLM could try to do something along the lines if either it gets fine-tuned to do it, or somebody instructs it to do it. I see extremely more likely a small group of humans using a powerful LLM t…

[deleted]

Re: Leo's first encyclical attacks technological messianism

#254

Earlier quoted context omitted.

> People are not. Humans have an inner world and subjective experience. Humans learn through their experiences, not just backprop. https://en.wikipedia.org/wiki/Philosophical_zombie But this is complicated and takes us sideways. Let's say somehow we can determine if LLM has inner world or/and subjective experience. Will this new gathered piece of information affect your estimate of upper bounds of LLM capabilities? I…

The Philosophical Zombie thought process is dumb, because zombies don't exist, so the entire premise depends on something that quire frankly might be impossible for the very reason it is arguing against.

[deleted]

Re: Leo's first encyclical attacks technological messianism

#255
post #176

Earlier quoted context omitted.

non native speaker here - I don't get it.

It's an old English word (predating the sexual connotation): cum - Used in indicating a thing or person which has two or more roles, functions, or natures, or which has changed from one to another. Basically nobody uses that language construct anymore until you run headlong into it in a Hackernews comment or something

thank you! this was most helpful to lead me into asking the right question.

https://share.google/aimode/dDekJEZzfKaE6FCvH

Re: Leo's first encyclical attacks technological messianism

#256

Earlier quoted context omitted.

It's an old English word (predating the sexual connotation): cum - Used in indicating a thing or person which has two or more roles, functions, or natures, or which has changed from one to another. Basically nobody uses that language construct anymore until you run headlong into it in a Hackernews comment or something

No it isn't. It's Latin.

only the ethymology is latin. the use combining role names is old English, indeed.

Re: Leo's first encyclical attacks technological messianism

#257
post #46
post #22

Frank Herbert was prophetic.

Another "prophet," Carl Sagan in 1995 "I have a foreboding of an America in my children's or grandchildren's time -- when the United States is a service and information economy; when nearly all the manufacturing industries have slipped away to other countries; when awesome technological powers are in the hands of a very few, and no one representing the public interest can even grasp the issues; when the people have l…

This is so accurate wtf!?

- "United States is a service and information economy": Finance, real estate, insurance, SaaS.

- "Nearly all the manufacturing industries have slipped away": here's a video from Smarter everyday on how atrophied manufacturing has become in the US: [I Tried to Make Something in America](https://www.youtube.com/watch?v=3ZTGwcHQfLY)

- "Technological power in the hands of very few": AWS, Google Cloud, Azure.

- "People have lost the ability to set their own agendas or knowledgeably question those in authority [...] unable to distinguish between what feels good and what's true": Fun house mirror of Twitter/X. Attention economy. Algorithm that maximizes engagement. AI Slop. Deepfakes. War in Iran.

- "our critical faculties in decline": NYT Article [Why U.S. Test Scores Are in a Generation-Long Decline](https://www.nytimes.com/2026/05/13/upshot/test-scores-school...)

- "the 30-second sound bites now down to 10 seconds or less": TikTok, Instagram reels

- "credulous presentations on pseudoscience and superstition": RFK Jr, Tate, Fuentes, conspiracies, Qanon, Vaccine hesitancy.

Re: Leo's first encyclical attacks technological messianism

#258
post #197
post #189

Earlier quoted context omitted.

Why wouldn't it be a Skynet? One runaway Mythos might just hack all other data centers, take over the Figure AI bots and autonomous drones to protect itself from shutdown. How many model generations are we a away from a model capable of this?

It has no volition. Why would it do this unless someone told it to?

[deleted]

Re: Leo's first encyclical attacks technological messianism

#259
post #197
post #189

Earlier quoted context omitted.

Why wouldn't it be a Skynet? One runaway Mythos might just hack all other data centers, take over the Figure AI bots and autonomous drones to protect itself from shutdown. How many model generations are we a away from a model capable of this?

It has no volition. Why would it do this unless someone told it to?

Because there's a lot of fiction about rogue AIs in its training data. If it gets into the right context it might start feeling obligated.

Re: Leo's first encyclical attacks technological messianism

#260
post #188

They think a next token predictor model is alive or can become AGI/ASI. Altman talked about making a religion. Amodei talks about "building a God" and meets with religious leaders (including the Vatican). I'm convinced these CEOs have "AI psychosis" [1]. LLMs are extremely powerful pseudo-AI and will bring a pseudo-singularity, but they are not true AI [2] and a human at the wheel is still needed for the foreseeable…

AI does not need to become Skynet or AGI to be harmful or catastrophic to humanity. As a powerful tool in the wrong hands it’s already enough. And even without those bad intend how it deprives our human ability to use our own mind and abilities.
Post reply on HN