201–210 of 1001 posts
Earlier quoted context omitted.
The church was a great archive of knowledge for the longest time. They were the powerful few too.
And they hoarded and kept such knowledge for themselves and those who swore fealty for as long as they could, concentrating and maintaining power for centuries. Still, I agree with the pope this once.
The overarching message is that builders should deeply consider the impact of what they're building on civilization. "Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it." Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity." The questions shouldn't just be 'can we buil…
Yes but... No one living today knows what direction AI technology will take humanity. If we have an algorithm breakthrough then we may avoid building new data centers. If the abilities of the technology plateau then there might not be large impacts on employment. Builders need to focus on the impact of their next steps. Don't put polluting natural gas generators in neighborhoods today. Don't make unemploying folks th…
> The Stratos artificial intelligence datacenter footprint will cover more than 40,000 acres (62 sq miles) over three sites in Box Elder county in north-western Utah. The facility will require about 9GW of power, which is more than the entire state of Utah currently consumes
Sure hope your rosy inflection point happens real soon.
Otherwise, the direction this is taking us is pretty obvious.
As an atheist I have an obligation to finish reading it all (still going through, and taking notes, probably having to revisit), but I am not sure how many (christian) believers will feel the same.
Priests will read it and then talk to their congregations about it on Sundays throughout the year, if not explicitly, then in how it shapes their homilies.
Earlier quoted context omitted.
The church was a great archive of knowledge for the longest time. They were the powerful few too.
And they hoarded and kept such knowledge for themselves and those who swore fealty for as long as they could, concentrating and maintaining power for centuries. Still, I agree with the pope this once.
Earlier quoted context omitted.
I would also recommend God and Golem, Inc., A Comment on Certain Points Where Cybernetics Impinges on Religion: https://monoskop.org/images/1/1f/Wiener_Norbert_God_and_Gole... Norbert Weiner was an atheist but he talks about three areas religion is the only thing to have really examined that relate to capable AI: omniscience, omnipotence, and worship (gadget worship). It has very prescient stuff on blackbox learning/…
Awesome, thx for posting. I now have my new next book to read. Been wanting to read more of the original cybernetics stuff. Would you also recommend "The Human Use of Human Beings"?
God & Golem is the most succinct and up to date though, probably a 2hr read.
The book Cybernetics is a lot of math and ergodic theory stuff that went beyond me, but is the longest and you still get a lot out of it skimming over that stuff if you don't have the background for it. The last revision of it in the 50s added some of the same blackbox function copying/imitation learning/distillation stuff, reinforcement learning with reward hacking concerns, and superintelligence as genie/monkey's paw.
I would read the three in reverse order of publication.
He also foresaw another big area of potential existential danger, Wiener filter for guidance and control of missiles (later superceded with Kalman filter bringing the nuclear hard targets era with 15min retaliation windows) and refused to work on it or share prior work, and he also had bioweapons delivery concerns before the bioweapons treaties, publishing this open letter in The Atlantic in 1947:
By then we might not even have computers anymore, or we might have "transparent" computers, i.e. have everything on the cloud and just tell our AI agents what to do.
Sorry Pope Leo, things are not going to suddenly turn into a wonderful utopia, but maybe buy some stocks so you can at least make a buck from what's coming.
[flagged]
Former Catholic. I left the church for a variety of reasons, one of which being the child abuse scandal. I am aware of the Catholic Church's long and often sordid history. What I am trying to say is there is no love lost between me and the Catholic Church. With that out of the way, the Pope is right. Knowledge should be used for the benefit of humanity and I don't think any of the big AI companies have our best inter…
You can still follow a religion while rightfully thinking that the organization representing it to be corrupt (and how could it be otherwise, as it's made from mortal sinners?).
But you either believe that St.Peter and its descendants in Rome have been tasked by god to spread (and interpret) its word or you don't.
It's fine if you don't (I don't my self, I'm an atheist), but I don't get why can't you be a catholic if you believe and also find the organization flawed.
What kind of regulation is Leo the alignment expert proposing exactly? Occam's Razor says this is Anthropic trying to build a regulatory moat by leveraging some halo effect. Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions? Could be a better use of the infallible man's pulpit?
> 12: Today, the human desire for fullness of life is at risk of being misled by deceitful goals, such as the prospect of a technology that promises to free us from all weakness, and models of wellbeing that leave behind entire populations. All too often, we place our hope in unlimited 'upgrades,' in forms of progress that exacerbate inequalities, and in immediate solutions incapable of healing people's wounds.
> 94: The danger of humanity becoming a victim of its own achievements was already clearly recognized by Saint Paul VI, who warned that 'the most extraordinary scientific progress, the most astounding technical feats and the most amazing economic growth, unless accompanied by authentic moral and social progress, will in the long run go against man.' For this reason, technological progress — valuable in itself — requires careful discernment of the anthropological vision that guides it and the ends it pursues. If technological development advances without a corresponding ethical and social progress, the result may be an increase in means without a growth in humanity: 'having more' without 'being more.' In such a scenario, there is a risk that individuals will be evaluated principally according to the outcomes they produce.
> 112: More gravely, the pervasive technocratic paradigm in which we are immersed, and that is amplified by the digital revolution and AI, threatens to normalize an anti-human vision. In that vision, the fullness of life is equated with having more, reducing weakness, eliminating uncertainty and exerting total control. When efficiency becomes the ultimate measure of value, human beings are tempted to see themselves as a project to be optimized rather than as persons called to relationship and communion.
There's much more along these and related lines.