Live data from Hacker News

Magnifica Humanitas

vatican.va

41–50 of 1001 posts

Re: Magnifica Humanitas

#41
post #23
post #6

Earlier quoted context omitted.

I am immediately reminded of my favourite quote from the Jewish book Pirkei Avot (‘Ethics of the Fathers’): > It is not your duty to finish the work [of perfecting the world], but neither are you at liberty to neglect it. [ https://www.sefaria.org/Pirkei_Avot.2.16?ven=english|Mishnah... ]

I grew up Jewish. I have lost my faith, but that quote is still fundamental to how I see my place in the world.

I'm an atheist but I really like:

>Therefore man was created single in the world to teach that for anybody who destroys a single life it is counted as if he destroyed an entire world, and for anybody who preserves a single life it is counted as if he preserved an entire world.

(Directly from the Mishna in the Talmud Yerushalmi)

Re: Magnifica Humanitas

#42
post #33

Yes, but can the pipe draw a pelican riding a bike?

For a moment I pictured the Jesuits training their own LLM. If Arthur C. Clarke was still alive, we'd read a story like The Star, but with AI as the main plot device.

https://en.wikipedia.org/wiki/The_Star_%28Clarke_short_story...

Re: Magnifica Humanitas

#44

The overarching message is that builders should deeply consider the impact of what they're building on civilization. "Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it." Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity." The questions shouldn't just be 'can we buil…

> Scientists are actually preoccupied with accomplishment. So they are focused on whether they can do something. They never stop to ask if they should do something. From Crichton's book Jurassic Park, which like most of his books is about the perils of technological advancements. They used the quote in the movie, slightly tweaked.

I would replace the word scientists with engineers in that quote. People often conflate the two, but in my experience, scientists tend to be more cautious and there are built in checks and balances in the process (however flawed).

Engineers/technologists tend to have no such guardrails, and are also usually embedded into entirely profit motivated environments, whatever their own values might be.

Re: Magnifica Humanitas

#45

The overarching message is that builders should deeply consider the impact of what they're building on civilization. "Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it." Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity." The questions shouldn't just be 'can we buil…

I would also recommend God and Golem, Inc., A Comment on Certain Points Where Cybernetics Impinges on Religion:

https://monoskop.org/images/1/1f/Wiener_Norbert_God_and_Gole...

Norbert Weiner was an atheist but he talks about three areas religion is the only thing to have really examined that relate to capable AI: omniscience, omnipotence, and worship (gadget worship). It has very prescient stuff on blackbox learning/distillation, reinforcement learning/reward hacking, alignment through human feedback.

His The Human Use of Human beings and Cybernetics are extremely good too and have more of a mash of the themes between Rerum Novarum and Magnifca Humanitas, and more near-term automation.

Re: Magnifica Humanitas

#47
post #38

Earlier quoted context omitted.

Although, it's called Latin America many countries speak variations of spanish and Brazil speak portuguese, just because those languages derived from latin and not because there the people speak it

That was the joke :(

The net is too infused with dumb takes that the joke becomes indistinguishable to reality.

Re: Magnifica Humanitas

#48
for me the most important point in this is about how ai and tech in general concentrates power. if we want to build something good (in a moral sense) we need to put in work and make sure as many people as possible can use it with equal access.

this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.

i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.

as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.

Re: Magnifica Humanitas

#50
post #33

Yes, but can the pipe draw a pelican riding a bike?

For a moment I pictured the Jesuits training their own LLM. If Arthur C. Clarke was still alive, we'd read a story like The Star, but with AI as the main plot device. https://en.wikipedia.org/wiki/The_Star_%28Clarke_short_story...

Ah, an opening to recommend The Sparrow by Mary Doria Russell, about a Jesuit going to space to speak with aliens. It won the Arthur C Clarke Award in 1998. I read it recently and it has stuck with me very strongly!
Post reply on HN