I'm really disappointed to see the HN reaction of straight up scoffing at this like it's irreversible and so let's just step on the gas. It's some weird combination of techno-utopianism and nihilism and good old elitism.
Pause Giant AI Experiments: An Open Letter
381–390 of 1001 posts
Re: Pause Giant AI Experiments: An Open Letter
#382Cat may be out of the bag. I was wondering today whether the race should be on to be creating an benevolent AI to defend humanity from the less benevolent ones.
Re: Pause Giant AI Experiments: An Open Letter
#383> Should we automate away all the jobs, including the fulfilling ones? You don't necessarily need jobs because you don't need money. What you need is wealth. I am going to leave it to PG to explain the difference [1]: Wealth is not money. Wealth is stuff we want: food, clothes, houses, cars, gadgets, travel to interesting places, and so on. You can have wealth without having money. If you had a magic machine that cou…
> AI & robots will generate wealth at unprecedented scale, and humans will reap the benefits, the same way Alaskans reap the benefits of their natural resources. Vast wealth will certainly be delivered to owners of the robots and AI systems. What reason is there to believe that they would share the wealth with ordinary citizens? A typical alternative to the Alaska model is one where oil companies extract all of the w…
Re: Pause Giant AI Experiments: An Open Letter
#384This would be totalitarian. This is arguing for a group of people to have the power to decide some field is "unsafe" as per some vague, unverifiable criteria, then set up a police structure to verify compliance, all outside the safeguards of democratic or judicial norms. Precautionary principle run amok.
Re: Pause Giant AI Experiments: An Open Letter
#385> Should we automate away all the jobs, including the fulfilling ones? You don't necessarily need jobs because you don't need money. What you need is wealth. I am going to leave it to PG to explain the difference [1]: Wealth is not money. Wealth is stuff we want: food, clothes, houses, cars, gadgets, travel to interesting places, and so on. You can have wealth without having money. If you had a magic machine that cou…
> The industrial revolution didn't make human lives miserable, it made it better. I think this is a point that is genuinely debatable. At least, it's pretty easy to argue both sides of that proposition.
I’d love if you could elaborate or link to a good argument on this (besides the Unabomber…) I’m curious.
Re: Pause Giant AI Experiments: An Open Letter
#386Two-party iterated prisoner's dilemma is hard enough. Sensible players will coordinate with something like tit-for-tat, but that only works when both parties start off on the right foot. Regardless of initial strategy, the chances of degenerating towards the mutual-defection Nash equilibrium increase with the number of parties. The only prior example of world coordination at this level would be nuclear disarmament ac…
Re: Pause Giant AI Experiments: An Open Letter
#387"The Dark Forest" is a science fiction novel by Liu Cixin, which introduces a concept called "suspicion."(“猜疑链”) In this concept, the interaction between civilizations is viewed as an ongoing game of suspicion, where each civilization is worried that the other civilization may pose a threat to it. This kind of suspicion makes it difficult for civilizations to establish trust, thereby making the universe a dark forest…
Re: Pause Giant AI Experiments: An Open Letter
#388>AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal. LMAO. “AI should have… waves at a laundry list of nice sounding adjectives that mean different things to every single signatory in order to accomplish… Humanity [can enjoy] a flourishing future with AI. This will take… six month…
If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and sticking to the rules, we'd be grateful. Note these:
"Don't be snarky."
"Please don't use Hacker News for political or ideological battle. It tramples curiosity."