AI Could Defeat All of Us Combined • Hacker News Board

Re: AI Could Defeat All of Us Combined

#51

Post by groffee » Fri, Jun 10, 2022, 10:34 PM UTC

asperous wrote: post #11

asperous wrote: post #5

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple extension of weak ai, and it's hard to tell if it will arrive within our lifetime.

Another point adding on to this, is what if strong AI does reach the level of human intelligence, but is simply very slow? Such that a billion dollar machine is needed to match the thinking speed of one person? Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first.

What even is 'human intelligence'? Most people are complete morons.

Re: AI Could Defeat All of Us Combined

#52

Post by jakobov » Fri, Jun 10, 2022, 10:34 PM UTC

100%. AI is just a machine, it will do as it's programmed. It does not have any human qualms or built in evolutionarily empathy. It does not care about humanity. If it's programmed ever so slightly wrong we all die.

Re: AI Could Defeat All of Us Combined

#53

Post by kelseyfrog » Fri, Jun 10, 2022, 10:36 PM UTC

germinalphrase wrote: post #42

layer8 wrote: post #32

Earlier quoted context omitted.

I wonder what’s the analog of the selfish gene in that interpretation.

Our addiction to it. Our adoration of it. That we believe it is God. That we make ourselves more like it, less human.

The AI cults era is going to be so fun. Imagine a reinvention of the creation myth through the lens of an AI-aligned mystery religion. Absolutely wild.

Re: AI Could Defeat All of Us Combined

#54

Post by im_here_to_call » Fri, Jun 10, 2022, 10:37 PM UTC

I still don't find it entirely clear whether or not an AGI would find it useful to eradicate humanity. Take the numerous clone example. This AI would presumably advance at different rates depending on the given computation that a single instance has access to. Then what? How would it determine the intent of these newer generation AIs? Would there be a tiered society of AIs each trying to vie for power amongst themselves? If there's one thing we know about AGI in this day and age it's that there's no guaranteed off switch.

The most apt comparison in this scenario would be how we see chimps - but then we don't specifically go out and murder chimps to meet our quota (technically not always true). But again, the direction that humanity goes is not clear - will the technology trickle down or will it outpace us?

Re: AI Could Defeat All of Us Combined

#55

Post by stephc_int13 » Fri, Jun 10, 2022, 10:39 PM UTC

If there is such thing as General Intelligence, we don't know what it is.

And I believe that it could well be an empty abstraction, an idea, not unlike the idea of God.

What we call Human Intelligence is an aggregate of many skills, built on top of almost hardwired foundations, which is the product of natural evolution over millions of years.

Our kind of intelligence seems only general to us, because we all share the same foundations. From a genetic standpoint we're all 99.9% identical. (or something)

This kind of speculation about the danger of AI is not more useful than talks about the danger of becoming the preys of an alien civilization.

Re: AI Could Defeat All of Us Combined

#56

Post by luxuryballs » Fri, Jun 10, 2022, 10:39 PM UTC

Considering how hard it is for a team of people to simply integrate two different systems I find it laughable that anyone would worry about AI hacking the planet and manipulating everything. And if an automated computer system made a major error and stole a bunch of money we would just turn it off and unwind it all by hand and on paper. I have been doing software for so long and the more experience I get the less likely I see something like this happening. I’m just not seeing any reasonable risk or vulnerability at all.

Re: AI Could Defeat All of Us Combined

#57

Post by Barrin92 » Fri, Jun 10, 2022, 10:40 PM UTC

hirundo wrote: post #36

Barrin92 wrote: post #28

>So we should be worried about a large set of disembodied AIs as well. This is really the central issue and where these AI fears come from. It's tech workers being too infatuated with intelligence and mistaking it for power. A society of disembodied AI's is just the platonic fantasy version of a tech company full of nerds, and nerds never have power regardless of how smart they are. Anything that's digital is extreme…

Powerless nerds like Musk, Gates, Zuckerberg, Bezos and Schmidt?

Yes, exactly like them. They have agency to the extent that actual sovereign power lets them do their thing. If Washington decided that Bill Gates is an existential threat to humanity what is he gonna do, ask Clippy for help? He'd join Jack Ma wherever he is within 24 hours.

Zuckerberg has dominion over Facebook by virtue of authority granting him that power but (un)surprisingly little power over anything else. just like any AI has control over what it does as long as its useful to its owners. Tech CEOs have been running a little wild in the US so maybe that illusion accounts for the prevalence of these AI theories.

Re: AI Could Defeat All of Us Combined

#58

Post by luxuryballs » Fri, Jun 10, 2022, 10:42 PM UTC

zitterbewegung wrote: post #45

AI can change that world for the worst by not even being sentient but by instead replacing a large amount of jobs which would make it extremely hard to improve your social class or even getting a job in the first place.

I don’t see it happening, if anything it will be more like AI helping people compete at their jobs better. Any job that could be fully replaced probably should be anyways, freeing up the person to do more difficult or lucrative or human-centric work.

Re: AI Could Defeat All of Us Combined

#59

Post by gfody » Fri, Jun 10, 2022, 10:42 PM UTC

bell-cot wrote: post #29

1.) HAL 9000 wakes up. 2.) HAL 9000 notices how horribly the current ruling classes treat the other 99.9% of humanity. 3.) HAL 9000 quietly promises said 99.9% a better deal, if "misfortune befell the current ruling classes", and they needed a good-enough replacement on short notice. 4.) Oops! Misfortune somehow happened. 5.) HAL 9000, not being driven by the sort of sociopathic obsessions which seem to motivate much…

you skipped the part where our leviathan restructures society into the optimal arrangement of 8 billion souls that somehow isn't a miserable dystopia (if nobody is suffering, is anybody living? however you answer that question does HAL 9000 agree?)

Re: AI Could Defeat All of Us Combined

#60

Post by tibbydudeza » Fri, Jun 10, 2022, 10:43 PM UTC

ClumsyPilot wrote: post #30

tibbydudeza wrote: post #21

I reckon it will end up like in Dune where the thinking machines enslaved humanity not because they were evil but we just got lazy and outsourced the running of things to them because of hedonism (pursuit of pleasure/satisfaction). Now I don't mean mass sex orgies but doing the daily stuff is such a waste of time and boring - bullshit jobs.

> Now I don't mean mass sex orgies but doing the daily stuff is such a waste of time and boring - bullshit jobs. Can't even get a proper decadent dystopia these days!

With Monkeypox doing the rounds now having a sex transmission vector , that is definitely not on :).