Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

businessinsider.com

Post reply on HN
Print view View original

51–60 of 873 posts

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#51

Post by raverbashing »

lazzlazzlazz wrote: post #35

The way incumbents are attempting to seize power via regulatory capture, using "X-Risk" and fantastical claims of sudden human extinction is maybe one of the most cynical ploys in the history of tech so far. Open source is one of our greatest gifts, and the push to close off AI with farcical licensing and reporting requirements (which will undoubtedly become more strict) is absurd. The laws we have already cover male…

Correct. The risk that's the real ploy is much higher and much more impactful than the actual risk of Rogue AI (as much as the risk might exist, though probably tiny)

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#52

Post by JoshTriplett »

lazzlazzlazz wrote: post #35

The way incumbents are attempting to seize power via regulatory capture, using "X-Risk" and fantastical claims of sudden human extinction is maybe one of the most cynical ploys in the history of tech so far. Open source is one of our greatest gifts, and the push to close off AI with farcical licensing and reporting requirements (which will undoubtedly become more strict) is absurd. The laws we have already cover male…

> seize power via regulatory capture

Not even a little bit. "Stop" is not regulatory capture. Some large AI companies are attempting to twist "stop" into "be careful, as only we can". The actual way to stop the existential risk is to stop. https://twitter.com/ESYudkowsky/status/1719777049576128542

> the push to close off AI with farcical licensing and reporting requirements

"Stop" is not "licensing and reporting requirements", it's stop.

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#53

Post by [deleted] »

PeterStuer wrote: post #48

People focus on LLM's and diffusion models because they are so omnipresent now. But an AI for stock picking and prediction that would be realy next level and outcompete the current ones cosistently would siphon of so much wealth it would basically own society if the operators were clever enough not to get so gready short term that the system would litterally collapse overnight.

[deleted]

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#54

Post by huytersd »

PeterStuer wrote: post #48

People focus on LLM's and diffusion models because they are so omnipresent now. But an AI for stock picking and prediction that would be realy next level and outcompete the current ones cosistently would siphon of so much wealth it would basically own society if the operators were clever enough not to get so gready short term that the system would litterally collapse overnight.

It would have a brief period where it would be effective and then you would just have an AI stock picking arms race, and would be back in the same situation again.

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#55

Post by Joeri »

Geee wrote: post #32

Yeah, it is a true risk. What happens when people start making their voting decisions with AI, asking who to vote? Nothing wrong with that per se, but it gives an ultimate power to the company who developed and hosts the AI, which means the end of democracy. My recommendation for regulation would be to make closed & cloud-hosted AI illegal. Architecture, training data and weights should always be available, and peopl…

Seeing the weights is useless for knowing capabilities, and even knowing training data and architecture you still need to interact with it to figure those out, which you can do with cloud AI just as well.

The real risk that I see is the use of open source AI by governments, corporations and criminal groups to influence elections through a deluge of bots. Cloud AI can at least be controlled to some degree because there is a government that can inspect and regulate that business, but an army of bots built on local LLM’s could just run wild over the internet without stopping them.

How many comments in this thread are written by a bot? I do not feel confident I could tell them apart.

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#56

Post by jdblair »

Geee wrote: post #32

Yeah, it is a true risk. What happens when people start making their voting decisions with AI, asking who to vote? Nothing wrong with that per se, but it gives an ultimate power to the company who developed and hosts the AI, which means the end of democracy. My recommendation for regulation would be to make closed & cloud-hosted AI illegal. Architecture, training data and weights should always be available, and peopl…

Sounds great until someone says the warehouse full of computers out back is their "local machine."

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#57

Post by 123yawaworht456 »

Geee wrote: post #32

Yeah, it is a true risk. What happens when people start making their voting decisions with AI, asking who to vote? Nothing wrong with that per se, but it gives an ultimate power to the company who developed and hosts the AI, which means the end of democracy. My recommendation for regulation would be to make closed & cloud-hosted AI illegal. Architecture, training data and weights should always be available, and peopl…

This is extremely dangerous to our democracy.

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#58

Post by shreyshnaccount »

sgu999 wrote: post #17
penjelly wrote: post #2

some speculators say we'll enter an age of abundance and money wont matter nearly as much (or at all) but if thats the case, how do businesses transition from their current state of profit over everything into money is not important? I see it as much more likely that things become monopolized instead

Abundance for who? Our entire specie could live comfortably with goodies the last roman emperor wouldn't even have dreamed of, just with our current means of production. Yet we still have people not able to feed their children, dying of exhaustion at work or killing each other for land.

You've got the causality the other way round. We are in an apparent state of abundance partly because of exploitative practices

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#59

Post by shreyshnaccount »

shreyshnaccount wrote: post #58
sgu999 wrote: post #17

Earlier quoted context omitted.

Abundance for who? Our entire specie could live comfortably with goodies the last roman emperor wouldn't even have dreamed of, just with our current means of production. Yet we still have people not able to feed their children, dying of exhaustion at work or killing each other for land.

You've got the causality the other way round. We are in an apparent state of abundance partly because of exploitative practices

(shit, not you, the gp)

Re: Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario

#60

Post by blovescoffee »

bsder wrote: post #8

The problem isn't seizing power. The problem is going to be that AI is creating an Eternal September by poisoning the well of training data. Anybody who has a data or a model prior to the poisoning is going to have a defensible moat that is not accessible to those who come after.

Except models can get more data efficient. We can overcome and sort of “poisoning the well.” Man’s desire for power is orders of magnitude more difficult to resolve.
Post reply on HN