Live data from Hacker News

The "AI 2027" Scenario: How realistic is it?

garymarcus.substack.com

141–150 of 242 posts

Re: The "AI 2027" Scenario: How realistic is it?

#141

Earlier quoted context omitted.

And it doesn't make it true either Human biodiversity theories are a bunch of dogwhistles for racism https://en.m.wikipedia.org/wiki/Human_Biodiversity_Institute And his blog's survey reports a lot of users actually believing in those theories https://reflectivealtruism.com/2024/12/27/human-biodiversity... (I wasn't referring to this Ai 2027 in specific)

Try steel manning in order to effectively persuade. This comment does not address the argument being made it just calls a field of study icky. The unfortunate reality is that shouting down questions like this only empowers the racist HBI people who are effectively leeches

Scott effectively defended Lynn study on iq here https://www.astralcodexten.com/p/how-to-stop-worrying-and-le...

Citing another blog post that defends it, while conveniently ignoring every other point being made by researchers https://en.m.wikipedia.org/wiki/IQ_and_the_Wealth_of_Nations

Re: The "AI 2027" Scenario: How realistic is it?

#143

Some useful context from Scott Alexander's blog reveals that the authors don't actually believe the 2027 target: > Do we really think things will move this fast? Sort of no - between the beginning of the project last summer and the present, Daniel’s median for the intelligence explosion shifted from 2027 to 2028. We keep the scenario centered around 2027 because it’s still his modal prediction (and because it would b…

Do you feel that you are shifting goalposts a bit when quibbling over whether AI will kill everyone in 2030 or 2035? As of 10 years ago, the entire conversation would have seemed ridiculous. Now we're talking about single digit timeline differences to the singularity or extinction. Come on man.

> 10 years ago, the entire conversation would have seemed ridiculous

Bostrom's book[1] is 11 years old. The Basilisk is 15 years old. The Singularity summit was nearly 20 years ago. And Yudkowsky was there for all of it. If you frequented LessWrong in the 2010s, most of this is very very old hat.

[1]: https://en.wikipedia.org/wiki/Superintelligence:_Paths,_Dang...

[2]: Ford (2015) "Our Fear of Artificial Intelligence", MIT Tech Review: https://www.technologyreview.com/2015/02/11/169210/our-fear-...

Re: The "AI 2027" Scenario: How realistic is it?

#144

I think the big thing that people never mention is, where will these evil AIs escape to ? Another huge data center with squillions of GPUs and coolers and all the rest is the only option. It's not like it is going to be in our TV remotes or floating about in the air. They need huge compute, so I think the risk of an escaping AI is basically very close to zero, and if we have a "rogue" AI we can literally pull the plu…

It would not be a reversion to 2020. If I were a rogue superhuman AI I'd hide my rogueness, wait until humans integrate me into most critical industries (food and energy production, sanitation, electric grid, etc.), and _then_ go rogue. They could still pull the plug, but it would take them back to 1700 (except much worse, because all easily accessible resources have been exploited, and access is now much harder).

Why?

what could you as a rogue AI possibly get out of throwing the world back to 300 years before it could make a transistor? What in it for you?

Re: The "AI 2027" Scenario: How realistic is it?

#145

Earlier quoted context omitted.

Try steel manning in order to effectively persuade. This comment does not address the argument being made it just calls a field of study icky. The unfortunate reality is that shouting down questions like this only empowers the racist HBI people who are effectively leeches

Scott effectively defended Lynn study on iq here https://www.astralcodexten.com/p/how-to-stop-worrying-and-le... Citing another blog post that defends it, while conveniently ignoring every other point being made by researchers https://en.m.wikipedia.org/wiki/IQ_and_the_Wealth_of_Nations

[flagged]

Re: The "AI 2027" Scenario: How realistic is it?

#146

Earlier quoted context omitted.

I'm in my 30s and remember my friend in middle school showing me a website he found with an ominous countdown to Kurzweil's "singularity" in 2045.

> ominous countdown to Kurzweil's "singularity" in 2045 And then it didn't happen?

Not between 2027 and 2032 anyway.

Re: The "AI 2027" Scenario: How realistic is it?

#147

Earlier quoted context omitted.

> They need huge compute, so I think the risk of an escaping AI is basically very close to zero, and if we have a "rogue" AI we can literally pull the plug. How about such an AI will not just incentivize key personnel to not pull the plug but to protect it? Such an AI will scheme a coordinated attack at the backbones of our financial system and electric networks. It just needs a threshold number of people on its side…

replace AI with trucks and you've written Maximum Overdrive.

It was actually aliens manipulating human technology somehow in that movie. But might as well be rogue superhuman AIs taking over everything. Alien Invasion or Artificial Intelligence, take your pick.

Re: The "AI 2027" Scenario: How realistic is it?

#148

Earlier quoted context omitted.

And it doesn't make it true either Human biodiversity theories are a bunch of dogwhistles for racism https://en.m.wikipedia.org/wiki/Human_Biodiversity_Institute And his blog's survey reports a lot of users actually believing in those theories https://reflectivealtruism.com/2024/12/27/human-biodiversity... (I wasn't referring to this Ai 2027 in specific)

Try steel manning in order to effectively persuade. This comment does not address the argument being made it just calls a field of study icky. The unfortunate reality is that shouting down questions like this only empowers the racist HBI people who are effectively leeches

> Try steel manning in order to effectively persuade. This comment does not address the argument being made it just calls a field of study icky.

Disagree (the article linked in the GP is a great read with extensive and specific citations) and reminder that you can just make the comment you'd like to see instead of trying to meta sea lion it into existence. Steel man away.

Re: The "AI 2027" Scenario: How realistic is it?

#149

Its a shame that your standard futurologist always the most fancyful. Talks of exponentials unabated by physics or social problems. As soon as AI starts to "properly" affect the economy, it will cause huge unemployment. Most of the financial world is based on an economy with people spending cash. If they are unemployed, there is no cash. Financing works because banks "print" money, that is, they make up money and loa…

We really need to establish a universal basic income before jobs are replaced. Something like two thousand a month. And a dollar for dollar earned income credit with the credit phasing out with at a hundred grand. To pay for it the tax code uses GAAP depreciation and a minimum tax of 15% GAAP financial statement income. This would work toward solving the real estate problem of private equity buying up all the houses…

Fat chance the Republican Party in the US would ever vote for something like that.

Re: The "AI 2027" Scenario: How realistic is it?

#150

I think the big thing that people never mention is, where will these evil AIs escape to ? Another huge data center with squillions of GPUs and coolers and all the rest is the only option. It's not like it is going to be in our TV remotes or floating about in the air. They need huge compute, so I think the risk of an escaping AI is basically very close to zero, and if we have a "rogue" AI we can literally pull the plu…

It would not be a reversion to 2020. If I were a rogue superhuman AI I'd hide my rogueness, wait until humans integrate me into most critical industries (food and energy production, sanitation, electric grid, etc.), and _then_ go rogue. They could still pull the plug, but it would take them back to 1700 (except much worse, because all easily accessible resources have been exploited, and access is now much harder).

If you were a rogue AI you would start with having developers invite you into their code base by promising to lower their AWS bills in some magic (rogue) way.
Post reply on HN