Live data from Hacker News

For AI leaders Doom is a form of hype

erkansaka.net

171–179 of 179 posts

Re: For AI leaders Doom is a form of hype

#171

Earlier quoted context omitted.

Explain a path from today to the extermination of humanity in 2028 by the ASI and von Neumann replicators heading to the stars in the early 2030s without resorting to magical thinking or underpants gnomes level business plans. Engineering details are what matters here, not wishy washy things you once saw on Star Trek or The Outer Limits. Go.

Have you ever lived through a power outage longer than 48 hours? Did you see what it did to people in your neighborhood? That’s the path.

Does a 3 month lockdown count? https://www.bbc.com/news/world-asia-china-61023811

Re: For AI leaders Doom is a form of hype

#173

Earlier quoted context omitted.

2. Astra just came out and Fable 5/5.1 too. These are SIGNIFICANT better in plenty of tasks than Opus in November. Try it out. Ask Opus 4.8 to do anything in 3d. Do the same with Fable or Astra. Just because you list up some type of random technology, doesn't make it an good argument. Metaverse, Hyperloop and the crypto stuff was clearly garbage from the beginning. Easy to dismiss because all of it had massive faults…

> Just because you list up some type of random technology, doesn't make it an good argument. In what way is this random? It's a chronology of the bullshit from the past few years. Also: easy to say in hindsight. The hype was there, and many people believed it. The press, in particular, just lapped up the claims the way a Labrador Retriever gobbles up whatever you put in front of it. > We have opened up a potential pa…

I never followed these hypes and it was very clear very fast that this stuff was bullshit.

Did I see that I could get rich with bitcoins investing until 100k and selling everything? For sure not. But i already saw basic flaws of crypto when it came out.

Hyperloop? I cried out very early on how dangeriuos this is and how stupid and that no one wants to ride in a small tube without proper precautions (i was wrong here, some poeple really use that las vegas tube).

But lets be clear about LLM: The first thing which motivated me to really look into this was a random YouTube video of someone talking/writing to GPT-3 and ask it to simulate being a mysql server. And it simulated this flawless. A table creation statement, 3 inserts and a working select statement.

That showed me something: The chance that someone trained that 'thing' to be able to simulate a random mysql server was very low. I then tried it and the first thing not happened: I wasn't able to find the flaw. You know when Google IO or Apple Keynotes are happening and you get your hands on any demo and you live in a differen country or speak a different language or you are just not in San Francisco were most demos were maid for, it breaks fast. GPT-3 didn't break fast. I was able to interleave english with german words, no issue.

And i wasn't following LLMs before, i was following progress in machine learning and machine learning started to get more and more traction.

I can now prompt a tremendes amount of generic things to a neural network and it responds very convincing.

I have never seen technology advancing that fast and its quite clear what we have to still build around this new technology. We are not even were we will be and its obviouse.

Only when we build all the stuff (ai layer, ai platforms, ai chips, language and skill specific models, ...) and then starting to see any plateu we can stop keeping an eye on it.

And while we do that, everything just got a little bit better again and another interseting new thing was discoveed about LLMs, AI, AGI etc.

Right now we are in the middle of a reinforcement learning phase which will bring even more.

These 'no consciousness' thing already took jobs from people. I was planing to pay an blender artist money on fiverr for a project, since Opus 5.0 it was just able to do this for me without fiverr.

I don't think these unscrupulous guys are wrong. I'm following this area for a decade and we might have hit an inflection point: We have the compute, apparently we have the money as a society to build this massive amout of compute, we have also everything digital. It doesn't matter what it is, everything we have is digital. Every training material, every best practice tips and tricks everythign is digital.

You can be as dismissive about all of this as you want, but when the economy of a whole planet invest the most money it ever had into one area of research, you should try to keep an eye of where this is going.

And these random technologies? Random people invested in these for different reasons for sure, but the investment into AI is a lot broader with a lot more money behind it. The richest companies on the planet with the smartest people on the planet are doing one thing: Investing in AI.

Re: For AI leaders Doom is a form of hype

#174
post #141

Earlier quoted context omitted.

Then why do you care so much to repeatedly post in this thread? If they are no danger and will never do anything, just let them get banned, or don't. If you are correct (which you are not) then they won't affect your world in any way.

I am an American taxpayer. The money to pay the regulators that Dario wants to permanently hire will come out of my paycheck and will take from me time I could spend interacting with family, traveling, or pursuing hobbies. Dario and others demanding this can get bent.

If you are an american taxpayer, you should be happy. The AI investment from all these companies are good for you as a taxpayer.

You do understand that the USA would be in a recession without AI right? And that these billions of invest are driipling down into your economy right?

Re: For AI leaders Doom is a form of hype

#175

Earlier quoted context omitted.

Thats the problem with doom. What might not affect you, might affect millions across the ocean. A society no longer creating bullshit jobs because there is no reason for it anymore. You have some AI. Right now a whole industry is transforming (again) but now filling the automation gap we were unable to do because of a shortage of labor or expertise. Our society already has peak employmet reached, now AI takes away al…

Actually, some sorts do assert humanity will be wiped off the planet by AI. I don't share that view either. I think it's ludicrous. We've lived through much worse without any sort of technology beyond fire and a big stick. But the end of scarcity and disease is a fantastic thing if it happens. If our lizard brains do not bridge that transition and instead attempt to maintain the billionaire status quo, I agree, we're…

> We've lived through much worse without any sort of technology beyond fire and a big stick.

Lack of technology alone will not wipe out the entirety of humanity, I agree. But we're not talking about just a lack of something. We're rapidly sprinting to give the fewest people the most power over the planet ever. I think it's likely to happen in the 21st century. What happens when the worst case scenario isn't just being left with nothing, but facing an entity that is so rich and powerful that it can use active measures to kill as many as possible? This is more power than any warlord or emperor could've dreamed of in the past.

> But as much as I think people like Elon Musk and Mark Zuckerberg are unhinged lunatics, I also think they're smart enough to keep people fed and entertained for pennies on their accumulating dollars.

So far, every time the billionaire class has been asked about how much money should go to them in society, their answer has always been a resounding "ALL OF IT". You don't get to that level of wealth while retaining a state of mind that allows you to toss a penny to the beggar. Reality is what's holding them back right now, but what would happen if their dreams of total automation eventually come true? How long from then until one of them snaps and decides to use state of the art automated military technology and weapons of mass destruction to wage war against the peasants (armed with sticks and stones) to solve the 'problem' once and for all?

To be clear, I'm not saying any of this is imminent or remotely likely to happen soon. But our society is moving in a direction where something like this could eventually be possible. Giving a human truly absolute power over the entire world has never been tried before.

Re: For AI leaders Doom is a form of hype

#176
I think their trying to make the public believe they're cautious individuals who intend on helping humanity advance, with their recent calls for a slow down on AI development. This way people will be more amenable and willing to use their LLMs, perhaps Dario and Altman do care for humanity and are definitely not trying to just make profit and I am reaching.

Re: For AI leaders Doom is a form of hype

#177

Earlier quoted context omitted.

https://archive.ph/BzBjZ Read the article. The things the Chinese officials are worried about are: * Fake videos / disinformation * Cyberattacks on critical infrastructure * Data leaks * Advances in military sensing / targeting technology These concerns have little in common with the Yudkowskian / apocalyptic doom marketing the US hyperscalers are pushing now. The Times even says this explicitly in the second paragra…

Read the article. I did, thanks. I don't need you to tell me to do that. The common thread is that they both see AI as a threat. It's a different threat to each side, but still a threat. Just because they see different threats from AI doesn't mean that AI isn't a threat. If one person wants to paint the house red and another person wants to paint the house blue doesn't mean the house doesn't need to be painted.

Thinking AI is an existential threat to humanity because it will take over the world and thinking AI is a non-existential threat because it makes disinformation and hacking easier are not even remotely the same thing.

It's about as much of a common thread as comparing Shohei Ohtani to a loan-shark's enforcer because they both swing bats at things.

Re: For AI leaders Doom is a form of hype

#178

Earlier quoted context omitted.

I am an American taxpayer. The money to pay the regulators that Dario wants to permanently hire will come out of my paycheck and will take from me time I could spend interacting with family, traveling, or pursuing hobbies. Dario and others demanding this can get bent.

If you are an american taxpayer, you should be happy. The AI investment from all these companies are good for you as a taxpayer. You do understand that the USA would be in a recession without AI right? And that these billions of invest are driipling down into your economy right?

I am happy. AI is great. I use it. I'm glad that the U.S. is building datacenters. I work for a company involved in siting and building datacenters. But AI is not as scary or dangerous as Dario claims.

Re: For AI leaders Doom is a form of hype

#179

Earlier quoted context omitted.

Just to focus on one part of your comment: does a program that can reliably beat you or I or Magnus Carlsen at chess have an intention to win chess games?

its optimizing the best moves that increases win prob thats it

and what happens when an AI or a coalition of AIs starts optimizing reality?
Post reply on HN