Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Rise of 'Vibe Hacking' Is the Next AI Nightmare

wired.com

Post reply on HN
Print view View original

11–20 of 56 posts

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#11

Post by blibble »

sgjohnson wrote: post #7
vouaobrasil wrote: post #6

Earlier quoted context omitted.

Of course it is. If enough people were truly enraged by it, if some leader were to rile up the mob enough, it could be shut down. Revolts have occurred in other parts of the world, and things are getting sufficiently bad that a sizable enough revolt could shut AI down. All we need is a sufficient number of people who are angry enough at AI.

Good luck shutting down the LLM running on my MacBook. The Pandora’s Box is open. It’s over.

a software update could easily cripple its ability to run on your local machine

unless you plan to never update again

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#12

Post by hluska »

rglover wrote: post #8
rco8786 wrote: post #3

Earlier quoted context omitted.

Is it even possible to shut it down?

It's just software running on a server...this isn't a Johnny Depp movie [1]. Just flip the power switch on the racks. [1] https://www.youtube.com/watch?v=0jg3mSf561w

Rather, it’s many different types of software running on many different systems around the world, each funded by a different party with its own motives. This is no movie…

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#14

Post by vouaobrasil »

sgjohnson wrote: post #7
vouaobrasil wrote: post #6

Earlier quoted context omitted.

Of course it is. If enough people were truly enraged by it, if some leader were to rile up the mob enough, it could be shut down. Revolts have occurred in other parts of the world, and things are getting sufficiently bad that a sizable enough revolt could shut AI down. All we need is a sufficient number of people who are angry enough at AI.

Good luck shutting down the LLM running on my MacBook. The Pandora’s Box is open. It’s over.

Plenty of past civilizations have thought they were invulnerable. In fact, most entities with power think that they can never be taken down. But countless empires in the past have fallen, and countless powerful people have lost their wealth and power overnight.

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#15

Post by AStonesThrow »

tptacek wrote: post #4

Software security has been running off large-scale automation for over a decade. LLMs might or might not be a step change in that automation (I'm optimistic but uncertain), but, unlike in conventional software development, the standard arguments about craft and thoughtfulness aren't operative here. If there was an argument to be had, it would have been had around the time Google stood up the mega fuzzing farms. A fun…

  rms@gnu.ai.mit.edu
It was actually the A.I. Lab at M.I.T. and they already had their own dedicated subdomain for it. This had to have been around 1990-91. And IIRC, the actual admins made a valiant effort to keep all the shell users away from "root" privileges, so it wasn't a total dumpster fire and the system stayed alive, mostly

https://en.wikipedia.org/wiki/MIT_Computer_Science_and_Artif...

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#16

Post by vouaobrasil »

hluska wrote: post #12
rglover wrote: post #8

Earlier quoted context omitted.

It's just software running on a server...this isn't a Johnny Depp movie [1]. Just flip the power switch on the racks. [1] https://www.youtube.com/watch?v=0jg3mSf561w

Rather, it’s many different types of software running on many different systems around the world, each funded by a different party with its own motives. This is no movie…

True, but the system only exists because it is currently economically viable. A mass taboo against AI would change that. And many people outside of tech already dislike AI a lot, so it's not inconceivable that this dislike could be fuelled into a worldwide taboo.

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#17

Post by Animats »

rglover wrote: post #8
rco8786 wrote: post #3

Earlier quoted context omitted.

Is it even possible to shut it down?

It's just software running on a server...this isn't a Johnny Depp movie [1]. Just flip the power switch on the racks. [1] https://www.youtube.com/watch?v=0jg3mSf561w

"Skynet was software; in cyberspace. There was no system core; it could not be shut down"

Yes. Look at how much trouble we have now with distributed denial of service attacks.

Go re-read "Daemon" and "Freedom™", by Daniel Suarez (2006). That AI is dumber than what we have now.

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#18

Post by vouaobrasil »

Animats wrote: post #17
rglover wrote: post #8

Earlier quoted context omitted.

It's just software running on a server...this isn't a Johnny Depp movie [1]. Just flip the power switch on the racks. [1] https://www.youtube.com/watch?v=0jg3mSf561w

"Skynet was software; in cyberspace. There was no system core; it could not be shut down" Yes. Look at how much trouble we have now with distributed denial of service attacks. Go re-read "Daemon" and "Freedom™", by Daniel Suarez (2006). That AI is dumber than what we have now.

On the other hand, if those fighting Skynet were asked to trade Skynet for the AI we have now, they would take it as their new enemy in a heartbeat.

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#19

Post by navanchauhan »

bradyriddle wrote: post #9
tptacek wrote: post #4

Software security has been running off large-scale automation for over a decade. LLMs might or might not be a step change in that automation (I'm optimistic but uncertain), but, unlike in conventional software development, the standard arguments about craft and thoughtfulness aren't operative here. If there was an argument to be had, it would have been had around the time Google stood up the mega fuzzing farms. A fun…

Say more about these mega fuzzing farms. I haven't heard anything about this.

Something like https://security.googleblog.com/2011/08/fuzzing-at-scale.htm... ?

Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare

#20

Post by diggan »

blibble wrote: post #11
sgjohnson wrote: post #7

Earlier quoted context omitted.

Good luck shutting down the LLM running on my MacBook. The Pandora’s Box is open. It’s over.

a software update could easily cripple its ability to run on your local machine unless you plan to never update again

> a software update could easily cripple its ability to run on your local machine

A software update collaborated on by Microsoft, Apple + countless of volunteer groups managing various other distributions?

The cat really is out of the bag. You could probably make it a death penalty in the whole world and some people would still use it secretly.

Once things like this run on consumer hardware, I think it's already too late to pull it down fully. You could regulate it though and probably have a better chance of limiting the damages, not sure an outright ban could even have the effect you want with a ban.

Post reply on HN