The Rise of 'Vibe Hacking' Is the Next AI Nightmare
1–10 of 56 posts
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#2> victory will belong to the savvy blackhat hacker who uses AI to generate code at scale
This is just it: AI, while providing some efficiency gains for the average user, will become simply too powerful. Imagine a superpower that allows you to move objects with your mind. That could be a very nice thing to have for many to have, because you could probably help people with it. That's the attitude many hacker-types take. The problem is, it allows people to also kill instantly, which means that telekinesis would just be too powerful to juxtapose against our animal instincts.
AI is just too powerful – and if more people took a serious stand against it, it might actually be shut down.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#3> victory will belong to the savvy blackhat hacker who uses AI to generate code at scale This is just it: AI, while providing some efficiency gains for the average user, will become simply too powerful. Imagine a superpower that allows you to move objects with your mind. That could be a very nice thing to have for many to have, because you could probably help people with it. That's the attitude many hacker-types take…
Is it even possible to shut it down?
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#4Software security has been running off large-scale automation for over a decade. LLMs might or might not be a step change in that automation (I'm optimistic but uncertain), but, unlike in conventional software development, the standard arguments about craft and thoughtfulness aren't operative here. If there was an argument to be had, it would have been had around the time Google stood up the mega fuzzing farms.
A fun thing to keep in mind about software security is that it's premised on the existence of a determined and amoral adversary. In the long-long ago, Richard Stallman's host at MIT had no password; anybody could log into it. It was a statement about the ethics of locking down computing resources. That's approximately the position any security practitioner would be taking if they attempted to moralize against LLM-assisted offensive computing.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#5[flagged]
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#6> victory will belong to the savvy blackhat hacker who uses AI to generate code at scale This is just it: AI, while providing some efficiency gains for the average user, will become simply too powerful. Imagine a superpower that allows you to move objects with your mind. That could be a very nice thing to have for many to have, because you could probably help people with it. That's the attitude many hacker-types take…
Is it even possible to shut it down?
Of course it is. If enough people were truly enraged by it, if some leader were to rile up the mob enough, it could be shut down. Revolts have occurred in other parts of the world, and things are getting sufficiently bad that a sizable enough revolt could shut AI down. All we need is a sufficient number of people who are angry enough at AI.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#7Earlier quoted context omitted.
Is it even possible to shut it down?
Of course it is. If enough people were truly enraged by it, if some leader were to rile up the mob enough, it could be shut down. Revolts have occurred in other parts of the world, and things are getting sufficiently bad that a sizable enough revolt could shut AI down. All we need is a sufficient number of people who are angry enough at AI.
Good luck shutting down the LLM running on my MacBook.
The Pandora’s Box is open. It’s over.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#8> victory will belong to the savvy blackhat hacker who uses AI to generate code at scale This is just it: AI, while providing some efficiency gains for the average user, will become simply too powerful. Imagine a superpower that allows you to move objects with your mind. That could be a very nice thing to have for many to have, because you could probably help people with it. That's the attitude many hacker-types take…
Is it even possible to shut it down?
It's just software running on a server...this isn't a Johnny Depp movie [1]. Just flip the power switch on the racks.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#9Software security has been running off large-scale automation for over a decade. LLMs might or might not be a step change in that automation (I'm optimistic but uncertain), but, unlike in conventional software development, the standard arguments about craft and thoughtfulness aren't operative here. If there was an argument to be had, it would have been had around the time Google stood up the mega fuzzing farms. A fun…
Say more about these mega fuzzing farms. I haven't heard anything about this.
Re: The Rise of 'Vibe Hacking' Is the Next AI Nightmare
#10Software security has been running off large-scale automation for over a decade. LLMs might or might not be a step change in that automation (I'm optimistic but uncertain), but, unlike in conventional software development, the standard arguments about craft and thoughtfulness aren't operative here. If there was an argument to be had, it would have been had around the time Google stood up the mega fuzzing farms. A fun…
Say more about these mega fuzzing farms. I haven't heard anything about this.
There are fields, endless fields, where kernel zero days are no longer born. They are grown.