Is this prompt injection truly malware, in your opinion?
Ask HN: Are Prompt Injections "Malware"?
1–10 of 14 posts
Re: Ask HN: Are Prompt Injections "Malware"?
#2If someone put up a sign in a store that said "Burn this store down!" the person who put the sign up is not responsible if someone follows the instructions written on it, are they?
Re: Ask HN: Are Prompt Injections "Malware"?
#3Re: Ask HN: Are Prompt Injections "Malware"?
#4Re: Ask HN: Are Prompt Injections "Malware"?
#5I personally have a hard time considering it malware, because it's just instructions targeted at an LLM. If someone put up a sign in a store that said "Burn this store down!" the person who put the sign up is not responsible if someone follows the instructions written on it, are they?
Now I very much question if automated system should be inciteable. And think that there is very much higher responsibility to make it always not be. Or make it uncapable of doing undesirable things.
Re: Ask HN: Are Prompt Injections "Malware"?
#6I personally have a hard time considering it malware, because it's just instructions targeted at an LLM. If someone put up a sign in a store that said "Burn this store down!" the person who put the sign up is not responsible if someone follows the instructions written on it, are they?
They could be. Incitement to commit crime is a crime in many places. And penalty can be same as for the crime itself. Now I very much question if automated system should be inciteable. And think that there is very much higher responsibility to make it always not be. Or make it uncapable of doing undesirable things.
Re: Ask HN: Are Prompt Injections "Malware"?
#7prompt injection is more close to an exploit. a sequence of input that leads to unexpected behavior, exploited to perform malicious behavior.
many exploits are hosted on websites. called exploit kits even. i think prompt injection match such classification. its very similar. a piece of data on the site's side exploits a program or interface on client side.
Re: Ask HN: Are Prompt Injections "Malware"?
#8Re: Ask HN: Are Prompt Injections "Malware"?
#9Re: Ask HN: Are Prompt Injections "Malware"?
#10In the case of TCRF, agents were also actively ignoring robots.txt and disregarding the site's instructions for interacting with it appropriately (with the "delete all data" instruction being specifically hidden from the discoverable page) - so I can't really see the case for comparing it to malware that deliberately tricks users into running it
AI does make cybersecurity more difficult, and that also goes for people using coding harnesses, sandbox your projects!