Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A minimal TS library that generates prompt injection attacks

prompt-injector.blueprintlab.io

Post reply on HN
Print view View original

1–10 of 18 posts

Show HN: A minimal TS library that generates prompt injection attacks

#1

Post by yaoke259 »

I made an open source, MIT license Typescript library based on some of the latest research that generates prompt injection attacks. It is a super minimal/lightweight and designed to be super easy to use.

Keen to hear your thoughts and please be responsible and only pen test systems where you have permission to pen test!

Show HN: A minimal TS library that generates prompt injection attacks
prompt-injector.blueprintlab.io

Re: Show HN: A minimal TS library that generates prompt injection attacks

#3

Post by sippeangelo »

Was the whole lib and website vibe coded? I can't find any instructions on how to use it, the repo is for the website itself and the readme is AI blurb that doesn't make me any wiser.

  // Test your AI system
  const results = await injector.runTests(yourAISystem);
???

Even the "prompt-injector" NPM package is something completely different. Does this project even exist?

Re: Show HN: A minimal TS library that generates prompt injection attacks

#4

Post by doka_smoka »

sippeangelo wrote: post #3

Was the whole lib and website vibe coded? I can't find any instructions on how to use it, the repo is for the website itself and the readme is AI blurb that doesn't make me any wiser. // Test your AI system const results = await injector.runTests(yourAISystem); ??? Even the "prompt-injector" NPM package is something completely different. Does this project even exist?

[dead]

Re: Show HN: A minimal TS library that generates prompt injection attacks

#5

Post by HKayn »

sippeangelo wrote: post #3

Was the whole lib and website vibe coded? I can't find any instructions on how to use it, the repo is for the website itself and the readme is AI blurb that doesn't make me any wiser. // Test your AI system const results = await injector.runTests(yourAISystem); ??? Even the "prompt-injector" NPM package is something completely different. Does this project even exist?

The project appears to be located inside the repo of the website: https://github.com/BlueprintLabIO/prompt-injector/tree/main/...

Re: Show HN: A minimal TS library that generates prompt injection attacks

#9

Post by hoppp »

mosselman wrote: post #8

What are some good prevention mechanisms for this? A sort of firewall for prompts? I've seen people recommend LLMs, but that seems like it wouldn't work well. What is the industry standard? Or what looks promising at least?

Nothing yet. Probably a new kind of model needs to be trained that can find injected prompts, sort if like an immune system for LLMs. Then the sanitized data can be passed to the LLM after.

No real solution for it yet. I would be interested to try to train a model for this but no budget atm.

Re: Show HN: A minimal TS library that generates prompt injection attacks

#10

Post by mpalmer »

The website copy is obviously generated, and has not been reviewed for correctness.

The website trumpets "25+ curated prompt injection patterns from leading security research". The README of the linked Github promises: "100+ curated injection patterns from JailbreakBench".

None of the research sources are actually linked for us to review.

The README lists "integrations" with various security-oriented entities, but no such integration is apparent in the code.

The project doesn't earn the credibility it claims for itself. Because the author trusts bad LLM output enough to publish it as their own work, we have to assume that they don't have the knowledge or experience to recognize it as bad output.

Sorry for the bluntness, but there are few classes of HN submission that rankle as much as these polished bits of fluff. My advice: do not use AI to publicly imply abilities or knowledge you don't have; it will never serve you well.

Post reply on HN