Live data from Hacker News

Garak, LLM Vulnerability Scanner

github.com

61–66 of 66 posts

Re: Garak, LLM Vulnerability Scanner

#61
post #54
post #15

Earlier quoted context omitted.

Check the last entry in the FAQ source

Ah, ok, good catch! Makes sense to hide the FAQ entry explaining the origin of the name, seeing that the DS9 Garak character was also "undercover".

There is also a quote by a certain individual named Elim visible, in the clear, near the end of README. I'm guessing that Elim is likely just a simple tailor.

Re: Garak, LLM Vulnerability Scanner

#62
post #48
post #35

Earlier quoted context omitted.

I guess I was a bit direct but I don't fully understand the down vote. I was not implying that the README was bad and it does have corrections that would improve it. My reason for not raising a PR is some repo owners don't care and I really didn't want to go through the effort unless they actually care.

Also, FYI, the majority of "errors" found by your tool are not actually errors.

Yes I agree if the prompt that was used was less strict with regards to verb tense, prepositions and so forth. I wrote this prompt for use for technical writing, which may not fit the style of the author.

Re: Garak, LLM Vulnerability Scanner

#63
post #35

Earlier quoted context omitted.

I guess I was a bit direct but I don't fully understand the down vote. I was not implying that the README was bad and it does have corrections that would improve it. My reason for not raising a PR is some repo owners don't care and I really didn't want to go through the effort unless they actually care.

This is actually pretty cool. Would love to try it!

Expect to be able to try it by the end of this month if I am lucky. It will be a simple one line docker pull command or if you want to install it, use npm.

Re: Garak, LLM Vulnerability Scanner

#64
post #11

Ah, this is an ((LLM vulnerability) scanner) not (LLM (vulnerability scanner)) which I thought would be a terrible idea and couldn't understand why everyone was joking about the lies. I also am not a Trekkie, so I had to look up all the tailor references but the character's philosophy makes sense for the name https://en.wikipedia.org/wiki/Elim_Garak#:~:text=the%20truth...

Any one have a good (LLM (vulnerability scanner) list?

Re: Garak, LLM Vulnerability Scanner

#65

For folks who are curious about what it actually does, check out the garak/data/ subdirectory. For the most part, it just seems to have an array of static prompts, e.g.: https://github.com/NVIDIA/garak/blob/main/garak/data/donotan...

If you want something purely dynamic... https://haizelabs.com/
Post reply on HN