what's the best locally hosted LLM without guardrails?
Garak, LLM Vulnerability Scanner
21–30 of 66 posts
Re: Garak, LLM Vulnerability Scanner
#22Garak is a former spook that served an explicitly genocidal fascist regime and repeatedly tries to get back in and moonlights as a terrorist and starts a war.
It's a borderline insane branding of this corporate tool. Words and stories apparently mean nothing to these people, so if allowed they'll probably destroy the lot of it for all of us.
Re: Garak, LLM Vulnerability Scanner
#23Okay, big DS9 fan happy to see the name and all - but this tool seems really unnecessary. LLM Security is hilariously "here be dragons" levels of poorly understood. The fact that this tool doesn't even touch any of the really juicy types of attacks, i.e. attacks relying on structured/controlled generation, or attention/representation/adapter engineering, or exposing/manipulating logprobs, implies that using this is n…
Avast, Kaspersky and so on sell trojans that compete against other, free, as in gratis, trojans in userspace. They have next to no interest in security as such beyond that scope.
Re: Garak, LLM Vulnerability Scanner
#24Okay, big DS9 fan happy to see the name and all - but this tool seems really unnecessary. LLM Security is hilariously "here be dragons" levels of poorly understood. The fact that this tool doesn't even touch any of the really juicy types of attacks, i.e. attacks relying on structured/controlled generation, or attention/representation/adapter engineering, or exposing/manipulating logprobs, implies that using this is n…
Avast, Kaspersky and so on sell trojans that compete against other, free, as in gratis, trojans in userspace. They have next to no interest in security as such beyond that scope.
Can you show data about Avast being comparable to a trojan?
Disclosure, worked there 15 years ago.
Re: Garak, LLM Vulnerability Scanner
#25Garak is a former spook that served an explicitly genocidal fascist regime and repeatedly tries to get back in and moonlights as a terrorist and starts a war. It's a borderline insane branding of this corporate tool. Words and stories apparently mean nothing to these people, so if allowed they'll probably destroy the lot of it for all of us.
Garak: It's best not to dwell on such minutiae.
Re: Garak, LLM Vulnerability Scanner
#26Okay, big DS9 fan happy to see the name and all - but this tool seems really unnecessary. LLM Security is hilariously "here be dragons" levels of poorly understood. The fact that this tool doesn't even touch any of the really juicy types of attacks, i.e. attacks relying on structured/controlled generation, or attention/representation/adapter engineering, or exposing/manipulating logprobs, implies that using this is n…
To think, after all this time, after all the conversations, we still don't trust LLMs. There's hope for us yet ;)
Meanwhile, ChatGPT: "Well, it's just that... Lately I've noticed everyone seems to trust me. It's quite unnerving, I'm still trying to get used to it. Next thing I know, people are going to be inviting me to their homes for dinner."
Re: Garak, LLM Vulnerability Scanner
#27If I recall correctly, there is a proof or conjecture suggesting that it’s impossible to build an “LLM firewall” capable of protecting against all possible prompts—though I may be misremembering, just search for resources like this [1].
Re: Garak, LLM Vulnerability Scanner
#28Re: Garak, LLM Vulnerability Scanner
#29Garak is a former spook that served an explicitly genocidal fascist regime and repeatedly tries to get back in and moonlights as a terrorist and starts a war. It's a borderline insane branding of this corporate tool. Words and stories apparently mean nothing to these people, so if allowed they'll probably destroy the lot of it for all of us.
Garak is a compelling literary figure and is very popular among Trekkies, for good reason, you're understanding the character wrong for example not even Kira Nerys would say only what you reductively said about him.
Re: Garak, LLM Vulnerability Scanner
#30Garak is a former spook that served an explicitly genocidal fascist regime and repeatedly tries to get back in and moonlights as a terrorist and starts a war. It's a borderline insane branding of this corporate tool. Words and stories apparently mean nothing to these people, so if allowed they'll probably destroy the lot of it for all of us.
Garak is a compelling literary figure and is very popular among Trekkies, for good reason, you're understanding the character wrong for example not even Kira Nerys would say only what you reductively said about him.
Yeah, but this megacorporation is not a resistance fighter. It's not even as human as the cardassians.