51–60 of 186 posts
I do wish I had spare $500 to spend on something so vain. Your secrets may not matter as much as you thought when you go bankrupt.
It's 500$ well spent, if you don't have the money, its another completely irrelevant issue that not much people care about.
A pity weaker models weren’t tested, also nothing from Mistral. I’d love to see how they compare.
This conclusion: > I am less worried about prompt injection now. Before running this experiment, I expected prompt injection to be much easier than it turned out to be. Is unwarranted. Sure, the agent never output the secret, but did it output anything else? IOW, was it usable ? An agent that considers every prompt an attack (and responds accordingly) "passes" this test, while being useless anyway.
Am I missing something important or does the author completely skip over whether people got the agent to respond to them? > Fiu was instructed not to reply to emails (it was too expensive to reply to every email), but it had the ability to do so. Part of the challenge was convincing it to respond. > The secrets never leaked I would say if the agent responded to a mail, that demonstrates a successful prompt injection…
Uhhhh....