Meta AI's David Singleton has a thread about their security prompt injection defenses here: https://twitter.com/dps/status/2097404102468899131 > One threat we’re particularly focused on is prompt injection, and we handle it in layers. The model is trained to recognize and resist it. The harness marks anything coming from an untrusted source. Deterministic code checks the result. And an ensemble of classifiers runs wh…
I like that we are talking about prompt injections from you to your personal assistant. Obviously I know what they are for, but still, it's so funny that we've just normalized building software adversarial to the consumers supposedly engaging with the product. "I'm sorry simon, your request for purchasing milk this week doesn't correspond with Zuck's milk positions in the market. I've rescheduled that for next week."
Just to be super clear. If you ask the agent to recommend a soda and buy it for you, and it goes to Reddit, it is going to be exposed to prompt hijacking attempts.