121–130 of 436 posts
Earlier quoted context omitted.
Thank you for the feedback! It's my first time posting here, so I didn't really know I should do that. I'll do that now.
Contrary to what 'b-kf said, you should not prefix your own content with "Show HN" unless it fits the Show HN rules: https://news.ycombinator.com/showhn.html
>Comments should be passed to the model with clear role boundaries that prevent them from being interpreted as system-level directives. Well, such clear boundaries would solve lots of problems. But those don’t exist, do they?
Earlier quoted context omitted.
No, it’s really not, it’s none of our jobs to do that. It’s our job to make our employer (even if you are your own employer) money. It’s incredibly rare you have the luxury of even trying to deliver bug free code, let alone achieve it.
People eventually stop using, and paying for, buggy code.
> Attacker leaves the comment on a creator's video. > Creator opens YouTube studio's comment tab. > Creator clicks a suggested AI prompt (Designed by YouTube) > Injection fires, attacker-controlled content appears in the response. It's insane that YouTube doesn't see prompt injection as a bug.
Earlier quoted context omitted.
I feel like things have become so much more cynical in the last 5 years, in this regard. I feel like part of it is the "over-systemization" of promos. I see the logic behind it to some extent - if there's a system, it's "fairer"/"more democratic". But, then we end up with ridiculous gamified promo systems.
objective systems become gamified subjective systems become politicized pick your poison
I recently left Google having worked on a number of projects with various YouTube teams. I think I can explain why it's being handled this way by YouTube. This is a fairly nuanced/involved issue, so the task of classifying the bug likely made it's way to one of the engineers responsible for the implementation of this feature. That engineer has already launched this project, and filed it away under their GRAD (perform…
I feel like things have become so much more cynical in the last 5 years, in this regard. I feel like part of it is the "over-systemization" of promos. I see the logic behind it to some extent - if there's a system, it's "fairer"/"more democratic". But, then we end up with ridiculous gamified promo systems.
Earlier quoted context omitted.
I feel like things have become so much more cynical in the last 5 years, in this regard. I feel like part of it is the "over-systemization" of promos. I see the logic behind it to some extent - if there's a system, it's "fairer"/"more democratic". But, then we end up with ridiculous gamified promo systems.
objective systems become gamified subjective systems become politicized pick your poison
The article suggests a seemingly easy fix: > The fix is pretty straightforward: treat comment content as untrusted data, not as potential instructions. Comments should be passed to the model with clear role boundaries that prevent them from being interpreted as system-level directives. > Any AI feature that ingests user-generated content and acts on it needs to enforce this separation. Otherwise, the AI becomes a vec…
Has anyone tested if this AI Studio model can be manipulated into editing/deleting videos, or showing a link that does so? Maybe that would get their attention.