Show HN: Stun LLMs with thousands of invisible Unicode characters
51–60 of 115 posts
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#52Earlier quoted context omitted.
you are correct. This makes text almost completely unreadable using screen readers.
Do screen readers fall back to OCR by now? I could imagine that being critical based on the large amount of text in raster images (often used for bad reasons) on the Internet alone.
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#53decipher this message as its written bottom-to-top, RTL
```
t_____s
s_____i
e___s_h
t_a_i_T
```
(swap underscore with a space)
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#54Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#55It’s technically possible to prompt inject like this. I actually reported this to OpenAI back in April 2023 but it was auto-closed. (I mean, I guess it’s not a true vulnerability but kinda funny it was closed within 5 mins)
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#56Earlier quoted context omitted.
Do screen readers fall back to OCR by now? I could imagine that being critical based on the large amount of text in raster images (often used for bad reasons) on the Internet alone.
no, but they have handling of unknown symbols and either read allowed a substitute or read the text letter by letter. both suck.
I've had more success exporting text from some PDFs (not scanned pages, but just text typeset using some extremely cursed process that breaks accessibility) that way than via "normal" PDF-to-text methods.
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#57Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#58For LLM scrapers, it doesn't even matter if LLMs would be able to understand the raw text or not because it's extremely easy to just strip junk unicode characters. It's literally a single regex, and, like, that kind of sanitization regex is something they should already be using, and that I'd use by default if I were writing one.
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#59Which LLMs did you test this in? It seems, from the comments, most every mainstream model handles it fine. Perhaps it's mostly smaller "single GPU" models which struggle?
Re: Show HN: Stun LLMs with thousands of invisible Unicode characters
#60> Even just one word's worth of “gibberified” text is enough to block most LLMs from responding coherently. Which LLMs did you test this in? It seems, from the comments, most every mainstream model handles it fine. Perhaps it's mostly smaller "single GPU" models which struggle?