Earlier quoted context omitted.
I can't tell if this is a joke app or seriously some snake oil (like AI detectors). Isn't it trivially easy to just detect these unicode characters and filter them out? This is the sort of thing a junior programmer can probably do during an interview.
>This is the sort of thing a junior programmer can probably do during an interview. How would you do it? , 15 minutes to reply, no google, no stackoverflow.
But just to humor you (since I did make that strong statement), without googling or checking anything, I would start with basic regular expression ranges (^[A-za-z\s\.\-*]) etc and do a find-replace on that until things looked coherent without too much loss of words/text.
But the problem isn't me, is it? It's the AI companies and their crawlers, that can trivially be changed to get around this. At the end of the day, they have access to all the data to know exactly which unicode sequences are used in words, etc.