Live data from Hacker News

Plagiarized news sites are using Cyrillic characters to avoid detection

hoax-alert.leadstories.com

21–30 of 33 posts

Re: Plagiarized news sites are using Cyrillic characters to avoid detection

#22
post #11

Let me nitpick a bit: these characters are not Russian, they are Cyrillic. There are some Cyrillic characters that are distinctly Russian (i.e. used only in the Russian language), but these characters can't impersonate Latin letters because they are too different from them. https://en.wikipedia.org/wiki/Cyrillic_script

Yeah that bothered me as well. Would you write: "Site uses American characters to publish fake news." ?

you gotta loop the Russians in to drive page views

Re: Plagiarized news sites are using Cyrillic characters to avoid detection

#25
Here is a project that maintains a list of homoglyphs and has some Java and Javascript code for detecting them.

https://github.com/codebox/homoglyph

The list itself in sorted text format, each line a list of similar glyphs:

https://github.com/codebox/homoglyph/blob/master/raw_data/ch...

Re: Plagiarized news sites are using Cyrillic characters to avoid detection

#26

Here is a project that maintains a list of homoglyphs and has some Java and Javascript code for detecting them. https://github.com/codebox/homoglyph The list itself in sorted text format, each line a list of similar glyphs: https://github.com/codebox/homoglyph/blob/master/raw_data/ch...

[deleted]

Re: Plagiarized news sites are using Cyrillic characters to avoid detection

#27

I doubt websites hosted in Eastern Europe care about copyright legal threats. Even if they contact the hosting provider directly I doubt any action will be taken. Eastern Europe has plenty of cheap, shady hosting providers where you can host pretty much anything that you want. Unless the website is making a lot of money, nobody is going to spend significant resources to take those websites down. Let me speculate of w…

I think you're right. Also news stories tend to have a currency. By the time a copyright owner complains, the news is old news. They don't want some automatic process to mark their content as "spammy" and not feature their links or content if someone pushes it.

Re: Plagiarized news sites are using Cyrillic characters to avoid detection

#30
post #9

Earlier quoted context omitted.

A neat trick would be to render the PDF into an image file, and then OCR that image file, and do the detection using the text file generated by the OCR process. Just like VW's defeat device, the cheater would then need to create software that outputs something different when they see they are being rendered not to display, but to an image file...

So, one needs to use a font that OCR finds hard to avoid detection. Would rubbish keming do the trick, you could abide by imposed don't requirements but change kerning/leading?

Presumably if you have the original file, you could reset the formatting to known-readable state before the OCR step.

Edit: You could also just use the text, but red-flag submissions where X% of the words used fall outside of the submitted language.

Post reply on HN