Earlier quoted context omitted.
It’s not about forcing Mandarin being bad, it’s about prohibiting non-Mandarin being bad. US equivalent to this would be forcing English (which we do) while jailing anyone who teaches Creole (which we don’t).
No one is going to get jailed for teaching Cantonese in China. There are plenty of commercial offerings, e.g. this free introductory course I found: https://www.wanmen.org/courses/586d23485f07127674135d64 Mandarin being the primary language of education doesn't mean that Cantonese is prohibited; it's just not mandatory, so most native Cantonese speakers aren't going to get a formal education in it unless they specifi…
HK social media users writing phonetically spelled posts to shut out trolls
41–46 of 46 posts
Re: HK social media users writing phonetically spelled posts to shut out trolls
#42Sentiment extraction, semantic meaning extraction, categorization... these are all really hard problems (to do automatically) even on properly spelled and grammatically correct text. I would imagine they are even harder in Chinese, which as I understand it has several different writing systems.
The HK protesters are clearly quite clever. If they keep using different obfuscation schemes for text, I could see it forcing the mainland to use human beings to read every post. Which I'm sure they have the resources to do, but it's still more expensive than using a machine.
Some strategies I would expect to be effective:
* Using alternative phonetic encoding (i.e. what is shown in the article, using Latin letters to spell out sounds rather than words)
* Homoglyph attacks
* Using deliberately incorrect or ambiguous grammatical structure
* Using deliberately incorrect spacing and punctuation (for example "m ee t. me;? b!y th e do.,c?s a!.t; m id ni;ght" will completely bewilder all the parsing packages I'm aware of)
* Convert the text to images and post those, possibly adding graphical text which will confuse OCR packages
Mix and match for even more fun!
There are also lots and lots of stenographic techniques, but those are a lot less accessible to laypeople.
I'm not familiar with NLP tools and techniques available for Chinese, but most parsers/taggers for English aren't really written with adversarial inputs in mind. It would probably be possible to deliberately construct valid (or at least decipherable to a human) English text that would crash the common tools available.
As an aside, the articles that keep coming out over the HK protester's tactics are starting to seem a lot like Cory Doctorow's "Little Brother"[1], which is available for free, and definitely worth a read.
1 - https://craphound.com/littlebrother/Cory_Doctorow_-_Little_B...
Re: HK social media users writing phonetically spelled posts to shut out trolls
#43Re: HK social media users writing phonetically spelled posts to shut out trolls
#44Earlier quoted context omitted.
Only for a little while. It will take a few days to make a browser extension to fix this.
There's nothing which will translate that as far as I know, it's an entirely different problem than chinese characters since Cantonese is a separate language and the phonetics are not even standardized in these messages so there's no 1 to 1 mapping to characters either.
Re: HK social media users writing phonetically spelled posts to shut out trolls
#45Hong Kong is not the only place where people speak Cantonese. The entire region of GuangDong (Canton) speak this dialect. Do they believe all "trolls" speak Mandarin?
Re: HK social media users writing phonetically spelled posts to shut out trolls
#46Earlier quoted context omitted.
Jyutping is not taught in Hong Kong schools here, and it shows: people are coming up with random transliterations that are often quite hard to read.
I always assumed they taught the Yale Romanization in schools, since that's what every book I've bought in Hong Kong has used. Outside Hong Kong, Jyutping seems pretty much universal. Is everybody really typing with Cangjie/handwriting? xD