Machine Learning Can Help Unlock the World of Ancient Japan
thegradient.pub
Machine Learning Can Help Unlock the World of Ancient Japan
1–9 of 9 posts
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#2> Chirashigaki was a method of writing popular in premodern Japanese due to the aesthetic appeal of the text. ... When humans read these documents, they decided where to start reading based on the size of characters and the darkness of the ink.
Extraordinary.
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#3It would be really cool if they released these generated images en masse because that could help a whole generation of linguists catch up on ancient Japanese literature swiftly. These symbols are hard to decipher, but with enough Machine Generated examples it could advance the field considerably!
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#4for those interested in the different ml methods attempted for the challenge, many of the top kagglers in this contest posted rundowns of their solution [0].
for those interested in kuronet [1] and the competition alex gave a presentation here (en, [2]) as did tarin (ja, [3]).
for those interested in classical japanese literature, you can see the tools they've built here [4]. tarin is also very active on twitter [5].
[0] https://www.kaggle.com/c/kuzushiji-recognition/discussion
[1] https://arxiv.org/pdf/1910.09433.pdf
[2] https://youtu.be/e2-mVBvygm8?t=1428
[3] https://youtu.be/e2-mVBvygm8?t=537
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#5> Chirashigaki was a method of writing popular in premodern Japanese due to the aesthetic appeal of the text. ... When humans read these documents, they decided where to start reading based on the size of characters and the darkness of the ink. Extraordinary.
Sounds more extraordinary than it is. It basically means “you read it the obvious way.”
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#6Describing kuzushiji ("broken characters") as a "writing system" is a bit much, I'd liken it to a cursive script. Not that this diminishes the importance of ML here, since anybody who's tried to read historical English documents will know that these can also be pretty incomprehensible to the untrained eye:
https://www.nationalarchives.gov.uk/palaeography/doc5_popup/...
But as ever, Japanese ramps up the difficulty because there are thousands of characters instead of 26 letters to deal with.
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#7> Chirashigaki was a method of writing popular in premodern Japanese due to the aesthetic appeal of the text. ... When humans read these documents, they decided where to start reading based on the size of characters and the darkness of the ink. Extraordinary.
Sounds more extraordinary than it is. It basically means “you read it the obvious way.”
I wopud not call it really obvious:
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#8Earlier quoted context omitted.
Sounds more extraordinary than it is. It basically means “you read it the obvious way.”
I wopud not call it really obvious: https://thegradient.pub/content/images/2019/11/image2.jpg
Well, even someone such as myself with only occasionally passable Japanese skills can fairly easily see that one most likely ought to start at “御” towards the upper right and do find that the other order markings “makes sense”. So perhaps it is just a matter of needing a little bit of exposure? Now, reading it is its entirety is an entirely different story, but I do know that native Japanese readers do struggle greatly as well on this point.
On a related note, does the first text region not look an awful lot like the Japanese main island of Honshu?
Re: Machine Learning Can Help Unlock the World of Ancient Japan
#9Earlier quoted context omitted.
I wopud not call it really obvious: https://thegradient.pub/content/images/2019/11/image2.jpg
Well, even someone such as myself with only occasionally passable Japanese skills can fairly easily see that one most likely ought to start at “御” towards the upper right and do find that the other order markings “makes sense”. So perhaps it is just a matter of needing a little bit of exposure? Now, reading it is its entirety is an entirely different story, but I do know that native Japanese readers do struggle great…
Spotting the starting point is easy, but I doubt even a human can order the text correctly without taking cues from the textual information.
It is indeed doable, calling it obvious is what I react to :-)