Live data from Hacker News

Experiments in Handwriting with a Neural Network

distill.pub

11–17 of 17 posts

Re: Experiments in Handwriting with a Neural Network

#11
post #6

Nice! Is it trained on Latin character-based hand writing only, or can it also predict other charactersets?

Latin character only. It was trained on the IAM Handwriting database [1], which is all English handwriting.

[1] http://www.fki.inf.unibe.ch/databases/iam-handwriting-databa...

Re: Experiments in Handwriting with a Neural Network

#12

Earlier quoted context omitted.

How much computing power/time did it take to train the model? Had any hyperparameters optimization been done? Sorry if I missed the reference that has this information, but I think that these numbers are important in any deep learning experiment because they allow the readers to evaluate applicability of described methods to their problems.

This post has more details about the model: http://blog.otoro.net/2015/12/12/handwriting-generation-demo...

Note that the contribution of this article is techniques for visualizing models, not the novel itself.

Re: Experiments in Handwriting with a Neural Network

#14
This is incredible important research. There are fields in which adoption of ML techniques is dependent on it being explainable and inspectable to stakeholders, e.g. in certain health care, policy or finance applications.

There is work being done on explaining non-linear models, such as LIME [1], but much more is needed. At a recent d3 meetup the topic was discussed but we primarily noted its importance. Notes at [2].

[1] https://github.com/marcotcr/lime [2] https://docs.google.com/document/d/1o-DO65PEZShLuadyRd35PsTJ...

Re: Experiments in Handwriting with a Neural Network

#15
In "Examining the Internals of the Model" it could be interesting to show an overview activation map that sums over the absolute activation of all the examples—to highlight which cells activate on all examples—and one that is colored by variance of activation across examples—to show which cells influence the character/differences in writing.

Re: Experiments in Handwriting with a Neural Network

#16
post #5
post #4

Earlier quoted context omitted.

I'm doing some research into handwriting recognition. In particular transcribing older documents. Do you see a way of applying your work here in that direction?

The generative model of handwriting that we're working with here probably isn't very applicable to handwriting recognition. In principle, you could train a model like this to jointly model the text and the produced handwriting and then search for the most likely text to correspond to handwriting, but it would be a lot less efficient and likely not work as well. Instead, the natural way to apply neural networks to use…

You can still have CNN hallucinate most likely set of next inputs.

And the kind of activity display you did later also works.

Post reply on HN