Live data from Hacker News

Scribble – Convert handwriting into digital text

getscribblenow.com

21–30 of 64 posts

Re: Scribble – Convert handwriting into digital text

#21

Cool idea. Could see this being useful with something like Evernote. It's got a great note capture feature as well but doesn't covert to text you can't edit.

Thanks!

Agreed re: Evernote. I actually really like that feature, because it makes handwritten notes searchable but found the same problem you identified with the lack of transcription.

My hope is we can integrate with players like Evernote / OneNote who already do a great job at centralizing notes.

Re: Scribble – Convert handwriting into digital text

#22
Nice! Maybe I won't need to implement this myself then.

Now if only someone would release designs for an affordable, reliable, non-destructive robot to do the physical data collection... My backlog of notes is way to big to stand around snapping cell phone photos at all of it manually.

Re: Scribble – Convert handwriting into digital text

#23

I've been keeping a physical dev diary and have been trying to keep up with transcribing it to digital, but would love any shortcuts to that process as I'm pretty bad about keeping up with it. My handwriting is kind of messy but I'm eager see how well your algorithms can handle it. It doesn't have to be perfect anyway, as I don't mind going in and cleaning up afterwards. Should still save me some time and some typing…

Thanks for the comment! We had the same use case when we decided to build it.

It's currently not perfect but handles a surprising amount of bizarre handwriting styles (cursive / messy notes). Looking forward to hearing your thoughts as we onboard to the beta,

Re: Scribble – Convert handwriting into digital text

#24
post #13

this kinda thing was well studied and developed nearly 30 years ago already..... Deep leaning, ML are all hypes.

Without any links or proof, this is a low value comment.

Do you need links or proofs if I tell you the sky is blue ? OCR has been around for decades. This approach is only interesting if it improves OCR via NN. Would love to learn more about this process (the improvement, not the training...).

Re: Scribble – Convert handwriting into digital text

#25

Does the processing happen locally or is there some cloud processing going on? Kind of worried about the privacy implications of that.

That's a great question.

It currently happens in the cloud (purely a software design decision), but we could probably do it locally as well since the NN is already trained.

We were thinking of having similar TOS as normal note editing software (Evernote, Dropbox Paper) to mitigate security concerns. What do you think?

Re: Scribble – Convert handwriting into digital text

#27
post #9

Looks nice. Any chance for an api so we can send jpg and get back a document?

Thank you for the comment!

We don't have a developer facing API at the moment but it's in the roadmap. Once our algorithm is accurate enough that it "just works" in an enterprise setting, we may open up an API so developers can build applications for their businesses.

Re: Scribble – Convert handwriting into digital text

#28

This looks cool but I wish it showed examples of different kinds of handwriting being detected. Cursive? European numbers vs American numbers (the 1 especially)? Doctor (or other badly rendered hand writing)? Seems like this technology isn't really all that useful if it doesn't work on various inputs, especially 'unclean' or 'sloppy' inputs.

>European numbers vs American numbers (the 1 especially)? Honestly I think 9 will be the bigger issue, to my eyes the European version is near identical to lower-case G.

You mean q? Because g has that loop at the end.

Re: Scribble – Convert handwriting into digital text

#30

Care to share some details on your technology? On whose handwriting was this trained, did you use any public datasets for this? And of course, how well will this perform on writing styles it hasn't seen before?

We did two things to train it (1) scraped the web for photographs of handwritten notes with known transcription to build our training dataset (2) had our university friends / students write out training examples by hand to get more realistic data on what modern handwriting looks like

Scribble currently only supports English, so it does poorly with other languages, but is pretty robust to poor handwriting in English (such as my own).

It gets about 85% of my handwriting correct (my handwriting is abysmal), so there's definitely room for improvement.

Post reply on HN