Using Neural Networks to Evaluate Handwritten Mathematical Expressions
1–10 of 20 posts
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#2superb! this is exactly the kind of thing computers should be doing for us. Would also like to have diagram recognition to turn hand-drawn graphs, networks, 3d-surfaces etc into data-structures that can be computed with, and also can it recognize code and run it please t
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#3just phenomaly practical
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#4Check out Joseph LaViola's work at UCF (formerly from Brown).
http://www.eecs.ucf.edu/isuelab/research/pen.php
The latest work, MathBoxes, uses the recognition engine from the starPAD sdk http://graphics.cs.brown.edu/research/pcc/research.html#star...
It's a great toolkit for building pen-centric computing tools (especially math recognizers and tools), but unfortunately it is heavily tied to the old Windows 7 tablet APIs and so isn't easily generalized. I've been hoping to port it to work on newer hardware for the past few years, but have not yet found the time. If anyone wants to take on that project it would be incredibly useful (especially since there seems to be a resurgence of pen-centric computing on the near horizon).
You can find more pen-math work on Brown's website: http://cs.brown.edu/research/ptc/FluidMath.html
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#5The free app Mathpix for iOS does this really well too: http://mathpix.com
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#6Will someone please build this into a mobile (tablet!) first version of Jupyter?
Stop doing all these slightly-better-in-some-way-but-not-really things (Zeppelin, etc). You've lost.
But I'm so frustrated trying to use Jupyter on a tablet. The compute model is perfect for using my tablet, but the UI just doesn't work that well.
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#7github link to code?
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#8This looks interesting. But I was a bit disappointed about the amount of work needed to divide the job into subtasks (finding the characters, cropping them, etcetera). I was somehow hoping the ANN would take care of that as well.
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#9This looks interesting. But I was a bit disappointed about the amount of work needed to divide the job into subtasks (finding the characters, cropping them, etcetera). I was somehow hoping the ANN would take care of that as well.
Having a single ANN do everything is the best way to end up with a system that works wonders 95% of the time, but then you give it a simple 1+1 question and it answers 42.
It would also require way more neurons, and a lot of processing power. Consider the curse of dimensionality: he's working with a 5000ish dimensions vector, you have to make it simpler on the machine at some point!
Re: Using Neural Networks to Evaluate Handwritten Mathematical Expressions
#10This looks interesting. But I was a bit disappointed about the amount of work needed to divide the job into subtasks (finding the characters, cropping them, etcetera). I was somehow hoping the ANN would take care of that as well.
Having a single ANN do everything is the best way to end up with a system that works wonders 95% of the time, but then you give it a simple 1+1 question and it answers 42. It would also require way more neurons, and a lot of processing power. Consider the curse of dimensionality: he's working with a 5000ish dimensions vector, you have to make it simpler on the machine at some point!
But I can also recognize digits by correlating them against a database of millions of test-characters. Recognizing perfectly cropped characters is not a hard problem. The only benefit of an ANN is the compactness of the representation. So, unfortunately, as a non-expert, I would say this is only a minor step in the direction of true artificial intelligence. The application looks quite fun and interesting though.