Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deep Text Correcter

atpaino.com

Post reply on HN
Print view View original

41–50 of 71 posts

Re: Deep Text Correcter

#41

Post by walrus1066 »

atpaino wrote: post #15
jmiserez wrote: post #7

Interesting idea. I went ahead and tested: > Alex went to the kitchen to store the milk in the fridge. Corrected: > Alex went to the kitchen to the store the milk in the fridge. Gathering a large, high quality dataset from the internet is probably not so easy. A lot of the content on HN/Reddit/forums is of low quality grammatically and often written by non-native English speakers (such as myself). Movie dialogues don…

Yep, it definitely has room to improve. The work thus far has primarily been a proof-of-concept for the methodology used to generate training samples (i.e. starting with grammatically correct text and introducing errors). Next step is to try to include more high quality data, after which I may try out comment data from HN, etc. I think it would be interesting to see what the effect of somewhat noisier data like that…

Programmatically generating incorrect grammar from correct sentences must be really tough. There are so many more ways to incorrectly structure a sentence than there are correct ones.

Random idea: what happens if you use Google translate to generate the incorrect sentence, I.e. Translate it to other languages and then back again. If the resulting sentence doesn't match the original, add it to the dataset.

Re: Deep Text Correcter

#42

Post by WhitneyLand »

Alex nice work this is exciting. I've been wanting to work on something similar because the quality of common grammar checkers (like MS Word) has made such little progress.

Have you considered combining your approach with rules based system? Some systems using only an elaborate set of rules for common mistakes have had pretty good performance. I wonder if these two approaches could be combined.

Btw, what is the highest performing grammar checker you've found that's commonly available?

Re: Deep Text Correcter

#44

Post by johnhenry »

raverbashing wrote: post #39

While there are limited errors it can officially correct, I tried a few phrases: Didn't fix misuse of its: "The tool worked on it's own power" "He should of gone yesterday" gets corrected to "the He should of gone yesterday" "To who does this belong?" doesn't get corrected "A Apple a day keeps the doctor away" doesn't change

I tried these, which stem from the given example:

"I'm going to store" gets corrected to "I'm going to the store" (looks good)

"I'm going to store food" gets corrected to "I'm going to the store store" (I'll forgive this due to lack of a prepositional phrase)

"I'm going to store food in the closet" gets corrected to "I'm going to the store food in the closet" (yeah, this is wrong)

It seems like the AI is good at fixing sentences where adding a missing "the" is the solution. So when that does turn out to be the solution, it works fine. When that isn't the solution, well, when all you have is a hammer, every problem looks like a nail...

Still really interesting, though. The AI may not [yet] be able to solve general grammatical errors, but it may good enough that it works in specific cases. It may even be the case that we'll design systems that depend on multiple agents offering suggestions and other aggregating suggestions into a more refined result.

Re: Deep Text Correcter

#49

Post by Paul-ish »

jmiserez wrote: post #7

Interesting idea. I went ahead and tested: > Alex went to the kitchen to store the milk in the fridge. Corrected: > Alex went to the kitchen to the store the milk in the fridge. Gathering a large, high quality dataset from the internet is probably not so easy. A lot of the content on HN/Reddit/forums is of low quality grammatically and often written by non-native English speakers (such as myself). Movie dialogues don…

Technical documentation may be dry, but it is generally well read and edited, grammatically correct, and easily obtained.
Post reply on HN