This is really cool. Use of GPT-3 to augment OCR is an amazing (and, retrospectively, obvious) insight and a great immediate use case for these language models. I wish Remarkable took this idea -- they really oversold their OCR capabilities[1]. It works great in their support and promo videos, but I found the actual performance to be absolutely terrible. [1] https://support.remarkable.com/hc/en-us/articles/3600026614…
It's an old idea, using a language model on top of character level OCR. Works well for general text but doesn't solve random sequences of digits and letters. So you can't use it to correct your invoices where you have lots of out-of-dictionary tokens.
[1] https://tesseract-ocr.github.io/docs/Limits_on_the_Applicati...
[2] https://tesseract-ocr.github.io/docs/Improving_Book_OCR_by_A...