Live data from Hacker News

Unlimited OCR: One-shot long-horizon parsing

github.com

11–20 of 119 posts

Re: Unlimited OCR: One-shot long-horizon parsing

#11
post #6
post #4

Earlier quoted context omitted.

Cost, throughput, latency...

Traditional OCR is faster, cheaper, and much more reliable than LLMs

I don't think that's a universal statement that aplies to every kind of documents and languages. Mistral OCR is able to do things no "traditional" OCR was ever able to.

Re: Unlimited OCR: One-shot long-horizon parsing

#13
post #2

OCR has been solved long time ago with vision models. Solutions are consistent, reliable, and stable. What is the point of reinventing the wheel? I would definitely understand post processing, like extracting data, answering question .. etc, but why re-doing the OCR engine itself?

I guess, in theory, the prior distribution of language would allow for improved performance in some cases, especially where input quality is low.

This is already used in OCR, tesseract uses that.

Re: Unlimited OCR: One-shot long-horizon parsing

#14
post #6
post #4

Earlier quoted context omitted.

Cost, throughput, latency...

Traditional OCR is faster, cheaper, and much more reliable than LLMs

If you consider non-English script, traditional OCR is not more reliable.

CJK have lots of character and high confusion rate.

Arabic scripts are complex and have lots of morphs.

Vietnamese have easily confused diacritics.

Thai have lots of non-standard fonts.

Re: Unlimited OCR: One-shot long-horizon parsing

#16
post #2

OCR has been solved long time ago with vision models. Solutions are consistent, reliable, and stable. What is the point of reinventing the wheel? I would definitely understand post processing, like extracting data, answering question .. etc, but why re-doing the OCR engine itself?

lol nope it hasn’t been solved. I deal with this constantly and we still have a longggg ways to go

Re: Unlimited OCR: One-shot long-horizon parsing

#17
post #2

OCR has been solved long time ago with vision models. Solutions are consistent, reliable, and stable. What is the point of reinventing the wheel? I would definitely understand post processing, like extracting data, answering question .. etc, but why re-doing the OCR engine itself?

Detecting characters almost, layout no.

Exactly my experience. If you try to OCR hand-filled forms with a fixed structure, traditional OCR models are great. Vision-llms can improve a bit on character recognition, but at the cost of harder to detect failure modes.

But if you are trying to ingest diverse documents with headings, multi-column layouts, headers and footers, ad space in the middle of your text, etc, vision-llms are a giant step forward. But you need the context of the previous page to make good decisions about the current page, which is where things quickly get janky (or slow, if you choose the naive approach)

Vision-llms also seem to deal much better with variance in scripts. Cursive, random Japanese in the middle of the text, weird math symbols, handwriting from three centuries ago, all "just works" without you even having to remember that this can happen

Post reply on HN