Live data from Hacker News

Mistral OCR

mistral.ai

91–100 of 450 posts

Re: Mistral OCR

#91

Co-founder of doctly.ai here (OCR tool) I love mistral and what they do. I got really excited about this, but a little disappointed after my first few tests. I tried a complex table that we use as a first test of any new model, and Mistral OCR decided the entire table should just be extracted as an 'image' and returned this markdown: ``` ![img-0.jpeg](img-0.jpeg) ``` I'll keep testing, but so far, very disappointing…

Would love to see the test file.

would be glad to see benchmarking results

Re: Mistral OCR

#92

Related, does anyone know of an app that can read gauges from an image and log the number to influx? I have a solar power meter in my crawlspace, it is inconvenient to go down there. I want to point an old phone at it and log it so I can check it easily. The gauge is digital and looks like this: https://www.pvh2o.com/solarShed/firstPower.jpg

https://www.home-assistant.io/integrations/seven_segments/

https://www.unix-ag.uni-kl.de/~auerswal/ssocr/

https://github.com/tesseract-ocr/tesseract

https://community.home-assistant.io/t/ocr-on-camera-image-fo...

https://www.google.com/search?q=home+assistant+ocr+integrati...

https://www.google.com/search?q=esphome+ocr+sensor

https://hackaday.com/2021/02/07/an-esp-will-read-your-meter-...

...start digging around and you'll likely find something. HA has integrations which can support writing to InfluxDB (local for sure, and you can probably configure it for a remote influxdb).

You're looking at 1xRaspberry PI, 1xUSB Webcam, 1x"Power Management / humidity management / waterproof electrical box" to stuff it into, and then either YOLO and DIY to shoot over to your influxdb, or set up a Home Assistant and "attach" your frankenbox as some sort of "sensor" or "integration" which spits out metrics and yadayada...

Re: Mistral OCR

#93

I would like to see how it performs with massively warped and skewed scanned text images, basically a scanned image where the text lines are wavy as opposed as straight horizontal, where the letters are elongated. One where the line widths are different depending on the position on the scanned image. I once had to deal with such a task that somebody gave me with OCR software, Acrobat, and other tools could not decode…

Garbage in, garbage out?

Re: Mistral OCR

#94
post #4

Dang. Super fast and significantly more accurate than google, Claude and others. Pricing : $1/1000 pages, or per 2k pages if “batched”. I’m not sure what batching means in this case: multiple pdfs? Why not split them to halve the cost? Anyway this looks great at pdf to markdown.

May I ask as a layperson, how would you about using this to OCR multiple hundreds of pages? I tried the chat but it pretty much stops after the 2nd page.

Re: Mistral OCR

#95

"World's best OCR model" - that is quite a statement. Are there any well-known benchmarks for OCR software?

We published this benchmark the other week. We'll can update and run with Mistral today! https://github.com/getomni-ai/benchmark

Came here to see if you all had run a benchmark on it yet :)

Re: Mistral OCR

#96
post #40

The new Mistral OCR release looks impressive - 94.89% overall accuracy and significantly better multilingual support than competitors. As someone who's built document processing systems at scale, I'm curious about the real-world implications. Has anyone tried this on specialized domains like medical or legal documents? The benchmarks are promising, but OCR has always faced challenges with domain-specific terminology…

Excited to test this our on our side as well. We recently built an OCR benchmarking framework specifically for VLMs[1][2], so we'll do a test run today.

From our last benchmark run, some of these numbers from Mistral seem a little bit optimistic. Side by side of a few models:

model | omni | mistral |

gemini | 86% | 89% |

azure | 85% | 89% |

gpt-4o | 75% | 89% |

google | 68% | 83% |

Currently adding the Mistral API and we'll get results out today!

[1] https://github.com/getomni-ai/benchmark

[2] https://huggingface.co/datasets/getomni-ai/ocr-benchmark

Re: Mistral OCR

#98
post #82

Earlier quoted context omitted.

You'll be happier finding a replacement meter that has an interface to monitor it directly or a second meter. An old phone and OCR will be very brittle.

Not OP, but it sounds like the kind of project I’d undertake. Happiness for me is about exploring the problem within constraints and the satisfaction of building the solution. Brittleness is often of less concern than the fun factor. And some kinds of brittleness can be managed/solved, which adds to the fun.

I would posit that learning how the device works, and how to integrate with a newer digital monitoring device would be just as interesting and less brittle.

Re: Mistral OCR

#99

LLM based OCR is a disaster, great potential for hallucinations and no estimate of confidence. Results might seem promising but you’ll always be wondering.

CNN-based OCR also have "hallucinations" and Transformers aren't that much different in that respect. This is a problem solved with domain specific post-processing.

Re: Mistral OCR

#100
post #93

I would like to see how it performs with massively warped and skewed scanned text images, basically a scanned image where the text lines are wavy as opposed as straight horizontal, where the letters are elongated. One where the line widths are different depending on the position on the scanned image. I once had to deal with such a task that somebody gave me with OCR software, Acrobat, and other tools could not decode…

Garbage in, garbage out?

"Yes" but if a human could do it "AI" should be able to do it too.
Post reply on HN