Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral OCR 4

mistral.ai

Post reply on HN
Print view View original

31–40 of 143 posts

Re: Mistral OCR 4

#31

Post by nik736 »

MostlyStable wrote: post #30
nik736 wrote: post #14

Earlier quoted context omitted.

Opus is very good at OCR. Way better than the small 1-4B VLMs. If Opus failed, most likely those smaller models will fail as well.

How long have you been testing this? Have you noted a large improvement? I tested Opus for this quite a while ago (maybe 4.5? Whatever was out about a year ago), and it performed quite poorly on my use case.

I have put together an internal benchmark on 1000s of business documents with weird tables, structure, etc. that I run on every relevant model release. Opus 4.8 performs very very well. But it is obviously overkill for the task (and expensive at doing so). I just wanted to respond to the OP.

Re: Mistral OCR 4

#32

Post by bpodgursky »

Insanity wrote: post #27
bpodgursky wrote: post #16

Earlier quoted context omitted.

I do not believe this story. Opus 4.8 scanned hundreds of PDFs for me recently with the worst handwriting imaginable. 100% successful, other than one record where even I could not figure out what was written.

I do not believe this story, because of the message I just posted above. That's not really productive lol, I'm glad it worked for you but these models are non-deterministic and 'YMMV' very much applies everywhere. I had it parse receipts (in fairness, in variable lightning), all taken from iPhone cameras in the past year. And yeah, not a great job, about 20% failed to get the date correct. (Not outrageously wrong, e.…

Are you sure you weren't using Sonnet or a low-effort reasoning mode?

Re: Mistral OCR 4

#33

Post by adlk »

greenleafone7 wrote: post #23

After paying for Mistral and using it for a while I genuinely hated it. It's a productivity black hole and can't realistically compete with anyone. I chose it only because it was European, but no. I'd rather let my one year subscription go to waste than use anything 'Mistral'.

what did you use it for and when?

Re: Mistral OCR 4

#34

Post by alex43578 »

weird-eye-issue wrote: post #17
utopiah wrote: post #8

" A note on out-of-scope use. OCR 4 is a document-understanding model, not a decision-maker. It is not intended for medical diagnosis, legal advice or judgment, high-stakes financial decisions, safety-critical systems, real-time/latency-sensitive processing, or non-document inputs (raw audio, video, etc.). " Can't wait for the "oh so innovative" manager who will suggest during the next meeting "Ok... but what if WE u…

Why would anybody do that you would simply get terrible results compared to dozens of other more capable models. It's for converting to text not answering questions. Just seems like you need some sort of weird angle to bring out an anti AI stance

I think his comment is referring to a scenario where a decision is made on financial numbers that are misrecognized. E.g. 9.0% actual is OCR’d as 90%

Re: Mistral OCR 4

#35

Post by andrewmutz »

A tangential observation: the video on the linked page wasn't what I expected. I thought Mistral was a european AI company, so I didnt expect the video to be filmed in San Francisco featuring three people who don't seem to be european.

I'm not against them being a global organization, that's wonderful. I was just surprised. I expected a parisian office and european accents.

Re: Mistral OCR 4

#37

Post by jppope »

collabs wrote: post #5
jppope wrote: post #3

Is there something wrong with their certificate? Chromium is saying https isn't valid

Looks good to me on both brave (on android) and firefox (on windows 11). Lets see what ssl labs says (it is running now) https://www.ssllabs.com/ssltest/analyze.html?d=mistral.ai&la... Looks good so far, A+ on ipv4 as well as ipv6 Edit: I also asked Gemini 3.1 Pro to analyze the certificate and it looks good It looks like you have shared an `about:certificate` URL containing a chain of three Base64-encoded X.509 TLS/…

thanks I'm going to have to check whats going on with my setup then

Re: Mistral OCR 4

#38

Post by jimmypk »

MostlyStable wrote: post #25

Does anyone know of OCR benchmarks that include hand-written documents? I'm currently using Gemini pro 3 for this, and error rates are quite good, but it's a little bit pricey, and I'd be interested in a cheaper model that could perform as well, but almost all the OCR benchmarks I'm aware of (and I believe all the ones included in this announcement) are about printed/typeset text.

[flagged]

Re: Mistral OCR 4

#39

Post by Insanity »

bpodgursky wrote: post #32
Insanity wrote: post #27

Earlier quoted context omitted.

I do not believe this story, because of the message I just posted above. That's not really productive lol, I'm glad it worked for you but these models are non-deterministic and 'YMMV' very much applies everywhere. I had it parse receipts (in fairness, in variable lightning), all taken from iPhone cameras in the past year. And yeah, not a great job, about 20% failed to get the date correct. (Not outrageously wrong, e.…

Are you sure you weren't using Sonnet or a low-effort reasoning mode?

Yes, lol

Re: Mistral OCR 4

#40

Post by rjzzleep »

andrewmutz wrote: post #35

A tangential observation: the video on the linked page wasn't what I expected. I thought Mistral was a european AI company, so I didnt expect the video to be filmed in San Francisco featuring three people who don't seem to be european. I'm not against them being a global organization, that's wonderful. I was just surprised. I expected a parisian office and european accents.

Unfortunately Europeans are terrible customers for making money. They ask a lot of questions and they're very stingy with their wallets. Americans on the other hand ...
Post reply on HN