My main beef with mistral is that they don’t bother to respond to customer inquiries for products the hide behind “reach out for pricing” terms, so even if they were better than SoTA it wouldn’t really matter.
Mistral OCR 3
51–60 of 137 posts
Re: Mistral OCR 3
#52It seems like Mistral is just chasing around sort of "the fringes" of what could be useful AI features. Are they just getting out-classed by OAI, Google, Anthropic? It seems like EU in general should be heavily invested in Mistral's development, but it doesn't seem like they are.
I think there is a lot of broad support, but they're just kind of hamstrung by EU regulation on AI development at this stage. I think the end game will ultimately be getting acquired by an American company, and then relocating.
Do you have any source on this other than vibes based on”EU bad” sentiment?
Re: Mistral OCR 3
#53there has been so many open source OCR in the last 3 months that would be good to compare to those especially when some are not even 1B params and can be run on edge devices. - paddleOCR-VL - olmOCR-2 - chandra - dots.ocr I kind of miss there is not many leaderboard sections or arena for OCR and CV and providers hosting those. Neglected on both Artificial Analysis and OpenRouter.
what I like in MistralOCR is that they have simple pricing $1/1k pages and API hosted on their servers. With other OCR is hard to compare pricing because are token based and you don't know how many tokens is the image unless you run your own test. E.g. with Gemini 3.0 flash you might seem that model pricing increased only slightly comparing to Gemini 2.5 flash until you test it and will see that what used to be 258 p…
Simple would be to bill per character.
Now I have to figure out how large a page can be.
Re: Mistral OCR 3
#54Earlier quoted context omitted.
Someone posted a project here about a month ago where they compare models in head-to-head matchups similar to llmarena https://www.ocrarena.ai/leaderboard Hasn't been updated for Mistral but so far gemeni seems to top the leaderboard.
OCR developers from decades past must be slapping their foreheads now that it seems users will wait a whole minute per page and be happy.
You can also sort by latency. dots.ocr has the lowest at 3.8s/page. And although it doesn't fare very well against much larger slower models, it's still streets ahead of traditional OCR techniques
Re: Mistral OCR 3
#55My current holy grail is my attempt to convert a Shipibo (an indigenous Peruvian language)-to-Spanish dictionary into a Shipibo-to-English dictionary. The pdf I have (available freely on archive.org) isn't a great scan (though I think it'd be a heck of a lot easier than some of the handwritten examples they show). Layout (2-columns) along with header/footers can cause some headaches, but it is all Latin script. This seems to fall on its face pretty badly (not even a couple of pages in), so my search continues. (The other major problem I'm having is trying to separate out Shipibo definitions/examples from the Spanish ones, and only translating the Spanish to English...so pretty complex I guess. I've been taking fresh stabs at this project every few months when I see OCR/LLM news pop up and continue to be disappointed)
Re: Mistral OCR 3
#56Gave it a birth registry from a Portuguese locality from 1755 which my dad and I often decipher to figure out geneology and it did a terrible job. Regular Gemini Thinking can actually get 70-80% of the documents correct except lots of mistakes on given names. Chatgpt maybe understands like 50-60%. This Mistral model butchered the whole text, literally not a word was usable. To the point I think I'm doing something wr…
Forgivable, as that's a quite atypical document, I'd say.
Re: Mistral OCR 3
#57From a tweet: https://x.com/i/status/2001821298109120856 > can someone help folks at Mistral find more weak baselines to add here? since they can't stomach comparing with SoTA.... > (in case y'all wanna fix it: Chandra, dots.ocr, olmOCR, MinerU, Monkey OCR, and PaddleOCR are a good start)
I've worked on document extraction a lot and while the tweet is too flippant for my taste, it's not wrong. Mistral is comparing itself to non-VLM computer vision services. While not necessarily what everyone needs, they are a very different beasts compared to VLM based extraction because it gives you precise bounding boxes, usually at the cost of larger "document understanding". Its failure mode are also vastly diffe…
Why not use both? I just built a pipeline for document data extraction that uses PaddleOCR, then Gemini 3 to check + fix errors. It gets close to 99.9% on extraction from financial statements finally on par with humans.
Re: Mistral OCR 3
#58> Mistral OCR 3 is ideal for both high-volume enterprise pipelines and interactive document workflows. I don’t know how they can make this statement with 79% accuracy rate. For any serious use case, this is an unacceptable number. I work with scientific journals and issues like 2.9+0.5 and 29+0.5 is something we regularly run into that has us never being able to fully trust automated processes and require human verif…
Where are you seeing 79% accuracy? 79% only occurs on the page as a win rate, not an accuracy
Right! I didn’t know the difference. Does it mean for 79 out of 100 documents they produce 100% accurate OCR, I doubt it. The win rate sounds like a practical approximation of accuracy here to me.
If I am wildly off, I am happy to learn.
Re: Mistral OCR 3
#59My current holy grail is my attempt to convert a Shipibo (an indigenous Peruvian language)-to-Spanish dictionary into a Shipibo-to-English dictionary. The pdf I have (available freely on archive.org) isn't a great scan (though I think it'd be a heck of a lot easier than some of the handwritten examples they show). Layout (2-columns) along with header/footers can cause some headaches, but it is all Latin script. This…
I'm assuming you're interested in studying Ayahuasca traditions?
I recently learned that traditionally in Shipibo culture, ayahuasca was never meant to be given to "the normal mind". Instead the maestras would be the ones taking the ayahuasca in order to help guide them into diagnosing people dealing with various sicknesses.
These maestras were also ranked by how many different plants they'd done a dieta on. A dieta is kinda similar to fasting. You can't shower with soap, you can't have sex, you can't have too much salt/seasoning, can't be exposed to too much smoke, can't have alcohol, etc. And you use that specific plant throughout your time. Basically you want to eliminate any conflicting variables so you can experience the plant as purely as possible to understand its effects. Traditionally these dietas could last over a year but modern day maestros typically do them for just a few weeks.
I don't really have a point to this. Just found it fascinating how deeply and strictly they study certain plant medicines and wanted to share
Re: Mistral OCR 3
#60Gave it a birth registry from a Portuguese locality from 1755 which my dad and I often decipher to figure out geneology and it did a terrible job. Regular Gemini Thinking can actually get 70-80% of the documents correct except lots of mistakes on given names. Chatgpt maybe understands like 50-60%. This Mistral model butchered the whole text, literally not a word was usable. To the point I think I'm doing something wr…
Forgivable, as that's a quite atypical document, I'd say.
Not atypical enough for Gemini is my point. Also its one of the most common hand written document types in existance since at the time almost nobody other than the local priest knew how to write and birth and marriage certificates were probably the only written documents in whole towns and villages. This is the same throughout Europe at least.