[flagged]
You might want to mention that you are a competitor.
Mistral OCR 3
21–30 of 137 posts
Re: Mistral OCR 3
#22Re: Mistral OCR 3
#23It seems like Mistral is just chasing around sort of "the fringes" of what could be useful AI features. Are they just getting out-classed by OAI, Google, Anthropic? It seems like EU in general should be heavily invested in Mistral's development, but it doesn't seem like they are.
Following the leaders too closely seems like a bad move, at least until a profitable business model for an AI model training company is discovered. Mistral’s models are pretty good, right? I mean they don’t have all the scaffolding around them that something like chatGPT does, but building all that scaffolding could be wasted effort until a profitable business model is shown. Until then, they seem to be able to keep…
>Mistral’s models are pretty good, right
Are they? IIRC their best model is still worse than the gpt-oss-120B?
Re: Mistral OCR 3
#24there has been so many open source OCR in the last 3 months that would be good to compare to those especially when some are not even 1B params and can be run on edge devices. - paddleOCR-VL - olmOCR-2 - chandra - dots.ocr I kind of miss there is not many leaderboard sections or arena for OCR and CV and providers hosting those. Neglected on both Artificial Analysis and OpenRouter.
Someone posted a project here about a month ago where they compare models in head-to-head matchups similar to llmarena https://www.ocrarena.ai/leaderboard Hasn't been updated for Mistral but so far gemeni seems to top the leaderboard.
OCR developers from decades past must be slapping their foreheads now that it seems users will wait a whole minute per page and be happy.
Re: Mistral OCR 3
#25Gave it a birth registry from a Portuguese locality from 1755 which my dad and I often decipher to figure out geneology and it did a terrible job. Regular Gemini Thinking can actually get 70-80% of the documents correct except lots of mistakes on given names. Chatgpt maybe understands like 50-60%. This Mistral model butchered the whole text, literally not a word was usable. To the point I think I'm doing something wr…
Oh god, I'm sure I wouldn't come close to 50%; that's so hard to read
Re: Mistral OCR 3
#26> Mistral OCR 3 is ideal for both high-volume enterprise pipelines and interactive document workflows.
I don’t know how they can make this statement with 79% accuracy rate. For any serious use case, this is an unacceptable number.
I work with scientific journals and issues like 2.9+0.5 and 29+0.5 is something we regularly run into that has us never being able to fully trust automated processes and require human verification every step.
Re: Mistral OCR 3
#27> Mistral OCR 3 is ideal for both high-volume enterprise pipelines and interactive document workflows. I don’t know how they can make this statement with 79% accuracy rate. For any serious use case, this is an unacceptable number. I work with scientific journals and issues like 2.9+0.5 and 29+0.5 is something we regularly run into that has us never being able to fully trust automated processes and require human verif…
Where are you seeing 79% accuracy? 79% only occurs on the page as a win rate, not an accuracy
Re: Mistral OCR 3
#28there has been so many open source OCR in the last 3 months that would be good to compare to those especially when some are not even 1B params and can be run on edge devices. - paddleOCR-VL - olmOCR-2 - chandra - dots.ocr I kind of miss there is not many leaderboard sections or arena for OCR and CV and providers hosting those. Neglected on both Artificial Analysis and OpenRouter.
I spent like three hours trying to get one of these running and then gave up. I think the paddleOCR one.
It took an hour and a half to install 12 gigabytes of pytorch dependencies that can't even run on my device, and then it told me it had some sort of versioning conflict. (I think I was supposed to use UV, but I had run out of steam by that point.)
Maybe I should have asked Claude to install it for me. I gave Claude root on a $3 VPS, and it seems to enjoy the sysadmin stuff a lot more than I do...
Incidentally I had a similar experience installing open web UI... It installed 12 GB of pytorch crap.. I rage quit and deleted the whole thing, and replicated the functionality I actually needed in 100 lines of HTML.... Too bad I can't do that with OCR ;)
Re: Mistral OCR 3
#29there has been so many open source OCR in the last 3 months that would be good to compare to those especially when some are not even 1B params and can be run on edge devices. - paddleOCR-VL - olmOCR-2 - chandra - dots.ocr I kind of miss there is not many leaderboard sections or arena for OCR and CV and providers hosting those. Neglected on both Artificial Analysis and OpenRouter.
Someone posted a project here about a month ago where they compare models in head-to-head matchups similar to llmarena https://www.ocrarena.ai/leaderboard Hasn't been updated for Mistral but so far gemeni seems to top the leaderboard.
How can something have a very high ELO but a very low win rate?
Re: Mistral OCR 3
#30> Mistral OCR 3 is ideal for both high-volume enterprise pipelines and interactive document workflows. I don’t know how they can make this statement with 79% accuracy rate. For any serious use case, this is an unacceptable number. I work with scientific journals and issues like 2.9+0.5 and 29+0.5 is something we regularly run into that has us never being able to fully trust automated processes and require human verif…
Where are you seeing 79% accuracy? 79% only occurs on the page as a win rate, not an accuracy
And I believe the number is 74%, compared to OCR 2.
What matters is whether this is better than competition/alternatives. Of course nobody is just going to take the output as is. If you do that, that's your problem.