Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral OCR 3

mistral.ai

Post reply on HN
Print view View original

61–70 of 137 posts

Re: Mistral OCR 3

#61

Post by speff »

This might be a good place to check the options available for OCR in-place translations. I took a look at OCR3, but it doesn't seem to support my use-case. It looks more tailored towards data extraction for further processing.

I've got some foreign artbooks that I would like to get translated. The translations would need to be in place since the placement of the text relative to the pictures around it is fairly important. I took a look at some paid options online, but they seemed to choke - mostly because of the non-standard text placements and all.

The best solution I could come up with is using Google Lens to overlay a translation while I go through the books, but holding a camera/tablet up to my screen isn't very comfortable. Chrome has Lens built in, but (IIRC) I still need to manually select sections for it to translate - it's not as easy to use as just holding my phone up.

Anyone know of any progress towards in-place OCR/translations?

Re: Mistral OCR 3

#62

Post by 650REDHAIR »

7thpower wrote: post #51

My main beef with mistral is that they don’t bother to respond to customer inquiries for products the hide behind “reach out for pricing” terms, so even if they were better than SoTA it wouldn’t really matter.

I absolutely loathe dealing with sales people.

I will pay a premium for an inferior product or service if it means I don't have to deal with sales people.

Re: Mistral OCR 3

#63

Post by temp0826 »

culi wrote: post #59
temp0826 wrote: post #55

My current holy grail is my attempt to convert a Shipibo (an indigenous Peruvian language)-to-Spanish dictionary into a Shipibo-to-English dictionary. The pdf I have (available freely on archive.org) isn't a great scan (though I think it'd be a heck of a lot easier than some of the handwritten examples they show). Layout (2-columns) along with header/footers can cause some headaches, but it is all Latin script. This…

I'm assuming you're interested in studying Ayahuasca traditions? I recently learned that traditionally in Shipibo culture, ayahuasca was never meant to be given to "the normal mind". Instead the maestras would be the ones taking the ayahuasca in order to help guide them into diagnosing people dealing with various sicknesses. These maestras were also ranked by how many different plants they'd done a dieta on. A dieta…

Yes essentially. I've got a few resources cobbled together over the last few years but it'd be really nice to have this reference (my Spanish isn't the best, and running to the translator for a definition can be a little annoying). Also to share with fellow learners/apprentices I know. There are a couple of classes out there (which are actually geared more toward the ceremonial/icaro language, not purely conversational Shipibo, which is a bit simpler as you don't need to worry as much about conjugation and other complexities) which I might look into eventually.

(Fwiw I've accumulated a couple years worth of dieta under my belt and am well aware of the restrictions! It's indeed very fascinating, been pretty serious about it the last few years and I've barely scratched the surface)

Re: Mistral OCR 3

#64

Post by vikp »

numlocked wrote: post #19
film42 wrote: post #10

Is open router still sending all OCR jobs to Mistral? I wonder if they're trying to keep that spot. Seems like Mistral and Google are the best at OCR right now, with Google leading Mistral by a fair bit.

(I work at OpenRouter) If you send a PDF to our API we will: 1. Use native PDF parsing if the model supports it 2. Use this Mistral OCR model (we updated to this version yesterday) 3. UNLESS you override the "engine" param to use an alternate. We support a JS-based (non-LLM) parser as well [0] So yes, in practice a lot of OCR jobs go to Mistral, but not all of them. Would love to hear requests for other parsers if fo…

Hey, I'm the founder of Datalab (we released Chandra OCR). I see someone requested it below - happy to help you all get setup. I'm vik@datalab.to

Re: Mistral OCR 3

#65

Post by claar »

speff wrote: post #61

This might be a good place to check the options available for OCR in-place translations. I took a look at OCR3, but it doesn't seem to support my use-case. It looks more tailored towards data extraction for further processing. I've got some foreign artbooks that I would like to get translated. The translations would need to be in place since the placement of the text relative to the pictures around it is fairly impor…

If you don't mind a paid solution, try DEEPL. I also use Word's built in document translation to good effect.

Re: Mistral OCR 3

#66

Post by speff »

claar wrote: post #65
speff wrote: post #61

This might be a good place to check the options available for OCR in-place translations. I took a look at OCR3, but it doesn't seem to support my use-case. It looks more tailored towards data extraction for further processing. I've got some foreign artbooks that I would like to get translated. The translations would need to be in place since the placement of the text relative to the pictures around it is fairly impor…

If you don't mind a paid solution, try DEEPL. I also use Word's built in document translation to good effect.

I don't mind paying for one, though I do remember trying DEEPL without much success. Can't remember the problem offhand, but one of the services I tried just gave me a generic error when I uploaded the PDF. My view at the time was that it had a conniption and just gave up.

Wonder if Word uses the same system Edge has. I remember Edge was also good, but like Chrome's Lens, I'd need to highlight sections for it to get translated. Edge also OCR'd everything very well - just didn't do the translation part automatically.

Re: Mistral OCR 3

#67

Post by 7thpower »

650REDHAIR wrote: post #62
7thpower wrote: post #51

My main beef with mistral is that they don’t bother to respond to customer inquiries for products the hide behind “reach out for pricing” terms, so even if they were better than SoTA it wouldn’t really matter.

I absolutely loathe dealing with sales people. I will pay a premium for an inferior product or service if it means I don't have to deal with sales people.

Agreed. In this case the offering just fit neatly into a non core stack we had designed and displaced a bunch of stuff didn’t want to build ourselves.

I also hate dealing with sales people and am not going to reach out to them via another avenue as they will try and posture as if they’re doing us a huge favor (in contrast to me begging gdb for gpt4 api access).

Re: Mistral OCR 3

#68

Post by CamperBob2 »

andai wrote: post #28
pzo wrote: post #2

there has been so many open source OCR in the last 3 months that would be good to compare to those especially when some are not even 1B params and can be run on edge devices. - paddleOCR-VL - olmOCR-2 - chandra - dots.ocr I kind of miss there is not many leaderboard sections or arena for OCR and CV and providers hosting those. Neglected on both Artificial Analysis and OpenRouter.

I spent like three hours trying to get one of these running and then gave up. I think the paddleOCR one. It took an hour and a half to install 12 gigabytes of pytorch dependencies that can't even run on my device, and then it told me it had some sort of versioning conflict. (I think I was supposed to use UV, but I had run out of steam by that point.) Maybe I should have asked Claude to install it for me. I gave Claud…

gemini-cli is good for this sort of thing. You can just tell it "Find out why xyz.py doesn't run" and let it crunch. It will try reasonably hard to get you out of Python dependency hell, and (more important) it generally knows when to give up.

But yes, in general, you want to use uv. Otherwise, the next Python application you install WILL break the last one you installed.

I suppose you could use gemini-cli as a substitute for proper Python virtual environment management, always letting it fix whatever broke since the last time you tried to run the program, but that'd be like burning down a rainforest to toast a marshmallow.

Re: Mistral OCR 3

#69

Post by siquick »

numlocked wrote: post #19
film42 wrote: post #10

Is open router still sending all OCR jobs to Mistral? I wonder if they're trying to keep that spot. Seems like Mistral and Google are the best at OCR right now, with Google leading Mistral by a fair bit.

(I work at OpenRouter) If you send a PDF to our API we will: 1. Use native PDF parsing if the model supports it 2. Use this Mistral OCR model (we updated to this version yesterday) 3. UNLESS you override the "engine" param to use an alternate. We support a JS-based (non-LLM) parser as well [0] So yes, in practice a lot of OCR jobs go to Mistral, but not all of them. Would love to hear requests for other parsers if fo…

That links gives an error and so does https://openrouter.ai/docs/guides/overview/multimodal/pdfs

Re: Mistral OCR 3

#70

Post by argsnd »

tecoholic wrote: post #58
MallocVoidstar wrote: post #27

Earlier quoted context omitted.

Where are you seeing 79% accuracy? 79% only occurs on the page as a win rate, not an accuracy

Right! I didn’t know the difference. Does it mean for 79 out of 100 documents they produce 100% accurate OCR, I doubt it. The win rate sounds like a practical approximation of accuracy here to me. If I am wildly off, I am happy to learn.

79 out of 100 documents Mistral OCR 3 provides better output than Mistral OCR 2.
Post reply on HN