Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral OCR

mistral.ai

Post reply on HN
Print view View original

171–180 of 450 posts

Re: Mistral OCR

#171

Post by d_llon »

It's disappointing to see that the benchmark results are so opaque. I hope we see reproducible results soon, and hopefully from Mistral themselves.

1. We don't know what the evaluation setup is. It's very possible that the ranking would be different with a bit of prompt engineering.

2. We don't know how large each dataset is (or even how the metrics are calculated/aggregated). The metrics are all reported as XY.ZW%, but it's very possible that the .ZW% -- or even Y.ZW% -- is just noise.[1]

3. We don't know how the datasets were mined or filtered. Mistral could have (even accidentally!) filtered out particularly data points that their model struggled with. (E.g., imagine good-meaning engineer testing a document with Mistral OCR first, finding it doesn't work, and deducing that it's probably bad data and removing it.)

[1] https://medium.com/towards-data-science/digit-significance-i...

Re: Mistral OCR

#172

Post by s4i »

I wonder how good it would be to convert sheet music to MusicXML. All the current tools more or less suck with this task, or maybe I’m just ignorant and don’t know what lego bricks to put together.

Re: Mistral OCR

#173

Post by gl-prod »

resiros wrote: post #146
evmar wrote: post #129

I noticed on the Arabic example they lost a space after the first letter on the third to last line, can any native speakers confirm? (I only know enough Arabic to ask dumb questions like this, curious to learn more.) Edit: it looks like they also added a vowel mark not present in the input on the line immediately after. Edit2: here's a picture of what I'm talking about, the before/after: https://ibb.co/v6xcPMHv

Arabic speaker here. No, it's perfect.

He means the space between the wāw (و) and the word

Re: Mistral OCR

#174

Post by beklein »

odiroot wrote: post #94
vessenes wrote: post #4

Dang. Super fast and significantly more accurate than google, Claude and others. Pricing : $1/1000 pages, or per 2k pages if “batched”. I’m not sure what batching means in this case: multiple pdfs? Why not split them to halve the cost? Anyway this looks great at pdf to markdown.

May I ask as a layperson, how would you about using this to OCR multiple hundreds of pages? I tried the chat but it pretty much stops after the 2nd page.

You can check the example code on the Mistral documentation, you would _only_ have to change the value of the variable `document_url` to the URL of your uploaded PDF... and you need to change the `MISTRAL_API_KEY` to the value of your specific key that you can get from the Le Platforme webpage.

https://docs.mistral.ai/capabilities/document/#ocr-with-pdf

Re: Mistral OCR

#175

Post by gl-prod »

evmar wrote: post #168
resiros wrote: post #146

Earlier quoted context omitted.

Arabic speaker here. No, it's perfect.

I am pretty sure it added a kasrah not present in the input on the 2nd to last line. (Not saying it's not super impressive, and also that almost certainly is the right word, but I think that still means not quite "perfect"?)

Yes, it looks like it did add a kasrah to the word ظهري

Re: Mistral OCR

#177

Post by jgalt212 »

qwertox wrote: post #167

We developers seem to really dislike PDFs, to a degree that we'll build LLMs and have them translate it into Markdown. Jokes aside, PDFs really serve a good purpose, but getting data out of them is usually really hard. They should have something like an embedded Markdown version with a JSON structure describing the layout, so that machines can easily digest the data they contain.

I think you might be looking for PDF/A.

https://www.adobe.com/uk/acrobat/resources/document-files/pd...

For example, if you print a word doc to PDF, you get the raw text in PDF form, not an image of the text.

Re: Mistral OCR

#179

Post by shmoogy »

What's the general time for something like this to hit openrouter? I really hate having accounts everywhere when I'm trying to test new things.

Re: Mistral OCR

#180

Post by bondolo »

Such a shame that PDF doesn’t just, like, include the semantic structure of the document by default. It is brilliant that we standardized on an archival document format that doesn’t include direct access to the document text or structure as a core intrinsic default feature.

I say this with great anger as someone who works in accessibility and has had PDF as a thorn in my side for 30 years.

Post reply on HN