Live data from Hacker News

Llama-OCR: Document to Markdown

llamaocr.com

61–70 of 104 posts

Re: Llama-OCR: Document to Markdown

#62
post #22

Hi all, I'm the author of llama-ocr. Thank you for sharing & for the kind comments! I built this earlier this week since I wanted a simple API to do OCR – it uses llama 3.2 vision (hosted on together.ai, where i work) to parse images into structured markdown. I also have it available as an npm package. Planning to add a bunch of other features like the ability to parse PDFs, output a response in JSON, ect... If anyon…

> Need an example image? Try ours. Great idea, I wish more services would have similar feature

Re: Llama-OCR: Document to Markdown

#63
I uploaded a multi-page PDF and it did not know what to do. This is before I went to the github repo and noticed that it wasn't supported. I think the tool should let the user know when they upload a file that is not supported.

Re: Llama-OCR: Document to Markdown

#64
Here's a bit of a quirk: I uploaded a webcomic as an example, all the dialog was ALL CAPS, but the output was inconsistently either sentence case or title case between panels.

I also tried some real examples a problem I'd like to use OCR with: I've got some old slides that needs digitising, and most of them are labelled, uploading one of these provides the output:

  The image appears to be a photograph of a slide or film frame, possibly from an old camera or projector. The slide is yellowed with age and has a rectangular cutout in the center, which is filled with a dark gray or black material. The cutout is surrounded by a thin border, and there is some text written on the slide in black ink.

  The text reads "Once Upon a Time" and is written in a cursive font. It is located at the bottom of the slide, below the cutout. There is also a small number "1069" written in the same font and color, but it is not clear what this number refers to.

  Overall, the image suggests that the slide is an old photograph or film frame that has been preserved for many years. The yellowing of the slide and the cursive writing suggest that it may be from the early 20th century or earlier.
So aside from unnecessary repetitious description of the slide, (and the "yellowing" is actually just white balance being off, though I can forgive that), the actual written text (not cursive) was "Once Uniquitous." and the number was 106g. It's very clearly a 'g' and not a '9'.

What I think is interesting about this is that it might be a demonstration of biases in models, it focuses too much on the slide being an antique that it hallucinated a completely cliche title. Also, it missed the forest for the trees and that the "black square" was the slide being front-lit so the text could be read, so the transparency wasn't visible.

Additionally, the API itself seems to have file size or resolution limits that are not documented

Re: Llama-OCR: Document to Markdown

#65
So, i uploaded a HN screenshot and it showed some rendered text but where is the Markdown code? A site titles "Document to Markdown" that fails to give me the MarkDown? What am i overlooking?

Re: Llama-OCR: Document to Markdown

#68
post #67

Reading the Llama community license agreement, section "Redistribution and Use" I expected to find 'Built with Llama'. Is this not required? https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instr... links to the community license.

Why don't you think that calling the app "Llama-OCR" is good enough?

Re: Llama-OCR: Document to Markdown

#70
post #67

Reading the Llama community license agreement, section "Redistribution and Use" I expected to find 'Built with Llama'. Is this not required? https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instr... links to the community license.

Why don't you think that calling the app "Llama-OCR" is good enough?

The license is pretty specific, if the API counts as a "service".

  i. If you distribute or make available the Llama Materials (or any derivative works thereof), or a product or service (including another AI model) that contains any of them, you shall (A) provide a copy of this Agreement with any such Llama Materials; and (B) prominently display “Built with Llama” on a related website, user interface, blogpost, about page, or product documentation.
Post reply on HN