We tried this and it was an absolute shit show for us.
Llama-OCR: Document to Markdown
61–70 of 104 posts
Re: Llama-OCR: Document to Markdown
#62Hi all, I'm the author of llama-ocr. Thank you for sharing & for the kind comments! I built this earlier this week since I wanted a simple API to do OCR – it uses llama 3.2 vision (hosted on together.ai, where i work) to parse images into structured markdown. I also have it available as an npm package. Planning to add a bunch of other features like the ability to parse PDFs, output a response in JSON, ect... If anyon…
Re: Llama-OCR: Document to Markdown
#63Re: Llama-OCR: Document to Markdown
#64I also tried some real examples a problem I'd like to use OCR with: I've got some old slides that needs digitising, and most of them are labelled, uploading one of these provides the output:
The image appears to be a photograph of a slide or film frame, possibly from an old camera or projector. The slide is yellowed with age and has a rectangular cutout in the center, which is filled with a dark gray or black material. The cutout is surrounded by a thin border, and there is some text written on the slide in black ink.
The text reads "Once Upon a Time" and is written in a cursive font. It is located at the bottom of the slide, below the cutout. There is also a small number "1069" written in the same font and color, but it is not clear what this number refers to.
Overall, the image suggests that the slide is an old photograph or film frame that has been preserved for many years. The yellowing of the slide and the cursive writing suggest that it may be from the early 20th century or earlier.
So aside from unnecessary repetitious description of the slide, (and the "yellowing" is actually just white balance being off, though I can forgive that), the actual written text (not cursive) was "Once Uniquitous." and the number was 106g. It's very clearly a 'g' and not a '9'.What I think is interesting about this is that it might be a demonstration of biases in models, it focuses too much on the slide being an antique that it hallucinated a completely cliche title. Also, it missed the forest for the trees and that the "black square" was the slide being front-lit so the text could be read, so the transparency wasn't visible.
Additionally, the API itself seems to have file size or resolution limits that are not documented
Re: Llama-OCR: Document to Markdown
#65Re: Llama-OCR: Document to Markdown
#66Re: Llama-OCR: Document to Markdown
#67https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instr... links to the community license.
Re: Llama-OCR: Document to Markdown
#68Reading the Llama community license agreement, section "Redistribution and Use" I expected to find 'Built with Llama'. Is this not required? https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instr... links to the community license.
Re: Llama-OCR: Document to Markdown
#69Re: Llama-OCR: Document to Markdown
#70Reading the Llama community license agreement, section "Redistribution and Use" I expected to find 'Built with Llama'. Is this not required? https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instr... links to the community license.
Why don't you think that calling the app "Llama-OCR" is good enough?
i. If you distribute or make available the Llama Materials (or any derivative works thereof), or a product or service (including another AI model) that contains any of them, you shall (A) provide a copy of this Agreement with any such Llama Materials; and (B) prominently display “Built with Llama” on a related website, user interface, blogpost, about page, or product documentation.