Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: OCR Arena – A playground for OCR models

ocrarena.ai

Post reply on HN
Print view View original

11–20 of 65 posts

Re: Show HN: OCR Arena – A playground for OCR models

#11

Post by ArcaneMoose »

I've been really impressed with this model specifically because of how insanely cheap it is: https://replicate.com/ibm-granite/granite-vision-3.3-2b

I didn't expect IBM to be making relevant AI models but this thing is priced at $1 per 4,000,000 output tokens... I'm using it to transcribe handwritten input text and it works very well and super fast.

Re: Show HN: OCR Arena – A playground for OCR models

#14

Post by kbyatnal »

codeddesign wrote: post #12

Most of these are general LLM’s and not specifically OCR models. Where is Google Vision, Mistral, Paddle, Nanonets, or Chandra??

We wanted to keep the focus on (1) foundation VLMs and (2) open source OCR models.

We had Mistral previously but had to remove it because their hosted API for OCR was super unstable and returned a lot of garbage results unfortunately.

Paddle, Nanonets, and Chandra being added shortly!

Re: Show HN: OCR Arena – A playground for OCR models

#16

Post by andrewlu0 »

fzysingularity wrote: post #8

FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?

ideally we want people to rate based on quality - but i imagine some of the results are biased rn based on loading time

Re: Show HN: OCR Arena – A playground for OCR models

#17

Post by kbyatnal »

fzysingularity wrote: post #8

FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?

Ultimately, there’s some intersection of accuracy x cost x speed that’s ideal, which can be different per use case. We’ll surface all of those metrics shortly so that you can pick the best model for the job along those axes.
Post reply on HN