Live data from Hacker News

Show HN: OCR Arena – A playground for OCR models

ocrarena.ai

31–40 of 65 posts

Re: Show HN: OCR Arena – A playground for OCR models

#32
post #29

I suggest you make explicit the assumption that this website is specifically about English text. Otherwise the leaderboard is pretty meaningless, with extreme differences in performance across other scripts - and potentially even languages such as Vietnamese or Czech which use Latin but have lots of accents.

That's unfortunate because I have a bunch of photos with handwritten German on the back that I need to transcribe, and seeing as that I can't read German I can't really do it by myself either.

Re: Show HN: OCR Arena – A playground for OCR models

#33

FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?

ideally we want people to rate based on quality - but i imagine some of the results are biased rn based on loading time

That's an easy fix if you wait for the slowest one and pop them both in at the same time, no?

Re: Show HN: OCR Arena – A playground for OCR models

#36

Really like the idea. Unfortunately, my first upload is still spinning on one of the models about 5 minutes in. Clicking "Stop Battle" seems to do nothing either

Hey, I'm the dev who built this! Looking into it. Wondering if it's because of load due to this post.

Re: Show HN: OCR Arena – A playground for OCR models

#37

I've been really impressed with this model specifically because of how insanely cheap it is: https://replicate.com/ibm-granite/granite-vision-3.3-2b I didn't expect IBM to be making relevant AI models but this thing is priced at $1 per 4,000,000 output tokens... I'm using it to transcribe handwritten input text and it works very well and super fast.

I'm the dev who made this:) We are looking into adding granite!

Re: Show HN: OCR Arena – A playground for OCR models

#38
post #29

I suggest you make explicit the assumption that this website is specifically about English text. Otherwise the leaderboard is pretty meaningless, with extreme differences in performance across other scripts - and potentially even languages such as Vietnamese or Czech which use Latin but have lots of accents.

Hey! I'm the dev who made this:) I think that you are right, data will bias towards english because we have a dataset that people can use that is in english. But you can also upload non-english docs into the battle mode as well as the playground!

Re: Show HN: OCR Arena – A playground for OCR models

#39

Two suggestions: UX on mobile isn’t great. It wasn’t obvious to me where the second model output was and I was thrown off even more so because the option to vote for model 1 output was presented without ever even seeing model two output. Second suggestion would be to install a MathJax plugin so one can properly rate mathematical equations and formulas. Raw LATeX is easy to mistake and it makes comparing between LATeX…

Hey! Dev who made this here. I hear you on the mobile UX, it's on my docket of things to fix. Same with math plugin! Thanks for the suggestions.
Post reply on HN