Live data from Hacker News

Building an Internet Scale Meme Search Engine

findthatmeme.com

41–50 of 154 posts

Re: Building an Internet Scale Meme Search Engine

#46

Earlier quoted context omitted.

(Not the author) Maybe they leveraged https://knowyourmeme.com/ ? But that can't possibly have all the random memes, could it?

Author here: KnowYourMeme is one of many sites that memes are continually ingested from (any site that has memes I try to ingest regularly) :)

Nice IPhone cluster.

Have you tried something based on deep-learning that uses Transformers : https://github.com/roatienza/deep-text-recognition-benchmark (available weights are for tasks that seem similar to OCR so there is a good chance you can use it out of the box). With a good gpu it should process hundreds to thousands image per seconds, so you likely can build your index in less than a day. (Maybe you can even port it to your iphone stack :) )

https://github.com/microsoft/GenerativeImage2Text (You'll probably have to train on your custom dataset that you have constituted)

There are tons of other freely available solutions that you can get with a search for things with keywords like "image to text ocr" "transformers" "visual transformers"...

Re: Building an Internet Scale Meme Search Engine

#48
post #47

I was hoping this would help me find the Database Iceberg meme that shows different levels of database insanity. It didn’t. Anyone have a link?

This one? https://www.reddit.com/r/ProgrammerHumor/comments/wuu689/the...

Yes, that’s it, thankyou. Been searching a few days for it

Re: Building an Internet Scale Meme Search Engine

#49
I'm curious how well the iPhone OCR actually works. How do you deal with errors? Is the error rate low enough that you can accept the output from the iPhone OCR as is or do you also run it through a cleaning process (e.g. spell check)?
Post reply on HN