Building an Internet Scale Meme Search Engine
findthatmeme.com
Building an Internet Scale Meme Search Engine
1–10 of 154 posts
Re: Building an Internet Scale Meme Search Engine
#2This is remarkable. I'd love to see that combined with some kind of sentiment analysis like Microsoft offers, just to see if something useful comes out of it.
Sometimes, I don’t know the exact words when looking for a meme, but once I see it, I know that’s the one.
Re: Building an Internet Scale Meme Search Engine
#3Would love to see that load balancer implementation, as I'm a scrub and this project fascinates me.
Re: Building an Internet Scale Meme Search Engine
#4This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing.
One thing I'm curious about: how did you build your corpus of meme images and videos?
Re: Building an Internet Scale Meme Search Engine
#5My #1 recommendation for anyone thinking about the convoluted OCR solution: use a cheap OCR API and save yourself months of time / hassle / upkeep. Google's OCR API is a good place to start, but AWS has one too and dozens of others out there.
Re: Building an Internet Scale Meme Search Engine
#6Would love to see that load balancer implementation, as I'm a scrub and this project fascinates me.
nginx makes it really simple to setup a load balancer, it defaults to distributing requests equally between all upstream hosts but you can always assign weights to each of your server. https://docs.nginx.com/nginx/admin-guide/load-balancer/http-...
Re: Building an Internet Scale Meme Search Engine
#7This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?
(Not the author) Maybe they leveraged https://knowyourmeme.com/? But that can't possibly have all the random memes, could it?
Re: Building an Internet Scale Meme Search Engine
#8My #1 recommendation for anyone thinking about the convoluted OCR solution: use a cheap OCR API and save yourself months of time / hassle / upkeep. Google's OCR API is a good place to start, but AWS has one too and dozens of others out there.
Without this "convoluted OCR solution" it never would have been built. Mandatory would have easily had to spend hundreds of thousands of dollars to OCR his meme collection alone, even without scraping other meme sites.
Re: Building an Internet Scale Meme Search Engine
#9The photo under Upgrading the iPhone OCR Service Into An OCR Cluster. In the future, data centres are going to host racks of iPhones.
Re: Building an Internet Scale Meme Search Engine
#10This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?
(Not the author) Maybe they leveraged https://knowyourmeme.com/ ? But that can't possibly have all the random memes, could it?
Author here: KnowYourMeme is one of many sites that memes are continually ingested from (any site that has memes I try to ingest regularly) :)