I accidentally built a meme search engine
harper.blog
I accidentally built a meme search engine
1–10 of 56 posts
Re: I accidentally built a meme search engine
#2Interesting, I knew about something similar but more focused on server side:
https://github.com/simon987/sist2
Re: I accidentally built a meme search engine
#3Last year we added CLIP-based image search to https://immich.app/ and even though I have a pretty good understanding of how it works, it still blows my mind damn near every day. It's the closest thing to magic I've ever seen.
Re: I accidentally built a meme search engine
#4Gives me an idea for a meme search service I can use locally to search through all the images on my computer to find a specific meme (I tend to know I downloaded a funny one and then when I want to share it with someone I can never find it)
Re: I accidentally built a meme search engine
#5I want to do this but for 30GB of PDFs
Re: I accidentally built a meme search engine
#6Did you host any version of this on the cloud for the general public to access?
Re: I accidentally built a meme search engine
#7Huh, are the image vector embeddings implicitly doing OCR as well? Because it seems like the meme search is pulling from the text as well as images, though it's not entirely clear.
Re: I accidentally built a meme search engine
#8Huh, are the image vector embeddings implicitly doing OCR as well? Because it seems like the meme search is pulling from the text as well as images, though it's not entirely clear.
CLIP does not have explicit OCR support, but it does somewhat coincidentally have a slight understanding of text. This is explained by training captions containing (some of) the text that is in the image.
Re: I accidentally built a meme search engine
#9This is awesome! We made similar functionality (plus more) available through an API. If anyone is interested to try it out and share feedback, please message me and I’ll hook you up.
Re: I accidentally built a meme search engine
#10Last year there was also a very funny project of meme search engine leveraging an iPhone farm:
https://findthatmeme.com/blog/2023/01/08/image-stacks-and-ip...