Hey @harper, you ever write about your vision quests?
Rarely. They are mostly bust fucking around. I will try to document the current one more. Fwiw, my recent blog is me trying to do this more
Cool!
I accidentally built a meme search engine
41–50 of 56 posts
Re: I accidentally built a meme search engine
#42Earlier quoted context omitted.
Thank you for your introduction! After creating Queryable, I also developed an app called MemeSearch, which searches for memes on Reddit ( https://apps.apple.com/us/app/memesearch-reddit-meme-finder/... ). Although it's completely free, it hasn't been downloaded by many users. I thought nobody wanted it, so I'm glad to see there are still some people who share a similar taste.
Thanks for Queryable, I use it quite often. As for Reddit meme finder, how do you deal with reddits sudden price increase for its api? Also, I think you should use another icon from this app because it looks like a goofy side project. It probably is but people would probably not download iPhone apps if the icon doesn’t look professional. (My two cents)
I made this app when the Reddit API was free : )
As for the icon, I drew it myself. I found it funny.
Re: I accidentally built a meme search engine
#43You might be interested in this, https://github.com/mazzzystar/Queryable , https://queryable.app/ I run it on my iPhone. Native app. Doesn't require a network connection (great for privacy). > Queryable is a Core ML model that runs locally on your device. Leveraging OpenAI CLIP's model encoding technology to connect images and text, you can search your iPhone photo album using any natural language input. Most importa…
Thank you for your introduction! After creating Queryable, I also developed an app called MemeSearch, which searches for memes on Reddit ( https://apps.apple.com/us/app/memesearch-reddit-meme-finder/... ). Although it's completely free, it hasn't been downloaded by many users. I thought nobody wanted it, so I'm glad to see there are still some people who share a similar taste.
Definitely! Great app!
Hadn't seen MemeSearch, downloading it now.
Re: I accidentally built a meme search engine
#44Huh, are the image vector embeddings implicitly doing OCR as well? Because it seems like the meme search is pulling from the text as well as images, though it's not entirely clear.
CLIP does not have explicit OCR support, but it does somewhat coincidentally have a slight understanding of text. This is explained by training captions containing (some of) the text that is in the image.
I think the SigLIP models' dataset (WebLi) includes OCRed things too, so they have very good text understanding. I tested a bunch of things for my own meme search engine.
Re: I accidentally built a meme search engine
#45Earlier quoted context omitted.
CLIP does not have explicit OCR support, but it does somewhat coincidentally have a slight understanding of text. This is explained by training captions containing (some of) the text that is in the image.
I think the SigLIP models' dataset (WebLi) includes OCRed things too, so they have very good text understanding. I tested a bunch of things for my own meme search engine.
(https://arxiv.org/pdf/2209.06794.pdf page 20.)
Re: I accidentally built a meme search engine
#46It's very cool to see how it's now possible to easily replicate old Google Photos features in 10 hours using open-source tools on a laptop.
I think this is based off Google research https://github.com/google-research/big_vision
The Google research was based on OpenAI research from 2021, though.
Re: I accidentally built a meme search engine
#47I apologize in advance if you're sick of hearing this, but...
I clicked through to your sites 'cause I dig your angle and I saw the bit about the kindle. Ouch, dude. Money sure ain't everything but holy crap.
You have my condolences. Keep building awesome shit, please.
edit: followup question - do you still have it?
Re: I accidentally built a meme search engine
#48Did you host any version of this on the cloud for the general public to access?
We're almost getting back to the .com era of the 2000's with some of these "public cloud" company demos. Enough frenzy, that if your app really starts grinding compute cycles you can quickly DDOS yourself with server costs. Even at $0.001/request [1], if you get 10,000 HN readers who all make 100 requests on average, you suddenly get $1000 server bill from somebody. Those used to be on /. all the time circa 2000.
If few convert, and most just tell their friends to try your cool demo, you can suddenly have 100,000 reddit users making 200+ requests on average every day cause your free demo's so cool. And suddenly you're mostly trying to figure out how to scrounge up server costs to cover the free parts.
Frankly, seems like the entire industry's probably going to have a lot of the same optimizations pretty soon. "How do we stop delivering such enormous JPGs with every Amazon/eBay click?" and similar.
[1] Slighly old article, so I lower the $/request on compute a bit from $0.0014 to $0.001. https://a16z.com/navigating-the-high-cost-of-ai-compute/
Re: I accidentally built a meme search engine
#49Last year we added CLIP-based image search to https://immich.app/ and even though I have a pretty good understanding of how it works, it still blows my mind damn near every day. It's the closest thing to magic I've ever seen.
Thanks for sharing about immich. I have a task that has been on my to-do list for several years now.
Amongst all the WhatsApp media on my phone I would like to get a list of all the videos and photos with my family in it and then delete the rest.
Is something like this possible with immich?
Re: I accidentally built a meme search engine
#50Earlier quoted context omitted.
OCR will be there at some point, but it already does a surprisingly good job without!
I'd also consider adding searching via QR codes. you could search by the content in the QR code (like the url) or if its a URL, search the content on the page of the QR code.
Why? I can't think of a use for this.