Live data from Hacker News

Building an Internet Scale Meme Search Engine

findthatmeme.com

101–110 of 154 posts

Re: Building an Internet Scale Meme Search Engine

#101
post #94

Earlier quoted context omitted.

I would guess that tests in this sentence refers to tests of the iOS app on the simulator. Which would be slow expectedly

I would think it would run well on a M1/M2 Mac as a native app though, right?

That was my question as well. I'm wondering how much of a performance benefit the neural engine has on M series chips when compared to intel chips.

Re: Building an Internet Scale Meme Search Engine

#102

This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?

It reminds me a little of https://www.beeper.com/ . It allows you to read iMessages on Android and other platforms. To make this work, they will ship you some old iPhone to act as a server "bridge": https://twitter.com/ericmigi/status/1351934418961661959 If it works, it works. But it also speaks volumes about Apple's disregard/inexperience with exposing their stuff via the web - https://www.icloud.com/ being the prim…

I think I've seen a post from https://texts.com about that they. I don't think they ship you the iPhone though, the host it themselves.

Re: Building an Internet Scale Meme Search Engine

#103

Love the hackiness of this - however, the vision framework is available on Desktop macs as well - https://developer.apple.com/documentation/vision and specifically: https://developer.apple.com/documentation/vision/vnrecognize...

What's the cost of building and running a cluster of iPhones vs Mac Minis?

Re: Building an Internet Scale Meme Search Engine

#104
I have a "hackish but works for me" meme database: I use my Telegram "self chat" to send memes I like to myself, and I tag them with the kind of words I'm likely to search for when looking for them later.

Works great for me.

It's kind of like trying to come up with a good Google search phrase, based on how other people must have phrased something, but relying on knowledge of how you phrase things instead.

Re: Building an Internet Scale Meme Search Engine

#107

Love the hackiness of this - however, the vision framework is available on Desktop macs as well - https://developer.apple.com/documentation/vision and specifically: https://developer.apple.com/documentation/vision/vnrecognize...

What's the cost of building and running a cluster of iPhones vs Mac Minis?

in the article $40 second hand, imei banned and broken screen iPhones are being used so...

Re: Building an Internet Scale Meme Search Engine

#108

Earlier quoted context omitted.

Author here: KnowYourMeme is one of many sites that memes are continually ingested from (any site that has memes I try to ingest regularly) :)

Nice IPhone cluster. Have you tried something based on deep-learning that uses Transformers : https://github.com/roatienza/deep-text-recognition-benchmark (available weights are for tasks that seem similar to OCR so there is a good chance you can use it out of the box). With a good gpu it should process hundreds to thousands image per seconds, so you likely can build your index in less than a day. (Maybe you can even…

Personally, I've been hunting for something that can extract both the text and the associated image. I've never seen anything that can do both.

Re: Building an Internet Scale Meme Search Engine

#109

This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?

(Not the author) Maybe they leveraged https://knowyourmeme.com/ ? But that can't possibly have all the random memes, could it?

OP’s meme site lists where each image comes from. Looking through it I mainly see ifunny and 9gag.

Re: Building an Internet Scale Meme Search Engine

#110
Does the Vision API call back to apple servers in any fashion? Like how google on-device voice recognition APIs will call back to Google when you are online (unless you explicitly pass flags to force it in offline mode).

If so, is there any risk in getting your account suspended or ip range banned somehow because of this, for example?

Post reply on HN