Earlier quoted context omitted.
I would guess that tests in this sentence refers to tests of the iOS app on the simulator. Which would be slow expectedly
I would think it would run well on a M1/M2 Mac as a native app though, right?
Building an Internet Scale Meme Search Engine
101–110 of 154 posts
Re: Building an Internet Scale Meme Search Engine
#102This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?
It reminds me a little of https://www.beeper.com/ . It allows you to read iMessages on Android and other platforms. To make this work, they will ship you some old iPhone to act as a server "bridge": https://twitter.com/ericmigi/status/1351934418961661959 If it works, it works. But it also speaks volumes about Apple's disregard/inexperience with exposing their stuff via the web - https://www.icloud.com/ being the prim…
Re: Building an Internet Scale Meme Search Engine
#103Love the hackiness of this - however, the vision framework is available on Desktop macs as well - https://developer.apple.com/documentation/vision and specifically: https://developer.apple.com/documentation/vision/vnrecognize...
Re: Building an Internet Scale Meme Search Engine
#104Works great for me.
It's kind of like trying to come up with a good Google search phrase, based on how other people must have phrased something, but relying on knowledge of how you phrase things instead.
Re: Building an Internet Scale Meme Search Engine
#105Re: Building an Internet Scale Meme Search Engine
#106Do you use mongodb to make it web scale? You turn it on and it scales right up.
Re: Building an Internet Scale Meme Search Engine
#107Love the hackiness of this - however, the vision framework is available on Desktop macs as well - https://developer.apple.com/documentation/vision and specifically: https://developer.apple.com/documentation/vision/vnrecognize...
What's the cost of building and running a cluster of iPhones vs Mac Minis?
Re: Building an Internet Scale Meme Search Engine
#108Earlier quoted context omitted.
Author here: KnowYourMeme is one of many sites that memes are continually ingested from (any site that has memes I try to ingest regularly) :)
Nice IPhone cluster. Have you tried something based on deep-learning that uses Transformers : https://github.com/roatienza/deep-text-recognition-benchmark (available weights are for tasks that seem similar to OCR so there is a good chance you can use it out of the box). With a good gpu it should process hundreds to thousands image per seconds, so you likely can build your index in less than a day. (Maybe you can even…
Re: Building an Internet Scale Meme Search Engine
#109This title really undersells the absolute insanity of the described solution. This is a beautiful example of "if it's stupid, but it works, it's not stupid." The justification is very convincing. One thing I'm curious about: how did you build your corpus of meme images and videos?
(Not the author) Maybe they leveraged https://knowyourmeme.com/ ? But that can't possibly have all the random memes, could it?
Re: Building an Internet Scale Meme Search Engine
#110If so, is there any risk in getting your account suspended or ip range banned somehow because of this, for example?