Live data from Hacker News

Show HN: AI powered meme search, open-source

examples.jina.ai

21–30 of 34 posts

Re: Show HN: AI powered meme search, open-source

#21

I wanted this meme : https://knowyourmeme.com/memes/for-five-minutes "Shrek 5 minutes" None of the results is Shrek. Ok... may be something simpler: "Shrek" Same...

You can see this link. It explains why the meme search still needs a bit of work: http://examples.jina.ai:8501/?tab=Dude,%20this%20meme%20sear...

Re: Show HN: AI powered meme search, open-source

#22
post #10
post #4

Searching on google for old english meme immediately pulls up a bunch of Joseph Ducreux memes which is exactly what I was looking for. But this one does not return any. Are they not present in the dataset or could it be because of the way the algorithm works? Interested to hear some details on this setup.

Since I helped build it, I'll explain :) This example is quick and dirty, indexing only about 1,000 images from a dataset we pulled from Kaggle. So if results suck, that's due to either the meme you search for not being in the dataset, or it just didn't get indexed in the random batch of 1,000.

I see. 1000 is probably a bit less to showcase a search concept but this is definitely a very interesting problem.

Re: Show HN: AI powered meme search, open-source

#24
post #22
post #10

Earlier quoted context omitted.

Since I helped build it, I'll explain :) This example is quick and dirty, indexing only about 1,000 images from a dataset we pulled from Kaggle. So if results suck, that's due to either the meme you search for not being in the dataset, or it just didn't get indexed in the random batch of 1,000.

I see. 1000 is probably a bit less to showcase a search concept but this is definitely a very interesting problem.

I'm indexing 10k as we speak. At least for text. Indexing 10k images will take a bit longer.

Re: Show HN: AI powered meme search, open-source

#25
post #11
post #5

Earlier quoted context omitted.

Is this comment on the wrong post?

I guess this comment was meant for https://notegarden.web.app/ on https://news.ycombinator.com/item?id=28400446

I first read it there: https://news.ycombinator.com/item?id=28401258

Re: Show HN: AI powered meme search, open-source

#26
post #23

This is a text to image search using deep learning, vector similarity search. Ask me anything.

What in your system is doing the text-to-vector encoding, and how did you train it?

We're using Transformers with `sentence-transformers/paraphrase-distilroberta-base-v1` model.

The framework is Jina (https://github.com/jina-ai/jina/) so it's pretty high-level. You can see the indexing/search Flow on lines 37-52 of https://github.com/alexcg1/jina-meme-search-example/blob/mai...

Re: Show HN: AI powered meme search, open-source

#27
post #24
post #22

Earlier quoted context omitted.

I see. 1000 is probably a bit less to showcase a search concept but this is definitely a very interesting problem.

I'm indexing 10k as we speak. At least for text. Indexing 10k images will take a bit longer.

10k memes are now indexed for text. So if you search for Wonka memes you'll get a lot better results.

Also swapped out the model

Re: Show HN: AI powered meme search, open-source

#28
post #23

This is a text to image search using deep learning, vector similarity search. Ask me anything.

What in your system is doing the text-to-vector encoding, and how did you train it?

We rely on pre-trained models at the moment, since Jina supports loads of them out of the box.

For image search we use Big Transfer Encoder (https://github.com/jina-ai/executors/tree/main/jinahub/encod...) but may switch to CLIPImage encoder at some point

Post reply on HN