41–50 of 286 posts
I was about to 'reviews' as well in the above list but decided not to as they are not always trustworthy. Now AI is so advanced, that it can be used to detect fake reviews and ignore them from sampling.
I love your approach; you found a problem and developed a solution for it. And then you got the courage to share with the larger technical community. Good on you. There's obviously some rough edges (multiple duplicate products, issues with product links linking to empty pages, and no results for broad terms), but don't let that stop you. I'm certain they can all be fixed. Keep going! At the least, you'll come out of…
Earlier quoted context omitted.
Why? They're cataloguing public data. Do you think the same of search engines - which are equally scraping the web? If it's not useful to you, nobody is forcing you to use this product.
You really didn't think about this. Search engine crawlers are specifically designed to ignore sites that have the right setups. In other words: they try to be good citizens of the web. Data scrapers on the other hand are known to steal others IP and use it to jump start their own services. When you do that you're using all the bandwidth of the site while devaluing everything they've built. They will have invested si…
I need to be able to filter search to if it will deliver to my country.
It desperately needs some indication that your action is being processed, like a spinner, when you search.
Agora also doesn't return red shoes for the search query "red shoes". Seems like you haven't fully solved the problem yet :) From a technical perspective, crawling 25M products is impressive but the search itself doesn't provide much value to me. I already use large e-commerce sites (amazon, wallmart, ...) and targeted ones (Nordstrom, SSENSE, ...). Sure I may not be searching through all the shopify, wix stores but…
Definitely have not solved the problem yet! The search algorithm prioritizes the brand called "Red Wing Shoe" so still figuring out ways to show real 'red shoes'. Have been thinking about passing the images through a detection tool and tag them to enhance the search experience. Re: Value Proposition. Absolutely, I think focusing on the SMB-angle and 'local shopping' will help direct users better. I'll definitely take…
wow! Nice work. I've been trying to build an index of shopify stores. Did you search for all domains pointing to shopify's name servers?
You may try using BuiltWith which is a paid service:
Do you plan to add filters: price etc? I was about to 'reviews' as well in the above list but decided not to as they are not always trustworthy. Now AI is so advanced, that it can be used to detect fake reviews and ignore them from sampling.
There are 'reviews' now and made the decision to only let authenticated users leave users so they are more trustworthy (i.e. thinking is that adding more friction will lead to higher quality reviews).
That's funny, I made a domain-specific version of this for canadian coffee deals. https://beangrid.mcconomy.org/