31–34 of 34 posts
The variety of sources seems extremely minimal and the majority of the data appears to be coming from Amazon.
When I sampled the data (pulling products from each topic), less than 1% of the products had data from a source other than Amazon.
Even so, very fun and interesting service. Look forward to playing around more.
How does this work? Is there a database of the most popular online stores and you're constantly scraping (or GETing) product data?
We aggregate data from a variety of sources (crawling, data dumps, rss feeds, and in some cases even manual curation) after which we integrate them into our data pipeline. We update them using a power law distribution, where the top 1% of best selling products (based on our internal ranking system) is updated hourly, the next 3% updated every two hours, etc.. The whole index is refreshed at the end of each month.
Here are two real problems you can tackle for online retailers: Retailers can often get product data directly from the manufacturer. This is true 100% of the time when the retailer is drop-shipping. The problem isn't really obtaining this data but the canned data you get is pretty worthless. Thousands of online retailers were hit hard by the Panda update (some time ago) because they all used the exact same descriptio…
It's worth it if you don't have a ton of development resources and are trying to get exposure fast.
However, if you can do it yourself, you can take advantage of optimizations you just can't get from canned solutions.
Also, all your competitors don't have the same advantages you do.
Earlier quoted context omitted.
We don't have books yet. That's been a common request, so we'll be launching with books by the end of the month. If you'd like, I can notify you as soon as we do.
Books would be great - could you notify me too? srmorrisonjit at google's email
Please check out the Book Prices API from DataWeave here: http://www.dataweave.in/apis/dataset-Book-Price-Search-By-IS... (Full Disclosure: I am an employee of DataWeave). Currently, we are serving data from Indian eCommerce stores, but expansion to other geographies is in the pipeline. You can search by ISBN as well as many other fields.