Viewing profile — mateozaratefw

Tik Tok crawler fucked us up by taking a product-name (e-commerce) and inserting it into the search bar recursively with the results page. Respect the game, but not respecting the …

:o

We do that with MercadoLibre (way smaller Amazon for latam) and the limit they pagination results to 40 pages/2000 products. Never thought of the faceted search approach. Thanks fo…

Thanks! sounds hard asf. I believe we can handle the inconsistence problem because we want the products (so it'll be really general), however i don't think Amazon can list all thei…

The core of my startup is product data mining, and we have a really good suite of anti-bot tech. However, we need help crawling big sites like Amazon or eBay. Not because of the an…