Earlier quoted context omitted.
As the post says, Google only scrapes the websites that want to be scraped. Sure, it's opt-out (via robots.txt) rather than opt-in, but they do give you a choice. You can even decide between no scraping at all and opting out on a per-scraper basis, and Google will absolutely honor your preferences in that regard. SERP API just assumes everybody wants to be scraped, and doesn't give you a choice. (whether websites sho…
requiring me to explicitly opt-out of something is NOT the same thing as getting my consent. So your argument breaks down there. You know what getting my consent would look like? Google hosting a form where i can tell them PLEASE SCRAPE MY WEBSITE and include it in your search results. That is what consent looks like. Google has never asked for my consent. Yet they expect others to behave by different rules. Now wher…
Re: Why we're taking legal action against SerpApi's unlawful scraping
#111It's never been the case that if you put something into public, then you get to reserve your right to refuse public access. Either it's public and strangers can look at it. Or it's private and you need to implement a gate.