Earlier quoted context omitted.
Do you have a source for this claim? Cloudflare gives me endless captchas on almost any website.
Yes, I bought a cheap residential proxy service and used it to scrape a site.
google.com/goto: Google's anti-scraping update
351–360 of 545 posts
Re: google.com/goto: Google's anti-scraping update
#352Earlier quoted context omitted.
Didn't Google take it down because of copyright? With the rise of paywalls it became a backdoor around them, but Google doesn't actually have a license to republish the copyrighted text they scraped.
It's not a backdoor is the sites intentionally served Google a version without the paywall so the indexing got "better" than what real users got. The sites kind of dug their own hole here, Google wouldn't even sit on the content unless it was offered up to them in that way.
Re: google.com/goto: Google's anti-scraping update
#353Re: google.com/goto: Google's anti-scraping update
#354So why are we angry about that ? I mean the end result for the users are exactly the same, it matters only for bots. Google have such a (justified) bad reputation that whatever they do, people assume it’s entishification. I don’t believed it is on that matter.
This could be, for example, step one in the return of AMP, but with a new twist. Where google conveniently returns the content of your website, without directly sending the user to your website. With whatever changes it chooses to make.
Re: google.com/goto: Google's anti-scraping update
#355As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…
> For actual web search I actually like using Yandex You might want to reconsider this. https://meduza.io/image/attachments/images/007/699/276/large...
It's the usual "I prefer censorship not targeted at/tailor made for me".
Re: google.com/goto: Google's anti-scraping update
#356Earlier quoted context omitted.
I switched to DuckDuckGo around 2018 or so, which was when I realized that Google's results quality has deteriorated so much that I won't lose anything of value by doing so. This thread is how I learn about the atrocities that Google Search is committing these days. Which is an elaborate way to say: you don't have to live like this.
I don't. At this point I just ask the oracle in natural language. There's so many to choose from. Why spend hours wading through only vaguely related things? You can ask it for a direct answer or you can ask it to teach you about the topic.
Re: google.com/goto: Google's anti-scraping update
#357I really like the idea of turning the search index into a public utility. It is one of those natural monopoly coordination problem things. Just quasi nationalise it for economic efficiency. Ofc google can still sell adds against their own ui (like everyone else). Hopefully this move will move that idea closer to reality.
With the current administration? They would manipulate the results to ridiculous extent
Re: google.com/goto: Google's anti-scraping update
#358Earlier quoted context omitted.
For Google, the business side of you paying them doesn't work out as obvious as it might seem. Advertisers are sold the idea that 1000 clicks/impression is X dollars. The average impression might be priced at 1000/X$. But you are worth much more than that for two reasons. - you are a person willing to pay 5$ - Google can sell a “collectivized” product. The same way that eg collective farmer crop insurance creates act…
The advert paradox, anyone willing to spend money to avoid ads is inherently worth more to advertisers, since they're willing to spend money. The more money you're willing to pay to avoid ads the more you're worth to advertisers. That's why tools like uBlock and YouTube morphe are the only answer, negotiating with terrorists never works.
Re: google.com/goto: Google's anti-scraping update
#359Earlier quoted context omitted.
> For actual web search I actually like using Yandex You might want to reconsider this. https://meduza.io/image/attachments/images/007/699/276/large...
You think Google doesn't do censorship? Or any mainstream search engine, for that matter? It's the usual "I prefer censorship not targeted at/tailor made for me".
Re: google.com/goto: Google's anti-scraping update
#360The Internet has been dead for years and, after the Scrapocalypse, the small living remnants are behind a login wall.
Google can not provide you anything you couldn't find on either your local ZIM archive or the Media you consume.