Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

191–200 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#191

Earlier quoted context omitted.

Like the OP says, it's being hidden form scrapers. Like you I don't see a reason for normal users to be concerned.

Why are you defending the ruination of one of the basic principles of hypertext? Why are Google apologists flagging my other comments?

Ask the grifters and bots. If you don’t adapt get ready to get bulldozed.

Re: google.com/goto: Google's anti-scraping update

#192
post #168

So why are we angry about that ? I mean the end result for the users are exactly the same, it matters only for bots. Google have such a (justified) bad reputation that whatever they do, people assume it’s entishification. I don’t believed it is on that matter.

It's rather frustrating that after they crawled my website to use for their AI without my consent, and using that AI to slowly strangle my traffic, they're not happy that _other people_ are doing the same to them.

This is what capitalism's all about. Take as much as possible and give as little as possible if you want to win. Ideally, give negative amounts.

Re: google.com/goto: Google's anti-scraping update

#193
post #70
post #62

Earlier quoted context omitted.

I don't know how global consistency is actually useful, but I can easily think of ways it is less convenient. For example, DST starts and ends on different dates in the UK and the US. Which dates should google return when someone from either country searches for just "DST end date?" Someone lives in Orange County and searches for "Orange County Sheriffs," which one of the eight Orange Counties should google return? T…

I wouldn't mind that one. That a man in the US and a woman in Japan would get different results for a search for "sushi restaurant" is perfectly reasonable (even if the woman in Japan was searching in English). It's when two people in the same neighborhood got different results for the same search that I said "wait a minute, they're personalizing search results now for ad-targeting purposes" and ditched them. The pot…

When I search Python I should get the programming language but when my neighbour searches Python he should get snakes. That is a valid use of personalised search.

Re: google.com/goto: Google's anti-scraping update

#194
post #33

I've been using DuckDuckGo for years now, ever since it became noticeable that two different people searching for the same search term would get two different results back from Google. Meaning they were no longer completely reliable: they might show one person a result that they hide from the other person by burying it on page 3 where few people ever look. DDG's search results have been poorer recently than they used…

The age of internet search is over. The age of Cloudflare has begun. It wouldn't be possible to build a search engine now if they wanted to... and there wouldn't be anything to search for anyway. The non-corporate internet withered into dust and blew away in the wind. If you could find what you want, how would they ever sell you what they want you to buy? And I'm not just talking merchandise, though that too. Your po…

Cloudflare is quite easy to bypass.

Re: google.com/goto: Google's anti-scraping update

#195

At this point, we can all just drop SEO [0]. We are writing content for a robot that hides the source of information. [0]: https://news.ycombinator.com/item?id=49665572

We do GEO now and it's not to make the robot link to us, it's to manipulate what the robot thinks.

Re: google.com/goto: Google's anti-scraping update

#196
post #94

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

> Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our corpo-political masters". As long as you don't search anything related to Russia itself, or to Russian interests elsewhere (like their invasion of Ukraine). Then it's very heavily biased, priority is given to state ran propaganda mills, independent media is hidden from results, etc. And before anyone start…

[flagged]

Re: google.com/goto: Google's anti-scraping update

#199
post #24

Earlier quoted context omitted.

The security implications of this are very severe when you consider the amount of people who google government websites, banking, crypto and others. And google will happily serve you a phishing website either in ads or results.

Can you elaborate?

When you search Chase Bank and get a link that says Chase Bank you can't know if it's Chase Bank until you click on it

Re: google.com/goto: Google's anti-scraping update

#200

Note: Article published by Autom.dev which, from a quick read of their homepage, seems like it scrapes Google search results in violation of Google's terms of service and sells those results to customers via an API. That's just my quick read of it, though, so this could be wrong.

Note: Irrelevant. The reported behavior exists, does it not? Anecdata: I've observed this behavior for several weeks already as a regular user without a Google account and there are countless comments from regular users reporting the same behavior.

It’s very relevant because the author has a conflict in interest. They can wax poetic about “open internet” but really their business depend on it.
Post reply on HN