Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

81–90 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#81
post #24

Can someone explain why this matters? Not being flippant I just don’t understand why this would be important.

The security implications of this are very severe when you consider the amount of people who google government websites, banking, crypto and others. And google will happily serve you a phishing website either in ads or results.

Can you elaborate?

Re: google.com/goto: Google's anti-scraping update

#82
As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification

I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our corpo-political masters". It is surprising to see how much they have stripped from our view - long tail results, actual results for product reviews and not ad spam, no preference for 20 page recipe sites.

There are still illegal streaming sports and movie sites everywhere (who knew) and all other seedy corners of the internet that have been neatly erased by Google. It makes me nostalgic for that brief window of time when the web was truly uncontrolled, when page rank had meaning and you didn't know if your search would return 0 results or 4,000 pages, which you could actually browse.

Re: google.com/goto: Google's anti-scraping update

#83
post #39
post #31

Earlier quoted context omitted.

They are forcing my further and further towards kagi. I do hope the fawning on here is at least partly justified.

Kagi is what I settled on a couple of years ago. I do think sometimes the fawning is over the top, but it is a solid search engine and tended to give me a bit better results than Google out of the box. The real win, though, is that you can give various sites a weight, so the search results will prefer or avoid sites according to your desires. Once I had that going, my search results tended to be much better than Goog…

Yup, same here. Been using Kagi for years. It's boring, it just works. Hoping they can stay that way.

Re: google.com/goto: Google's anti-scraping update

#85

Most people i see using ChatGPT for any search related work in everyday life. Maybe Google is observing this?

Yeah seems pretty obvious to me that most people are not going to be using a search engine in 5 years. In the sense of searching for something and combing through the results to find the answer.

Re: google.com/goto: Google's anti-scraping update

#86
post #41

Earlier quoted context omitted.

ISPs do not see query strings since Google uses HTTPS. ISPs can only see the domain and IP address you are connecting to.

Can they even see the domain? Assuming you're not using the ISP's DNS of course.

Unless you're using DNS over HTTPS they can see the unencrypted DNS traffic. There's also Encrypted Client Hello, but they can also see which IP you're connecting to.

Re: google.com/goto: Google's anti-scraping update

#87
post #33

I've been using DuckDuckGo for years now, ever since it became noticeable that two different people searching for the same search term would get two different results back from Google. Meaning they were no longer completely reliable: they might show one person a result that they hide from the other person by burying it on page 3 where few people ever look. DDG's search results have been poorer recently than they used…

I’ve been using DDG for a long time now. Results are getting more and more spammy. Way too many AI-generated / scraped websites nowadays.

Re: google.com/goto: Google's anti-scraping update

#89

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

> There are still illegal streaming sports and movie sites everywhere (who knew) and all other seedy corners of the internet that have been neatly erased by Google

This is such a strange position to take. Apple doesnt allow all sorts of apps on the appstore, but that is never said as "Apple is erasing illegal streaming". Google is simply not showing the results. They are not taking down, or banning, or doing anything to the websites.

Post reply on HN