Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

221–230 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#221

Earlier quoted context omitted.

>I do enjoy using their free AI It's really not free. You're paying with your data.

People have this fixation on privacy, when there's so much more going on, potentially way mor important. Google's strong position in AI gives them bragging right to attract more companies and get them to actually pay, subsidizing your use. It also lowers competitors position as you're not touching them while we're on Gemini. It also fortifies their position in the future ad market. Being second or third in AI usage i…

> Being second or third in AI usage is worth a lot, one's private data matters very little in comparison.

what does this even mean

Re: google.com/goto: Google's anti-scraping update

#222
post #196
post #94

Earlier quoted context omitted.

> Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our corpo-political masters". As long as you don't search anything related to Russia itself, or to Russian interests elsewhere (like their invasion of Ukraine). Then it's very heavily biased, priority is given to state ran propaganda mills, independent media is hidden from results, etc. And before anyone start…

[flagged]

What does israel have to do with this?

Re: google.com/goto: Google's anti-scraping update

#224
post #95

Earlier quoted context omitted.

The pain being made is: If you use a search engine as your eyes to see what exists “on the internet”, then, absolutely, whatever Google hides from its results or fails to index is “erased” from “your” experience of the internet.

I see where you are coming from but the argument would be stronger is Google Chrome refused to open illegal streaming sites etc. AFAIK, there's no such restriction. (I dont agree to this but ...) using your argument of " If you use a X as your eyes to see what exists “on the internet” .. " - we should all be mad at Apple. I use iPhone as the primary device to access apps, and they not just hides but actively ban and…

> I see where you are coming from but the argument would be stronger is Google Chrome refused to open illegal streaming sites etc.

Why would it be stronger? Google has a near-monopoly on search.

> If I ask Siri to give me a link to illegal streaming site and if it refuses, is that cause for concern?

Yes, because you cannot replace Siri on a device you own.

Re: google.com/goto: Google's anti-scraping update

#225
post #89

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

> There are still illegal streaming sports and movie sites everywhere (who knew) and all other seedy corners of the internet that have been neatly erased by Google This is such a strange position to take. Apple doesnt allow all sorts of apps on the appstore, but that is never said as "Apple is erasing illegal streaming". Google is simply not showing the results. They are not taking down, or banning, or doing anything…

> Apple doesnt allow all sorts of apps on the appstore, but that is never said as "Apple is erasing illegal streaming"

Because they are not "erasing" anything, they are refusing to provide a platform that enables the direct (app whose intended purpose is) delivery of illegal content to you.

The difference being one will not facilitate the activity, while the other, is actively suppressing it. And thats what is meant by erased.

Your question in other comment If I ask Siri to give me a link to illegal streaming site and if it refuses, then that would be the better comparison. Then we could say "other seedy corners of the internet that have been neatly erased by [Siri]"

Re: google.com/goto: Google's anti-scraping update

#226
post #110

Earlier quoted context omitted.

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

Kagi works by scraping Google and other engines, so this should still worry you. I still support the use of Kagi though, as a market signal to Google that we'd even pay them for their product if it wasn't dogshit.

[deleted]

Re: google.com/goto: Google's anti-scraping update

#228

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

How is this comment relevant to the post (and be so upvoted?) Google is making it harder for people to game the index, working in your favor.

Are they? This reads more like a way to stop people reusing their results in other services rather than reducing spam results, but I may be mistaken?

Re: google.com/goto: Google's anti-scraping update

#229
post #110

Earlier quoted context omitted.

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

Kagi works by scraping Google and other engines, so this should still worry you. I still support the use of Kagi though, as a market signal to Google that we'd even pay them for their product if it wasn't dogshit.

For Google, the business side of you paying them doesn't work out as obvious as it might seem.

Advertisers are sold the idea that 1000 clicks/impression is X dollars. The average impression might be priced at 1000/X$.

But you are worth much more than that for two reasons.

- you are a person willing to pay 5$

- Google can sell a “collectivized” product. The same way that eg collective farmer crop insurance creates actual value.

and the third reason (as consequence of the second) they dont want people to think about: it gives them more opportunity to fudge the value by making it all very complicated.

Re: google.com/goto: Google's anti-scraping update

#230

I did an interview with Google around 20 years ago, where they posed a challenge involving tracking which specific search results people click. It's obvious in hindsight the solution required rewriting all the urls to redirect through their servers. Note this was in the days before they already did so as a matter of course. I failed to gain traction on the problem, because to me the very idea of doing such a thing wa…

The right click copy thing annoys me to no end.
Post reply on HN