Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

281–290 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#281
post #211
post #172

Earlier quoted context omitted.

I have an android phone, they already have my data.

So have I, but they don't have any of my data.

Me too. I don't connect my phone to my Google account. I understand that the Play store is enticing, but there are other options. Some of which are actually better.

Re: google.com/goto: Google's anti-scraping update

#282

It's funny. Recently I looked into what Google is doing (see at https://blog.miloslavhomer.cz/how-google-sees-your-site/ ). It's a lot of work to get the data to build an index. Why would they give it to everyone for free?

Becuse they are a monopolist and we can require certain things from monopolists.

Similarly, Bell Labs was kind of required to release transistor for anyone to license - it was a part of social contract that they were allowed to maintain their monopoly in exchange for releasing certain parts of technology.

Alternatively, they could be split up and their indexing division made an independent company selling to anyone on a free market.

Re: google.com/goto: Google's anti-scraping update

#283

Earlier quoted context omitted.

[flagged]

Have you tried Yandex and evaluated the quality of its results, or do you just feel obligated to continuously put it down because it's russian?

As long as there are non-russian alternatives out there I'm never going to even try.

Re: google.com/goto: Google's anti-scraping update

#284

Earlier quoted context omitted.

[flagged]

Have you tried Yandex and evaluated the quality of its results, or do you just feel obligated to continuously put it down because it's russian?

I have, and it has never been good for my purposes. In English, I just can't find things I need, in Russian, I find things I wish to never see again, tbh.

What is your experience with it?

Edit: The best search for my purposes historically has been on Pinterest. Unfortunately, not anymore. I normally search for visual artifacts (photos, art, schematics, etc), out of all search engines Google is still the only one that is somewhat functional for me in this regard.

I tried DDG, Kagi, Yandex. None of them worked for me.

Re: google.com/goto: Google's anti-scraping update

#285

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

[flagged]

Guidelines: Please don't use Hacker News for political or ideological battle. Please don't post insinuations about astroturfing.

Re: google.com/goto: Google's anti-scraping update

#286
post #280

Earlier quoted context omitted.

Have you tried Yandex and evaluated the quality of its results, or do you just feel obligated to continuously put it down because it's russian?

I turn it down straight away for being Russian and I'm suspicious of anyone that mentions it positively. Russia is in a cold war with democracies in general and a hot war with Ukraine. It has an autocratic dictator as leader and state control of media. It has a well documented propaganda campaign with the goal of destabilising other countries through agitation. We even know the address of the building in Saint Peters…

Couldn't we say the exact same thing about any US service in this day and age?

Trade war with half the planet, hot war with Iran. Autocratic dictator as leader and complicit media. Well documented propaganda campaign and history of destabilising countries around the world. Known to compel tech companies to spy on foreign citizens...

Re: google.com/goto: Google's anti-scraping update

#287
post #134

Earlier quoted context omitted.

>I do enjoy using their free AI It's really not free. You're paying with your data.

Worse - We all are paying with our planet.

what is that not true of? HN and your post on it is paying with our planet

Re: google.com/goto: Google's anti-scraping update

#288
post #280

Earlier quoted context omitted.

Have you tried Yandex and evaluated the quality of its results, or do you just feel obligated to continuously put it down because it's russian?

I turn it down straight away for being Russian and I'm suspicious of anyone that mentions it positively. Russia is in a cold war with democracies in general and a hot war with Ukraine. It has an autocratic dictator as leader and state control of media. It has a well documented propaganda campaign with the goal of destabilising other countries through agitation. We even know the address of the building in Saint Peters…

Maybe so they can bring actual data to the discussion instead of bias.

Re: google.com/goto: Google's anti-scraping update

#290

Earlier quoted context omitted.

Cloudflare is quite easy to bypass.

Do you have a source for this claim? Cloudflare gives me endless captchas on almost any website.

Yes, I bought a cheap residential proxy service and used it to scrape a site.
Post reply on HN