Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

301–310 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#302
post #280

Earlier quoted context omitted.

I turn it down straight away for being Russian and I'm suspicious of anyone that mentions it positively. Russia is in a cold war with democracies in general and a hot war with Ukraine. It has an autocratic dictator as leader and state control of media. It has a well documented propaganda campaign with the goal of destabilising other countries through agitation. We even know the address of the building in Saint Peters…

Couldn't we say the exact same thing about any US service in this day and age? Trade war with half the planet, hot war with Iran. Autocratic dictator as leader and complicit media. Well documented propaganda campaign and history of destabilising countries around the world. Known to compel tech companies to spy on foreign citizens...

[flagged]

Re: google.com/goto: Google's anti-scraping update

#303
post #110

Earlier quoted context omitted.

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

Kagi works by scraping Google and other engines, so this should still worry you. I still support the use of Kagi though, as a market signal to Google that we'd even pay them for their product if it wasn't dogshit.

I’m pretty sure Kagi’s entire pitch is that they’re an alternate and original dataset. Theirs is the only search engine whose data isn’t based upon google or bing’s databases.

To anyone who didn’t find Kagi useful in the past, I strongly recommend you try it again, as they have made huge strides in usability and quality of surfaced data in just the past year…. Huge strides since even a few months ago too, with more adaptive curation, data labeling, and UI/UX

Re: google.com/goto: Google's anti-scraping update

#304

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

[flagged]

Do you use any Israeli products? What do you say about them?

Re: google.com/goto: Google's anti-scraping update

#305
post #246

Earlier quoted context omitted.

This is interesting. Do you consider Yandex absolutely safe to use (wrt their possible connections with the Russian government, and current war in Ukraine)? Asking this as a geeky end-user from Estonia -- I wonder if I would be considered "suspicios" by local internet service providers, our govt/police etc if I did a lot of searching via Yandex instead of e.g. Google these days. (For us in Estonia, I suppose "everyth…

I’d expect everything that you type into Yandex that can be of use to the Russia will be used by Russia - they will nit care about hurting you. Just like Russia doesn’t care about online criminals being located within their borders - as long as they target outside. While this may be true to some extent of all the countries, Russia is the one to be clearly against Estonia, Baltics and eastern europeans.

How is that different for any web site on Earth?

Re: google.com/goto: Google's anti-scraping update

#306
post #254

Earlier quoted context omitted.

What does israel have to do with this?

According to OP >It would be delusional to expect any sort of press and related (like search engine or aggregation) freedom, or to try to compare this to anything in any other developed country. Israel is responsible for killing more journalists than any other country. Google has profited by providing services to Israel in the ongoing genocide. https://cpj.org/special-reports/record-129-press-members-kil... https://a…

A genocide with an increasing population. And a famine where obesity is rising.

Jew haters on the internet?

Never heard about it.

Re: google.com/goto: Google's anti-scraping update

#307
post #254

Earlier quoted context omitted.

According to OP >It would be delusional to expect any sort of press and related (like search engine or aggregation) freedom, or to try to compare this to anything in any other developed country. Israel is responsible for killing more journalists than any other country. Google has profited by providing services to Israel in the ongoing genocide. https://cpj.org/special-reports/record-129-press-members-kil... https://a…

I was waiting to see how long it took for someone to "make this about Palestine" - their strategy is to inundate all discussion with the topic. Over half the journalists in the Gaza Strip are affiliated with Hamas. Many of them infiltrated Israel in 2023, and some of them held Israeli hostages in their homes, including children hostages. https://www.terrorism-info.org.il/en/abou

That site seems completely unbiased and not at all fed by the propaganda coming out of Israel. Thanks for finding such a reliable and trustworthy source.

Re: google.com/goto: Google's anti-scraping update

#308

Earlier quoted context omitted.

Becuse they are a monopolist and we can require certain things from monopolists. Similarly, Bell Labs was kind of required to release transistor for anyone to license - it was a part of social contract that they were allowed to maintain their monopoly in exchange for releasing certain parts of technology. Alternatively, they could be split up and their indexing division made an independent company selling to anyone o…

I tend to agree - businesses should give back. But they can also keep some secrets. R&D has steep cost. Publishing it all gives your competitors an advantage.

It has steep costs, but with monopolists they have other ways of extracting value from the inventions.

Awesome book about the history if Bell Labs - virtually all semiconductor tech we use today was created there (transistors, ics, solar, lasers, fiber optics, telecom satellites…), and they had to license it to be allowed to maintain their monopoly status.

https://www.amazon.pl/Idea-Factory-Great-American-Innovation...

Re: google.com/goto: Google's anti-scraping update

#309
post #72

Earlier quoted context omitted.

but you can click the link and reveal the information. what is being hidden? from who?

Like the OP says, it's being hidden form scrapers. Like you I don't see a reason for normal users to be concerned.

Google seems to be swimming in hypocrisy, as they develop and use scrapers.

PS: I do not understand why people keep using Google search, the results turned biased and mediocre.

Re: google.com/goto: Google's anti-scraping update

#310
post #303

Earlier quoted context omitted.

Kagi works by scraping Google and other engines, so this should still worry you. I still support the use of Kagi though, as a market signal to Google that we'd even pay them for their product if it wasn't dogshit.

I’m pretty sure Kagi’s entire pitch is that they’re an alternate and original dataset. Theirs is the only search engine whose data isn’t based upon google or bing’s databases. To anyone who didn’t find Kagi useful in the past, I strongly recommend you try it again, as they have made huge strides in usability and quality of surfaced data in just the past year…. Huge strides since even a few months ago too, with more a…

> I’m pretty sure Kagi’s entire pitch is that they’re an alternate and original dataset. Theirs is the only search engine whose data isn’t based upon google or bing’s databases.

It's not. In addition to their own indexes the results include calls to "all major search result providers worldwide"[1].

There are independent search engines that only use their own index, like Mojeek[1]. Kagi is explicitly something like a search engine aggregator.

[1]: https://help.kagi.com/kagi/search-details/search-sources.htm... [2]: https://www.mojeek.com/

Post reply on HN