Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

Post reply on HN
Print view View original

441–450 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#441

Post by mitxela »

Hackbraten wrote: post #405
MallocVoidstar wrote: post #390

Earlier quoted context omitted.

Kagi don't scrape, they pay other engines for API access: https://help.kagi.com/kagi/search-details/search-sources.htm... >Our search results also include anonymized API calls to all major search result providers worldwide

The only “other engine” that matters is really a thin paid SERP façade in front of a scraped Google result. In other words, Kagi pays for access to an API whose implementation is basically live scraping Google and throwing away the ads. There are a few other indexes that Kagi’s aggregator mixes in (such as Bing Search) but those haven’t been contributing much in terms of meaningful results. The sheer size of Google’s…

Marginalia likely returns better results than Google, when it returns useful results. DDG/Bing likely returns average quality results which can be better than Google's slop results. It's not true that Google is the only useful one.

Re: google.com/goto: Google's anti-scraping update

#442

Post by robtherobber »

brookst wrote: post #421
noisy_boy wrote: post #145

Earlier quoted context omitted.

> Worth the $5 for me Steep at 300 searches per month or about 10 per day. If you search often, it is too expensive. If you rarely search, not worth 5 bucks. They are plainly trying to push people to their $10 unlimited plan. I would have appreciated if they allowed, say, 600 searches per month for $5 or so.

Pretty much sums up why Google’s business model changed. Everyone wants good search, few are willing to be even $10/mo.

Google kept increasing its profits since then, and it was one of the most successful businesses out there way before they changed the business model to become enshittified. The argument that their business model changed because people wouldn't pay for its services doesn't really stand.

Re: google.com/goto: Google's anti-scraping update

#443

Post by dotancohen »

miroljub wrote: post #314
dotancohen wrote: post #299

Earlier quoted context omitted.

Your Holocaust inversion is not only morally wrong, it is also factually incorrect.

Care to explain?

Parent comment is implying that an ally (Israel) is performing a holocaust. In fact, there have been a good dozen genocides in the past century which I would agree fit the term, but not the conflict that Israel is involved with.

The anti-Israel and anti-US side typically take an argument or incident from Israeli or US history or culture and invert it. A good example is the common Hebrew expression "No other land" - we have culture and songs about that, as well as jokes and it is a common expression in everyday speech. After October 7th, as part of the propaganda campaigns against Israel, that phrase was used as the title of an anti-Israel movie highlighting that another population has "no other land". Inversion of our culture.

Holocaust inversion - accusing Israel of perpetrating a holocaust - is this particular example.

Re: google.com/goto: Google's anti-scraping update

#444

Post by rascul »

lubujackson wrote: post #82

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

I don't understand why people are still using Google search generally. It's so bad nowadays.

Re: google.com/goto: Google's anti-scraping update

#445

Post by jasonjmcghee »

I've never heard of this particular SERP provider, but some marketer is very excited they wrote this blog post right now (500+ upvotes on an seo blog post).

And their fix here - they just resolve all the urls- which I suppose could make the service slightly more expensive? But otherwise isn't that what every similar provider/ crawler etc will do and this change will only hurt users?

Re: google.com/goto: Google's anti-scraping update

#446

Post by radiator »

oblio wrote: post #289
radiator wrote: post #285

Earlier quoted context omitted.

Guidelines: Please don't use Hacker News for political or ideological battle. Please don't post insinuations about astroturfing.

[flagged]

> There are "politics and ideology" and there is right and wrong.

That is exactly how six-year-olds think.

Re: google.com/goto: Google's anti-scraping update

#447

Post by Cakez0r »

nairboon wrote: post #265
Cakez0r wrote: post #178

Earlier quoted context omitted.

It would be interesting to see a decentralised, residential collective that builds and publishes an index. There are surely enough interested people on HN alone that would be willing to run software at home to scrape a small slice of the internet.

Something like YaCy?

Just like that! I will give it a try

Re: google.com/goto: Google's anti-scraping update

#448

Post by kolinko »

ajsnigrutin wrote: post #401
kolinko wrote: post #313

Earlier quoted context omitted.

As a general rule, if another country has an open war with your neighbor and openly says that you may be next, don’t put in private data into the sites controlled by that country.

But that's true for google too Ok, maybe not the war *with a neighbor* (yet), but US has an open war with Iran (and has bombed a few other countries recently also) and it also threathens to annex the neigbor to the north plus another island country. Sure, americans might consider themselves to be "the good guys", but the rest of the world doesn't.

From where in the rest of the world are you? Did even you talk to anyone living in countries neighboring Russia?

Sure not everyone benefitted from US but a ton of people/countries did and still do.

US never felt a need to build walls to prevent their citizens/allies from leaving. Russia and the others very much so.

With US the track record may be mixed, but a ton of countries from Europe and Asia benefitted tremendously. Russia otoh doesn’t have a concept of win-win, they tend to exploit even their closest allies, which anyone living in Baltics/East-Central Europe can tell you.

Re: google.com/goto: Google's anti-scraping update

#450

Post by BoingBoomTschak »

MallocVoidstar wrote: post #390
mitxela wrote: post #181

Earlier quoted context omitted.

Kagi works by scraping Google and other engines, so this should still worry you. I still support the use of Kagi though, as a market signal to Google that we'd even pay them for their product if it wasn't dogshit.

Kagi don't scrape, they pay other engines for API access: https://help.kagi.com/kagi/search-details/search-sources.htm... >Our search results also include anonymized API calls to all major search result providers worldwide

Is Marginalia the only real competing search engine?
Post reply on HN