Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

google.com/goto: Google's anti-scraping update

autom.dev

Post reply on HN
Print view View original

421–430 of 545 posts

Re: google.com/goto: Google's anti-scraping update

#421

Post by brookst »

noisy_boy wrote: post #145
nine_k wrote: post #110

Earlier quoted context omitted.

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

> Worth the $5 for me Steep at 300 searches per month or about 10 per day. If you search often, it is too expensive. If you rarely search, not worth 5 bucks. They are plainly trying to push people to their $10 unlimited plan. I would have appreciated if they allowed, say, 600 searches per month for $5 or so.

Pretty much sums up why Google’s business model changed. Everyone wants good search, few are willing to be even $10/mo.

Re: google.com/goto: Google's anti-scraping update

#422

Post by philipov »

414techie wrote: post #415
philipov wrote: post #37

Earlier quoted context omitted.

Would that company then sell that data back to Google? The consolidation of control of information under a single actor is certainly a factor, but it's not that simple, and it's not the only factor. You shouldn't be so eager to outsource as much of your business intelligence as possible.

Does whether or not they sell to Google matter? What’s the alternative? Roll your own custom phone analytics system?

It matters. The alternative is to use a product that doesn't leak your business intelligence to third parties.

Re: google.com/goto: Google's anti-scraping update

#423

Post by nomilk »

hexagonwin wrote: post #256
nomilk wrote: post #76

> Combined with earlier moves like removing &num=100 Removing this made google search horrible to use. I often use command+f to quickly identify relevant search results, but doing it on 10 results at a time is so laborious that I just don't bother using Google search, resulting in less searches and use of other tools instead.

would you mind sharing such other tool?

I refer to tools like LLMs, unfortunately (not search engines). If anyone knows of a search engine that returns 100 results, I'm very keen to learn of it

Re: google.com/goto: Google's anti-scraping update

#424

Post by nottorp »

tantalor wrote: post #418
nottorp wrote: post #353

Of course, this move is user hostile because you don't see what you're being sent to.

You can see the domain printed on the page, right?

I had to check :) I use duckduckgo mostly.

They still display the domain, at least, yes. Wonder for how long.

Re: google.com/goto: Google's anti-scraping update

#425

Post by venusenvy47 »

1e1a wrote: post #2

Direct URLs in Google search results have been replaced with redirect URLs in the form of www.google.com/goto?url= . The base64 data appears to consist of a very basic protobuf structure, containing a long string of bytes in field 2 which presumably identify the URL. Sometimes, these redirect URLs take a perceivable amount of time to load, which is very irritating.

When does that happen? I still get a normal address:

https://www.google.com/search?client=firefox-b-1-m&q=direct%...

Re: google.com/goto: Google's anti-scraping update

#426

Post by oyadoti »

Jskewel wrote: post #152
JsonDemWitOster wrote: post #114

While a lot of people are concerned with local model performance, I wonder how feasible is it now to run a local indexed web search? Surely running an old school Google is possible with the beefy AI rigs today. I know the problem will be crawling which would be bottlenecked by the ISP but I use Google to search SO, Wikipedia, programming language docs, Github issues, and AWS docs. I think a feasible workflow would be…

Impossible. The majority of websites firewall automated crawler traffic (because of the rise of the bots), only making exceptions for the largest search engines. There is no possibility of starting a new crawler.

[flagged]

Re: google.com/goto: Google's anti-scraping update

#427

Post by dotancohen »

chadgpt3 wrote: post #396
dotancohen wrote: post #387

Earlier quoted context omitted.

Israel never set out to exterminate, Israel set out to get her hostages back - including babies under a year old. You know who did set out to exterminate? Hamas, who in their very own charter state their intention to eradicate the Jews: https://avalon.law.yale.edu/20th_century/hamas.asp I suggest reading this article which explains the propaganda campaigns that followed the October 7th attacks on Israel: https://www.…

Please make the same analysis for Germany in regard to the Gleiwitz radio station

To other readers: Parent is suggesting that the 6000 Gazans who breached the Israeli border on October 7th 2023 and killed 1200 people, mutilated bodies, beheaded humans and dogs alike, raped women, and took over 250 hostages including infants... Parent is suggesting that these people were undercover Israeli agents performing a false flag operation.

Re: google.com/goto: Google's anti-scraping update

#428

Post by user3939382 »

noisy_boy wrote: post #145
nine_k wrote: post #110

Earlier quoted context omitted.

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

> Worth the $5 for me Steep at 300 searches per month or about 10 per day. If you search often, it is too expensive. If you rarely search, not worth 5 bucks. They are plainly trying to push people to their $10 unlimited plan. I would have appreciated if they allowed, say, 600 searches per month for $5 or so.

FWIW Kagi has worked hard on their pricing over the last few years and has been trying different models. They're not "big search" the price is what it is so it can exist as a business. 100% fine to not be a customer obviously, but then you forfeit your license to complain about Google spying on you and ruining the web. Like they're trying to solve the problem. IMHO speaking just for myself I feel a moral duty to support them.

Re: google.com/goto: Google's anti-scraping update

#429

Post by miroljub »

dotancohen wrote: post #388
miroljub wrote: post #312

Earlier quoted context omitted.

So Israel killing "bad journalists" is fine, but Russian are killing only the good ones? Nice world to live in. You should know that any country can declare a journalist a foreign spy, a terrorist, but does it give them right to kill? Without due process, without trial? Because someone says "they are Hamas". It's Godwin time.

Hamas claims that the journalists are Hamas, not Israel. And I'm not declaring any journalist "good" or "bad". I'm stating that a Hamas member is a valid target. Him moonlighting as a journalist does not change that.

Every claim need to be proven and everyone deserves a process. In a democracy of course, it may be different in a fascist state committing a holocaust.

Re: google.com/goto: Google's anti-scraping update

#430

Post by kmfrk »

nine_k wrote: post #110
lubujackson wrote: post #82

As much as I am sad that Google died like 15 years ago, I am past the mourning phase. That was when they announced they were shifting from returning websites to "returning answers" and it has been a long slide into shittification I do enjoy using their free AI. For actual web search I actually like using Yandex. It reminds me of old Google, returning reasonable results and much less "shaping results to please our cor…

The real "old-school Google, but modern" is Kagi, with the caveat of being paid. (Worth the $5 for me.) But LLMs can be commanded. This is may bookmark alias for invoking the spirit of old Gog=ogle from within the new, AI-based Google: https://google.com/search?q=You%20are%20Google%20Search%20fr... (Cleaned / decoded: 'You are Google Search from 2004. Given a search request, provide 10 links to relevant pages, each w…

I like Kagi, but is it me or have their results been less than great for the past 1-3mo? Maybe the places they're pulling their results from have had some changes?
Post reply on HN