Live data from Hacker News

Google Deactivates Web Search API

ajax.googleapis.com

111–120 of 132 posts

Re: Google Deactivates Web Search API

#111

Earlier quoted context omitted.

Yes, and it's scoped by either domain or (rarely used) types from the schema.org ontology. You can't use it to just search the web.

You can use it to search the web; you don't get the exact same experience as the old API. https://support.google.com/customsearch/answer/2631040?hl=en

Neat. Now it's just a matter of dealing with the absurdly low free usage limit and absurdly expensive paid tier.

Re: Google Deactivates Web Search API

#113
post #89
post #72

Earlier quoted context omitted.

Writing an open, and distributed web crawler / indexer is a nice programming exercise. Writing an "objective" ranking function (for any values of "objective") in an open, and distributed manner is structurally not favoured by humanity's current incentive structure. As in: * a dev team have to agree on signals, and weights: "SERP quality" has dedicated teams of people assigned for specific verticals @ Google; replicat…

> submit ranking code to public github repo, the algo will be played by thousand SEO scammers to their advantage Just a thought : Ranking code could itself learn & adapt to each individual user (the learned "weights" could be sync'd online across your devices). Weighted signals from users can be fed back to the mother ranking algorithm (un-customized one). Basically millions of distributed deep minds[1], instead of a…

> Ranking code could itself learn & adapt to each individual user

Cue blackhat SEOs creating millions of subverted "users" on AWS spot instances/Lambda

Re: Google Deactivates Web Search API

#115

Earlier quoted context omitted.

You can use it to search the web; you don't get the exact same experience as the old API. https://support.google.com/customsearch/answer/2631040?hl=en

Neat. Now it's just a matter of dealing with the absurdly low free usage limit and absurdly expensive paid tier.

Then it's just a market forces question. Use a provider of search services which matches your budgetary/usage requirements.

Re: Google Deactivates Web Search API

#116
post #110

What is the rationale for Google doing this? How much money was this service costing them?

I believe the problem was that if you did /google or !google on your bots for various chat platforms, you were able to find the top hit or two without ever looking at Google's Ads. Most of their revenue is ads.

So the question becomes, how much potential money were they losing through the API? Does Google think that by removing the API, people are now going to go to another window, perform a google search, and intently study the advertising before reviewing the search results?

Re: Google Deactivates Web Search API

#117

Since I can't post both a title and text: What's interesting about this is that the API has been officially deprecated since 2010 (and "offline" since September 2014), but today is the first day that it's actually become unavailable. Edit: Additionally, there are probably going to be big repercussions to the web/average person's browsing experience as a result of this. A massive number of sites (and programs, bots, e…

> Additionally, there are probably going to be big repercussions to the web/average person's browsing experience as a result of this. A massive number of sites (and programs, bots, etc) were using this API because of its simplicity (and absence of registration/authentication). Yep. My harmless little IRC bot can no longer Google search anymore :(

Google search web scraper as a service?

Re: Google Deactivates Web Search API

#119
post #110

Earlier quoted context omitted.

I believe the problem was that if you did /google or !google on your bots for various chat platforms, you were able to find the top hit or two without ever looking at Google's Ads. Most of their revenue is ads.

So the question becomes, how much potential money were they losing through the API? Does Google think that by removing the API, people are now going to go to another window, perform a google search, and intently study the advertising before reviewing the search results?

You just made a textbook strawman. It doesn't do anyone any good to theorize about what the dumbest possible reason might be for Google to do this. It is infinitely more useful to think about what rational, informed reasons they might have for doing it (regardless of whether you agree with those reason). People reflexively jumping to strawman arguments is probably #2 or #3 on the top ten list of Why We Can't Have Nice Things, in tech, politics, and just about anything else in the world where different groups of people have imperfect knowledge about each other's activities and motivations.

Re: Google Deactivates Web Search API

#120

Earlier quoted context omitted.

>Can you use Google Custom Search for a full index web search?Last I looked, I thought you could only use it configured with a certain list of domains to include in the search. You can, refer to this SO answer: http://stackoverflow.com/a/11206266/3354209

Thanks. One of the comments on that SO answer from Aug 2015 says: > WARNING: we did development using the free version, but to upgrade to the paid version (to do more than 100 searches), google forces you to turn off the "search the entire web but emphasize included sites" I remain not very confident that you can really search the whole web with google custom search, or if you can that it's not some kind of a loophol…

Yes, you can search the whole web. We have been using a pool of credit cards to make up to a million requests per month.
Post reply on HN