Live data from Hacker News

To Break Google’s Monopoly on Search, Make Its Index Public

bloomberg.com

231–240 of 630 posts

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#233
post #61

Okay, this is a relatively serious proposal to require Google to allow API access to its search index, with the premise that it would democratize the search engine ecosystem. There are some issues with the regulations he proposes (you have to allow throttling to prevent DDoS attacks, and you can't let anyone with API access add content to prevent garbage results), but it's roughly feasible. The main problem is, I thi…

> 1) a record of searches and user clicks for the past 20 years If a government was serious about getting more players in the search industry, they would force Google (and all other players) to make this data public. Simply say "All user-behaviour data used to improve the service must be freely published". Make the law apply to any web service with more than 20 million users globally so small businesses aren't burden…

> If the data cannot be published for privacy reasons, the private parts must be seperated and not used by google or it's competitors.

As a user that notices the impact of this data: please no, thanks though.

Have you ever visited youtube's home page in incognito mode? It's... bad. Really bad. Not allowing any company to use this (obviously very private) information in ranking would simply make their products suck, horribly, compared to today.

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#235

Earlier quoted context omitted.

I'd wager any startup that tries to crawl a few sites like Amazon, Yelp, Linkedin, etc will be blocked. Google, however gets a pass because they're Google. So yes, I believe their huge index, and ability to crawl any site at will is a huge, huge advantage for them.

I built a search engine that was able to crawl Amazon and Yelp. The toughest sites were reddit and facebook.

And google sucks at those too.

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#236
post #170

Earlier quoted context omitted.

Google's claim that the algorithm is generic is demonstrably false. Type in "hillary clinton e" and there is no suggestion for "email", type "donald trump e" and email is the first suggestion. Given the news content that we know is out there, that can only be the result of adjusting the results for clinton specifically (if anything, we would not expect "email" to be autocompleted for trump). This is not research that…

This is not "research" period. Using one arbitrary search comparison to draw conclusions about the nature of a system that processes billions of queries a day is pretty weak. Additionally, I don't get the same results you do. "hillary clinton e" does not bring up emails, nor does "donald trump e" bring up emails (the first results I see are election, education, england visit, ex wife). I'm not ruling out the possibil…

Try "hillary clinton emai". From a fresh chrome session in NYC I get nothing, not a single autocomplete result. On the other hand "donald trump emai" gets:

* donald trump email * donald trump email address * donald trump email list * donald trump email newsletter * donald trump email list signup

And just to drive the point home I tried "root_axis emai" and got "root_axis email". Try anyone else and you get similar results, 'barack obama emai', 'george bush emai', etc etc. So yes, this is proof that the results are scrubbed for Clinton email.

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#238
post #222
post #152

Earlier quoted context omitted.

'Break Google up' would mean you'd have: * an Office suite / enterprise company (Google Cloud + Docs + Gmail + Business) * a phone company (Android) * a search company (Google Search + Advertisement) * and a media company (Google Play Movies, Music, Books and YouTube) The names would probably become different in time, but you get the gist. Amazon and Microsoft could be broken up much the same way, in neat categorical…

Almost all of those businesses tie back into their main business which is advertising. Who is going to sell those ‘neat silos’ cheap advertising to survive with no other business model? Google?

Search advertising is different from web display advertising is different from streaming video advertising.

The cloud services (Enterprise apps, hosting, etc) don't need it.

  I think we'd probably see a worse Gmail (worse ads or aggressive upsells).

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#239
post #186

Earlier quoted context omitted.

He does raise some good points in his findings: https://sputniknews.com/us/201609121045214398-google-clinton... I know Sputnik isn't a good source, but according to him, they were the only ones who would publish the findings without edits.

Thats a pretty strong indication that his claims are BS. Sputnik is a literal propaganda arm.

It's certainly grounds for more scrutiny, but not outright dismissal before even looking at it.

Re: To Break Google’s Monopoly on Search, Make Its Index Public

#240
post #61

Okay, this is a relatively serious proposal to require Google to allow API access to its search index, with the premise that it would democratize the search engine ecosystem. There are some issues with the regulations he proposes (you have to allow throttling to prevent DDoS attacks, and you can't let anyone with API access add content to prevent garbage results), but it's roughly feasible. The main problem is, I thi…

Storage and bandwidth are cheaper than ever before, people scrape a billion pages for much more mundane purposes these days, even for academic papers.

Having a full text index on that is more involved but hardly impossible. You're completely right that it's not at all Google's secret sauce. Bing has clearly indexed much more than that, plus invested a ton in actually returning good results from their index. And still nearly nobody cares. It's just not easy to make a better Google, and the people most likely to figure out how to do that already work there.

Post reply on HN