This is more a feature than a different search engine, but I so so so wish I could de-prioritize blogspam. 300 - 1000 word text-heavy writeups of a couple of facts where a few bullet points, an image, a graph, a map, or a data table would be much much better. Google has been SEO'd to death because of its block-of-text lowest common denominator favoring.
Ask HN: Is there room for another search engine?
171–180 of 200 posts
Re: Ask HN: Is there room for another search engine?
#172I observe occasional referrals to our web-site from Qwant [1], a French search engine with focus on privacy. Although, I don't know if they're cash-positive or still burning investor's money. [1] https://www.qwant.com/
Re: Ask HN: Is there room for another search engine?
#173The short answer is YES, but the long answer is, if you're thinking about building a startup, this should NEVER be the question you ask. All successful companies that came out of nowhere and disrupted already stable industry never started out thinking "How do i build another X", "How do I disrupt X"? They all built something they thought was needed by the world and it went onto somehow "disrupt X". So if you're start…
Dunno. It's worked before. http://infolab.stanford.edu/~backrub/google.html
Re: Ask HN: Is there room for another search engine?
#174Earlier quoted context omitted.
> We can agree to disagree about Google's immortality Dude where did I say Google is immortal? I'm just saying it's a wrong approach to try to kill google this way. There are many good ways to do it and coming from "How do i disrupt Google" is the worst possible way. > Obviously Microsoft has no chance, they're worse off than Google re: ossification and Bing is a hedge at best. Nothing is obvious when we talk about d…
I'm convinced that the only reason Microsoft is keeping Bing alive is to keep Windows 10 users from funneling money to Google by default.
Only large companies can afford to make browsers. They are insanely complicated beasts now. Google because ad and Android, Microsoft because windows and Bing, Apple because of ios. Firefox is facing struggles and Opera gave up to webkit.
Disrupting Google search is going to be very hard. Google invests more than anyone in AI. If someone were to disrupt Google, they have to have very strong models of the world, natural language parsing, image recognition, knowledge reasoning, troves of data and an ocean of servers and fibre.
Google hasn't been sitting idle, they've been disrupting themselves and pushing towards those fronts.
Re: Ask HN: Is there room for another search engine?
#175Based on what I've heard from leaks and various news articles, the leadership of the search division was once adamantly against using neural networks for search.
Things took a sudden turn maybe 5 years ago. Something caused google to do a complete 180 and vastly increase their investment in AI research. They saw something that scared them.
I think it was their unexpected success using AI for machine translation. There was much PR about it at the time, and I think it really got the gears turning at Google HQ. You see, the same language processing needed for machine translation has obvious parallels to search.
The more curious employees began applying word vectors used for translation to search. After all, most of it had been trained on index data from multi lingual websites anyways. They found that, horrifically, rather simple neural networks sometimes outperformed the the search algorithms google had spent billions on.
When this reached upper management it set off a quiet panic. Google, once seen as invincible, could have been beaten by a start-up using effective ML techniques. Computer power calculations showed that this could have been done since a few years after the debut of CUDA, a window of vulnerability of maybe 7 years.
The timeframe of around 2005-2010 coincided with Google spinning off a bunch of moonshot projects and doubling down on their core businesses. Coincidence? Maybe, but I don't think so. I wish a Xoogler or two would come out of the woodwork and tell me if I'm crazy or not.
Anyways, Google usually has a 5-7 year lag time when they release details of their tech to the public. This dates Tensorflow and their heavy AI work to around 2010. The window where somebody could have beat them easily with ML was probably 2005-2010
Re: Ask HN: Is there room for another search engine?
#176This is more a feature than a different search engine, but I so so so wish I could de-prioritize blogspam. 300 - 1000 word text-heavy writeups of a couple of facts where a few bullet points, an image, a graph, a map, or a data table would be much much better. Google has been SEO'd to death because of its block-of-text lowest common denominator favoring.
Basically google can't trust backlinks anymore because people game them and competitors try to destroy each other's sites by buying scummy links to their stuff.
So they mainly attempt to measure quality in a vacuum. This is using their machine learning stuff to look at the quality, confidence, and reading level of the writing style.
They do the same quality checks for the site. Checking for EV certs, clean markup, real email volume through Gmail, reputable DNS provider, physical address in G maps. A lot of their hundreds of quality metrics don't measure the site itself, but use Google's pervasive data trove from their other services. Most scammers don't bother doing any of this right.
The problem becomes people like me. I setup sites with all measures of quality for legitimate businesses. Have articles written by good writers with knowledge in the subject. Sounds great right?
The problem is that these articles are still done for money and quite biased sometimes. Google is slowly running into a need for a strong AI because all measures of quality can be emulated if enough money is on the line. It doesn't matter if something seems truthful in every way except the fact that it isn't.
This is the same reason "fake news" is invading google and Facebook. Smart spammers have upped their game to the point that it's impossible to know what's real anymore.
Need a wikipedia article changed? Good reviews on Yelp? A nice piece on a popular tech website? All of this can be openly bought with zero consequences.
Re: Ask HN: Is there room for another search engine?
#177Earlier quoted context omitted.
> We can agree to disagree about Google's immortality Dude where did I say Google is immortal? I'm just saying it's a wrong approach to try to kill google this way. There are many good ways to do it and coming from "How do i disrupt Google" is the worst possible way. > Obviously Microsoft has no chance, they're worse off than Google re: ossification and Bing is a hedge at best. Nothing is obvious when we talk about d…
I wonder, is DuckDuckGo's name a problem for adoption? I have no idea what it's supposed to mean, but it sounds very silly and I don't much enjoy recommending it to people in real life, at least in part for that reason. ("Google" was a silly name too, but at least it was just one syllable of silliness.) Privacy is probably slowly growing into a big deal in the minds of regular people, but when the incumbent works, an…
For me it is too, yeah. They even own duck.co which would be a better brand. It'd be a pain in the arse to tell others to use to start ("duck dot com?" "no, dot co") but nowhere near as silly sounding as duck duck go.
Re: Ask HN: Is there room for another search engine?
#178Earlier quoted context omitted.
We can agree to disagree about Google's immortality, but I take issue with you treating DDG and Bing as serious challengers to Google. Obviously Microsoft has no chance, they're worse off than Google re: ossification and Bing is a hedge at best. DDG is one step above a lifestyle business and only innovates at the UI level, even their efforts there are forgettable. Their major differentiator (data privacy) is meaningl…
While google has a much stronger brand than bing, they give roughly equivalent results except for a few categories such as "paste the error message I just got into the search box" queries. Google's much better for those longer queries. HN readers are probably more likely than average to make them, too.
Re: Ask HN: Is there room for another search engine?
#179Earlier quoted context omitted.
>I have no idea what it's supposed to mean I've understood it to be a reference to https://en.wikipedia.org/wiki/Duck,_duck,_goose ; the wikipedia article on duckduckgo confirms.
Is this an American thing? I have never heard of it.
Re: Ask HN: Is there room for another search engine?
#180Earlier quoted context omitted.
The next direction in search is search that machines can use. Without needing humans to tell them what the results mean.
This isn't task of the search engine, it's the task of the machine that uses it. If the machine doesn't understand meaning there is no way the search engine can teach it that meaning. So no, this will not be the next direction - unless there is a universal model of machines that understand things. But there isn't, and there won't be for at least another 10 years.
IMHO, the other pieces of the picture, and what i see happening, is search engines or a service, will index entities and relationships ( in the ontology sense ), and return results enriched with that data through something like an extended microdata vocabulary. There will be an API where machine consumers can query entities and relationships, and see those attributed to their sources in the webpage. This prediction is nothing new and has been consistently foretold by ai and information retrieval augurs for decades. The difference is that I see this moving beyond the realm of expert systems in large corporations and into the realm of being an API generally accessible to anyone.
I think it's very possible that, as you say, a current incumbent search engine may not consider the provision of such a service its job. Which makes things very interesting for potential new entrants in the semantic search market.
Other business types could surely supply these entities and relationships however who better to be involved in the supply chain than search engines because they hold a hose containing nearly all the world's information, and in the other hand a market hungry for all the world's information.
But this type of service could be niche because most humans are not going to care about getting ontology data in their search results. So even though parsing out entities and relationships could improve the usefulness and accessibility of information there might not be enough universal demand for someone like Google to really care about it.
With these caveats, I think the trend from information, to knowledge, is a very natural and already apparent progression for search engines. The type of API described here is possible today given the right incentives.