Live data from Hacker News

Two upstart search engines are teaming up to take on Google

wired.com

91–100 of 299 posts

Re: Two upstart search engines are teaming up to take on Google

#93
post #41

Earlier quoted context omitted.

The Swede behind search.marginalia.nu has had a working search engine running at a single desktop class computer in a living room, all programmed and maintained on his spare time, that was so good that in its niches (history, programming, open source comes to mind) it would often outshine Google. Back before I found Kagi I used to use it everytime Google failed me. So, yes, given he is the only one I know who manages…

I think the problem with search is that while it's relatively doable to build something that is competitive in one or a few niches, Google's real sticking power is how broad their offering is. Google search has seamless integration with maps, with commercial directories, with translation, with their browser, with youtube, etc. Even though there's more than a few queries they leave something to desire, the breadth of…

This is one of those things that I think is interesting about how "normal" people use the Internet. I am guessing they just always start with google.

But for me, if I want to look up local restaurants, I go straight to Maps/Yelp/FourSquare(RIP). If I want to look up releases of a band, I go straight to musicbrainz. Info about Metal Band, straight to the Encyclopeadia Metallum. History/Facts, straight to Wikipedia. Recipes, straight to yummly. And so on. I rarely start my search with a general search engine.

And now with GPT, I doubt I even perform a single search on a general search engine (google, bind, DDG) even once a day.

Re: Two upstart search engines are teaming up to take on Google

#96
post #76

Is it just me or does it feel like a lot of Big Tech empires are immovable? There are no winner takes all markets now. Massive incumbents are not replaced by another even more massive startup that gobbles up the market, but rather a collection of specialized alternatives. So Google is not being replaced, but is slowly losing bits and pieces to ChatGPT, Kagi, Perplexity, and others. Facebook/X lose a little to BlueSky…

It went on for far longer than the last decade. The thing is that it takes a long time for a very big company of any sort to die, so it can zombie along for years. Even when private equity notorious is pretty much trying to kill the company.

Re: Two upstart search engines are teaming up to take on Google

#97

Earlier quoted context omitted.

"CommonCrawl [being] text-only is only ~100TB, and can fit on my home server." Are any individual users downloading CC for potential use in the future? It may seem like a non-trivial task to process ~100TB at home today but in the future processing this amount of data will likely seem trivial. CC data is available for download to anyone but, to me, it appears only so-called "tech" companies and "researchers" are grab…

Is Common Crawl updated frequently?

They do monthly-ish releases https://index.commoncrawl.org/

Re: Two upstart search engines are teaming up to take on Google

#98

For me, it seems the direction for search is going towards AI sites. (Gemini, ChatGPT) Trying to reinvent Google/ Search in 2024 seems a bit like jumping the shark

The thing is, often I want articles, opinion pieces, and interesting reading. Sure, sometimes I'm searching for facts or answers to programming questions, but most of the time LLMs are not going to give me what I'm looking for.

Re: Two upstart search engines are teaming up to take on Google

#99

> “We could de-rank results from unethical or unsustainable companies and rank good companies higher,” Kroll says of the eco-minded Ecosia. Understandable knowing Ecosias goals, but I find it rather concerning their vision of a better search involves deciding what is good and bad. Ranking by quality (against spam & SEO sites) is fine, but it should be applied equally to all Websites, and not target specific companies…

> I find it rather concerning their vision of a better search involves deciding what is good and bad the entire purpose of a search engine is to do this, you've been grossly confused about the entire space if you think this isn't exactly what everyone is trying to do.

Yes, but it usually isn't "good or bad" in the moral judgement sense. Not to mention the many logical flaws involved with trying to make such prioritization. If I'm searching for say desert eagles refusing to return any gun related content and only giving me birds isn't helping anything or anyone.

Although come to think of it I'm surprised that I haven't heard of any attempts of fundamentalists to make "moral" search engines that do things like exclude evolution.

Re: Two upstart search engines are teaming up to take on Google

#100

I was hoping this will be about Kagi. A lot of companies that make bold promises of taking on Google end up in the drain 2 years later.

I'm a paying customer of Kagi.

Kagi itself runs on top of Google. It's certainly worth paying for (IMO), but let's not kid ourselves -- it is *not* a competitor (as in, can replace Google). Without Google, there is no Kagi.

Post reply on HN