A look at search engines with their own indexes (2021)
1–10 of 28 posts
Re: A look at search engines with their own indexes (2021)
#2It needs updating to include you.com, perplexity, etc. Most of those are google reskins/emulators but they are there non the less
Re: A look at search engines with their own indexes (2021)
#3It needs updating to include you.com, perplexity, etc. Most of those are google reskins/emulators but they are there non the less
> a look at search engines with their own indexes
Re: A look at search engines with their own indexes (2021)
#4Is there some 80/20 rule for web indexing?
I’m not saying having deep per-page indexing of Reddit, for example, isn’t useful. But is there any value in a breadth-focused index that is far cheaper to maintain?
Re: A look at search engines with their own indexes (2021)
#5Missed exa.ai! Embeddings-based search engine with its own index
Re: A look at search engines with their own indexes (2021)
#6It needs updating to include you.com, perplexity, etc. Most of those are google reskins/emulators but they are there non the less
Perplexity have their own index now, though it's not clear to me how much they use that over Bing in their core experience.
It's also hard to find information about it (they really need to write more about it), but it's mentioned in this article: https://thenewstack.io/more-than-an-openai-wrapper-perplexit...
Re: A look at search engines with their own indexes (2021)
#7Is there some 80/20 rule for web indexing? I’m not saying having deep per-page indexing of Reddit, for example, isn’t useful. But is there any value in a breadth-focused index that is far cheaper to maintain?
Almost certainly. Internet search is above all a problem of improving the signal to noise ratio.
There's an inordinate amount of documents that will never be a good search result for any query. Both in trivial cases that have barely anything to index in them, but also sign-up forms, cookie policies, redundant information (e.g. any given man page exists in dozens if not hundreds of identical copies on the web).
Re: A look at search engines with their own indexes (2021)
#8Missed exa.ai! Embeddings-based search engine with its own index
How does an embeddings based search work? Without hallucinating bad links?
Re: A look at search engines with their own indexes (2021)
#9Related:
A look at search engines with their own indexes (2021) - https://news.ycombinator.com/item?id=31820149 - June 2022 (114 comments)
Re: A look at search engines with their own indexes (2021)
#10I have been somewhat impressed by Mojeek, but it does have two obvious flaws:
1) It not really good for localized search, it might be if you're local to the US or UK.
2) No !bangs. Coming from Ecosia I frequently just do !w !maps !yt because I know where I want the answer to come from
For English language searches, it completely usable, but not quite as good as Bing or Google. I really wanted to try to use Mojeek as my default for an extended period of time, but the lack of good local search makes it a bit annoying.