Live data from Hacker News

A New Search Engine

0x65.dev

31–40 of 107 posts

Re: A New Search Engine

#31

Anybody knows Cliqz's database stack? Curious to see what powers a large scale information retrieval index of this sort.

[Disclaimer I work at Cliqz] There is a lot of systems under the hood, depending if it's the main index or the freshness index. But if I have to pick one as database it should be Keyvi (https://github.com/KeyviDev/keyvi).

FYI, there will be a bunch of articles regarding search in the next week.

Re: A New Search Engine

#32

What I really want, is not another search engine for contextless queries. Except for really basic queries (which Google/etc already do a good job at), I'm trying to answer a question, perhaps open-ended, and it will take multiple queries to resolve. And it's not a linear process of narrowing down with + or - keywords. It's establishing a context: I'm searching for something relevant to "go" the language, not "go" the…

I believe this is called faceted search.

For the first level context, you're right. Does faceted search also allow the ability to specify "near this link"? Like a "warmer" or "colder" approach to searching, where I can train the engine during the search?

I also want to maintain a longer-term list of pages/sites to exclude. Like, unless otherwise specified, I never want results from w3schools or expertsexchange.

This field is ripe for disruption, in my opinion. We can do so much better, but I've not seen any serious attempts.

Re: A New Search Engine

#33
The nationalism on the homepage is a little odd... in particular since they're still essentially building on top of Google.

https://cliqz.com/en/

> Europe has failed to build its own digital infrastructure. US companies such as Google have thus been able to secure supremacy. They ruthlessly exploit our data. They skim off all profits. They impose their rules on us. In order not to become completely dependent and end up as a digital colony, we Europeans must now build our own independent infrastructure as the foundation for a sovereign future. A future in which our values apply. A future in which Europe receives a fair share of the added value. A future in which we all have sovereign control over our data and our digital lives. And this is exactly why we at Cliqz are developing digital key technologies made in Germany.

Re: A New Search Engine

#34
We need a smarter search.

One that is based on analyzing the content of a page then on it's page rank.

Self speaking that it has to be open source.

Apache SOLR would be a good starting point.

Re: A New Search Engine

#35

What I really want, is not another search engine for contextless queries. Except for really basic queries (which Google/etc already do a good job at), I'm trying to answer a question, perhaps open-ended, and it will take multiple queries to resolve. And it's not a linear process of narrowing down with + or - keywords. It's establishing a context: I'm searching for something relevant to "go" the language, not "go" the…

> I want to be able to open a jupyter-like notebook with the start of my search query, and the first step should be to show me the available eigencontexts

AltaVista used to do this. I miss it terribly.

Re: A New Search Engine

#36

I would like to read this but I can't reach the web server. Is it just me? Had the same issue with another article from this same site a couple of days ago. Looks like everyone else is able to read it but for some reason not me. Anyone know what's going on?

Maybe it is just you. For me, it works. Not sure why it does not load for you.

Re: A New Search Engine

#37

The nationalism on the homepage is a little odd... in particular since they're still essentially building on top of Google. https://cliqz.com/en/ > Europe has failed to build its own digital infrastructure. US companies such as Google have thus been able to secure supremacy. They ruthlessly exploit our data. They skim off all profits. They impose their rules on us. In order not to become completely dependent and end…

Well, I think they're right (American here).

Re: A New Search Engine

#38
If you are going to make a new search engine, you need to attack a problem that people have, like Duckduckgo solving privacy issues. I don't want to install something that collects a bunch of personal info about me. A better idea is to search bookmarked sites and the cache. And do it locally.

Re: A New Search Engine

#39
I like Cliqz and am already impressed with the results for several of my test queries, though they certainly have a ways to go.

But what I would really like to see, as has been mentioned in other threads, is an open-source or community-funded search engine. Something that "belongs to the web" itself, so to speak, and not to any particular corporation.

Post reply on HN