Building a Search Engine from Scratch

Post by lisper » Sat, Dec 07, 2019, 8:49 PM UTC

iudqnolq wrote: post #139

lisper wrote: post #137

Earlier quoted context omitted.

If you're going to indulge in that level of paranoia, how do you know that DDG is not itself a secret Microsoft conspiracy to destroy the world? If you don't know the terms under which DDG licenses Bing's search results, how do you know that those terms don't give MS complete control over DDG?

I think I was too snide in my comment and it wasn't clear. I meant that if Microsoft launched a privacy-focused product and hid their involvement with it they would receive extremely negative publicity on the sort of websites people who use privacy-focused products read. Completely leaving aside the harm that would cause to the Microsoft brand, it would also be completely useless. Essentially no one would switch from…

Post by lisper » Sat, Dec 07, 2019, 9:00 PM UTC

iudqnolq wrote: post #142

lisper wrote: post #141

Earlier quoted context omitted.

There is a difference between hiding your involvement and not going out of your way to draw attention to it.

Yes. Do you believe that a HN discussion of a company owned by Microsoft that doesnt draw attention to that and which markets towards privacy-focused users would he received positively?

Post by based2 » Sun, Dec 08, 2019, 2:06 PM UTC

Post by citilife » Mon, Dec 09, 2019, 1:22 AM UTC

aldoushuxley001 wrote: post #76

citilife wrote: post #4

Also having built a search engine from scratch, we use a similar method: https://insideropinion.com/ In our case the "queries" are also the index creation components. Every time someone discusses something, we are indexing it, so you can search media, documents, people from context. We hint at how this works here: https://austingwalters.com/fast-full-text-search-in-postgres... The downside of our approach is it needs…

I remember reading your article on FTS in postgres, great stuff. Was wondering what strategies you might be using to perform counts on your data? I'm trying to implement a faceted search in postgres and currently using window functions to count subcategories (a la http://akorotkov.github.io/blog/2016/06/17/faceted-search/ ), but not sure if it's the most efficient.

Post by NicoJuicy » Mon, Dec 09, 2019, 11:17 PM UTC

liability wrote: post #88

tschakkaMarc wrote: post #66

Earlier quoted context omitted.

It’s the one time where I can honestly say: The discussion we’re having within Cliqz about our brand name are even more heated and controversial than here on Hacker News (and Reddit for that matter) ... but then there is this saying: “Every brand name is shit until you surpass one billion users - than it becomes brilliant”. More seriously: we do think about it a lot - happy to get ideas.

How are there even two sides to the discussion internally? I'd sooner cut off my left nut with a spoon than trust any company named 'Cliqz.' You might as well name yourself "Nigerian Princes Inc."