Live data from Hacker News

Ask HN: Can you borrow Googles search algorithm?

news.ycombinator.com

11–14 of 14 posts

Re: Ask HN: Can you borrow Googles search algorithm?

#11
post #7

Mm... PageRank is the basis, but then recent publications suggest they use a multitude of factors (probably 7-10+?) to evaluate sites. PageRank is still more-or-less the biggest chunk, but since people learned how to game it, they've had to likewise step up their internal game on ranking. What you're requesting probably comes off as a trade secret, but you could probably get reasonable results using a PageRank inspir…

The pagerank algorithm is public and there exist a lot of implementations, for instance https://networkx.org/documentation/networkx-1.10/reference/g...

I’m pretty sure it was patented at the beginning so it should be free by now

Re: Ask HN: Can you borrow Googles search algorithm?

#12
What are you trying to achieve? Search your website's blog posts? Create an e-commerce search engine? Job search engine? Web search engine? Just learn about how search tech works?

All of these are radically different domains, some of which requiring intensive NLP, others requiring other domains...

Re: Ask HN: Can you borrow Googles search algorithm?

#13
post #8

I would recommend to start with a mature search engine such as Lucene or ElasticSearch.

Forgive me if this doesn't make sense: If I'm implementing search in an application and want to use NLP, do I need to train the search or are these solutions already ready to go? I'm not sure how other people do it/how search works/if you need to tell it what to do.

Well, of course the engine needs to have access to some corpus to search on. So the general answer to your question is: yes, however this step typically not called "training" but "indexing".

Most engines will repeatedly index your contents with crawlers or similar.

Re: Ask HN: Can you borrow Googles search algorithm?

#14

More prosaic but if you have a blog etc. you can add a Google programmable search engine: https://programmablesearchengine.google.com/about/

You can also put a DuckDuckGo search box, works well for website search and supports DDG instead of Alphabet.

EDIT: Shameless plug if it gets the author to go with a non-google option https://www.gkbrk.com/wiki/DuckDuckGoSearchBox/

Post reply on HN