71–80 of 131 posts
I know (almost) nothing about search engines but I hope something like this succeeds.
Searched Red Dead Redemption 2 - no game info
Searched "bobs" - no bobs
I'm Marcus, founder of Didyougogo and author of the software behind it. For the past ten years I've been trying to improve my programming and math skills to get to a level where I could write a proper web search engine for the written word using absolute cutting-edge IR methods. The final result is something I have not seen or read about: a language represented as a 65K wide vector-space, serialized into a binary tre…
I'm glad I could make you curious about this. I will gladly expand on the documentation around the language model and querying as soon as I can. In broad terms: its a 16-bit vector space in which you can encode anything you like. I have chosen to encode phrases and words as bags-of-characters. This separates terms from each other enough that they can be searched for reliably (in almost all cases). Terms that share a…
It would be surprising (to me) to get the same results for e.g. "strange" and "garnets".
Awesome, but man, that name really needs some work. It sounds like I'm asking a two-year-old whether he's been on the potty.
Earlier quoted context omitted.
The catch is: this is 0.1 alpha software. I need a small team and some server capacity to get rolling. I need people to submit URLs. And a few hundred queries per second. That would scare the living shit out of big league search engines and might wake up some investor wanting to throw money at this.
In addition to users submitting articles, is there a reason this doesn't have a spider of its own based off something like the Google zeitgeist to seed some topics? This project looks neat, I think first experiences with it would be much more improved if you could seed it with some content. Maybe this could run my search with other search engines to compare and gain insights.
Yes, server capacity. Once I have a better hosting situation I'll start crawling.
Thank you, I've tried to be neat this time around.
With regards to full-text search, the didyougogo search engine should be able to replace elasticsearch (which is laughable relevance-wise in my eyes) or solr, once the alpha-bugs are gone.
Love the ambition, but a long way to go go.
The index is super tiny. A search for "the" got 112 results. Seems like a quick way to explore the entire index. Also it indexes pages twice if you submit them twice, so that needs to be fixed. But for some crazy reason, I kinda like this. It feels like the 90s internet. The links included so far have that same random mix of lots of nerdy links, homepages & personal blogs, a few religious sites, and the occasional bi…