Show HN: Building a web search engine from scratch with 3B neural embeddings
1–10 of 124 posts
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#2Very nice project. Do you have plans to commercialize it next?
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#3This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why what was once a razor exact search engine like Google, it cannot find verbatim or near verbatim quotes of content I remember seeing on the internet.
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#4This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why…
I see you’re also having trouble coping with this. Fact is, “that” internet is simply gone.
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#5This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why…
My understanding was that every few months Google was forced to adjust their algorithms because the search results would get flooded by people using black hat SEO techniques. At least that's the excuse I heard for why it got so much worse over time.
Not sure if that's related to it ignoring quotes and operators though. I'd imagine that to be a cost saving measure (and very rarely used, considering it keeps accusing me of being a robot when I do...)
From what I understand, that good old Google from the 2000s was built entirely without any kind of machine learning. Just a keyword index and PageRank. Everything they added since then seems to have made it worse (though it did also degrade "organically" from the SEO spam).
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#6This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why…
I see you’re also having trouble coping with this. Fact is, “that” internet is simply gone.
Nah, its a series of tubes, just gotta get the right tubes together.
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#7This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why…
My understanding was that every few months Google was forced to adjust their algorithms because the search results would get flooded by people using black hat SEO techniques. At least that's the excuse I heard for why it got so much worse over time. Not sure if that's related to it ignoring quotes and operators though. I'd imagine that to be a cost saving measure (and very rarely used, considering it keeps accusing m…
That begs the question, if you can recreate their engine from the 2000s with high quality search results, would investors even fund you? Lol
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#8This then begs the question for me, without an LLM what is the approach to build a search engine? Google search used to be razor sharp, then it degraded in the late 2000s and early 2010s and now its meh. They filter out so much content for a billion different reasons and the results are just not what they used to be. I've found better results from some LLMs like Grok (surprisingly) but I can't seem to understand why…
My understanding was that every few months Google was forced to adjust their algorithms because the search results would get flooded by people using black hat SEO techniques. At least that's the excuse I heard for why it got so much worse over time. Not sure if that's related to it ignoring quotes and operators though. I'd imagine that to be a cost saving measure (and very rarely used, considering it keeps accusing m…
The majority of the public internet shifted to "SEO optimized" garbage while the real user-generated content shifted to walled gardens like Instagram, Facebook, and Reddit (somewhat open). More recently, even use generated content is poisoned by wannabe influencers shilling some snake oil or scam.
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#9This is so cool. A question on the service mesh - is building your own typically the best way to do things?
I'm new to networking..
Re: Show HN: Building a web search engine from scratch with 3B neural embeddings
#10Earlier quoted context omitted.
My understanding was that every few months Google was forced to adjust their algorithms because the search results would get flooded by people using black hat SEO techniques. At least that's the excuse I heard for why it got so much worse over time. Not sure if that's related to it ignoring quotes and operators though. I'd imagine that to be a cost saving measure (and very rarely used, considering it keeps accusing m…
That begs the question, if you can recreate their engine from the 2000s with high quality search results, would investors even fund you? Lol
> if you can recreate their engine from the 2000s
Seriously, how? Iam pretty sure you have to have a very different approach than google had in its best times. The web is a very different place now