11–20 of 45 posts
I have been thinking about this. I’d like to index the blogosphere and some knowledge base sites and stuff and exclude most of the Top1000 websites. I imagine I could do it on consumer hardware for less than $10-20k. Perhaps common crawl has done much of the heavy lifting already and I just have an indexing task.
I have been thinking about this. I’d like to index the blogosphere and some knowledge base sites and stuff and exclude most of the Top1000 websites. I imagine I could do it on consumer hardware for less than $10-20k. Perhaps common crawl has done much of the heavy lifting already and I just have an indexing task.
Plugging https://search.marginalia.nu/
I'm on a single ~$17k server now, probably utilizing about 20% of it's capacity.
Alternatives while probably fine in America, suck in the Nordics. I think people forget just how much search traffic happens in this category.
Google is a fine search engine.
Don't get me wrong, I still find anything I search for, on page 2-N
I switched to duckduckgo about 5 years ago and look back occasionally.
DDG simply works better for me. I find what I search for usually on page 1.
Just to put things into context: I don't care about google, meaning I have no beef with them. I used google search for many years until I switched the default engine, simply because the search results for how I search got worse over time.
[1] - https://docs.searxng.org [2] - https://github.com/ItzCrazyKns/Perplexica
The phonebook capabilities of pretty much all Google alternatives suck. Google is currently the only search engine that actually works for local queries (i.e. phone repair in ). Alternatives while probably fine in America, suck in the Nordics. I think people forget just how much search traffic happens in this category.
Google is a fine search engine.
Google is fine unless you need something really specific, chatgpt is better at this point for a lot of queries because Google give you the most simple answer no matter how specific you got with your keywords. I still miss the ability to use "".
So your "search engine" uses Google and DuckDuckGo to get results? and you are creating it because "Google sucks"? Am I missing something here?
Yeah I think they are trying to get a search-results-only view without the ads etc. Perhaps they would like startpage.com?
If that was the case then their description is completely off, as what they are doing is not creating a search engine but filtering results from other search engines.
I mean, just because you pipe your output to grep it does not mean you created an entirely new app.
So your "search engine" uses Google and DuckDuckGo to get results? and you are creating it because "Google sucks"? Am I missing something here?
Yeah I think they are trying to get a search-results-only view without the ads etc. Perhaps they would like startpage.com?