RIP StumbleUpon.
Ask HN: Is there a search engine which excludes the world's biggest websites?
221–230 of 236 posts
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#222RIP StumbleUpon. The randomized search engine I want back.
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#223in the same vein, it would be awesome to search for a product to buy with the results being ecomm websites owned by people in my area. A way to "shop local" online.
I'm curious how English speakers (especially not in US?) finding national shopping websites because I live in Japan so never find foreign website written in Japanese
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#224I sometimes use "inurl:wordpress" when searching for travel info. This ensures more first-person blog accounts, rather than all the tripadvisor junk that's at the top.
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#225RSS used to be this. Google has done its best to kill it.
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#226I think there's a simple google way. Just add `-bigwebsite.com` to your query. [search term] -google -youtube -facebook ... -top100website and it should work. I found a list of the top 1m alexa websites here: http://s3.amazonaws.com/alexa-static/top-1m.csv.zip An add-on with that list should do the work.
That's pretty clunky. - there's probably a pretty low limit for size of Google queries, you'll likely hit it quickly - you won't be able to search for e.g a story about YouTube censoring some content
Filtered out regional sites that Google wouldn't cater my search for (eg Taobao, Baidu, etc).. Only possible with 31 negative sites.
-site:google.com -site:youtube.com -site:facebook.com -site:jd.com -site:yahoo.com -site:wikipedia.org -site:amazon.com -site:netflix.com -site:reddit.com -site:live.com -site:zoom.us -site:okezone.com -site:alipay.com -site:instagram.com -site:twitch.tv -site:csdn.net -site:blogspot.com -site:microsoft.com -site:bing.com -site:github.com -site:tribunnews.com -site:myshopify.com -site:office.com -site:panda.tv -site:stackoverflow.com -site:ebay.com -site:bongacams.com -site:livejasmin.com -site:babytree.com -site:naver.com -site:apple.com
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#227For more queries, you can add modifiers to a Google Search to get the results you want
Seeing folks mention the NOT operator (-). It's quite powerful! For example, you can do:
intext:"Powered by intercom" -site:intercom.com will find all the sites that use the Intercom widget
or ~blog bread baking -inurl:checkout -intext:checkout will find bread blogs (or similar) without commercial intent
I put together a list of the two dozen or so most useful templates of this, for folks who are interested: https://www.alec.fyi/dorking-how-to-find-anything-on-the-int...
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#228You can boot up your own custom search engine in a few minutes with YaCy (Ya See!) an open-source, P2P, Dockerized crawler and search engine built on top of Solr. https://yacy.net/ If you're generous; you can make your index available to other P2P instances. I wanted to run an API search the other week and was blown away with how quickly I could prop-up my own custom search portal (I didn't want to pay for API access…
I have my own yacy search engines running internally (non-peered) for similar reasons. One crawls some key code documentation sites that I need for work, and another crawls a whole bunch of music blogs.
While I typically still use RSS for reading music blogs, I find having the search engine is a great way to go back and find something or discover something new! Every time I find a new blog, I just add it as an index to yacy to crawl.
I think it'd be great to see people spinning up larger instances that are highly specialized. For example, maybe a search engine that is dedicated solely to sci-fi and only crawls high quality boards, personal sites and blogs, and skips all the spammy, seo-optimized sites.
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#229This is a great question, I also want a way to search the internet but exclude all major media domains as well as any company over a certain size. So I just want to search through old blogs, SO, non-corporate social media, weird forums, etc. There are so many cool things I remember reading on the web like 10-20 years ago that still exist that are so buried now on Google they might as well not exist. Nowadays searchin…
For years, my trick for finding interesting content was to go to, say, the 7th page of Google results, and start there. This doesn't work anymore -- it's SEO-optimised listicle blog posts all the way down. My trick now is to use Twitter to discover interesting people, and follow them there. Granted, it's not a search engine, but it's at least given me the ability to discover weird things again.
I was about to ask about dmoz.org. But apparently it's dead. We could probably do something with bookmark sharing à la Delicious. Good dead things for a better future.
Re: Ask HN: Is there a search engine which excludes the world's biggest websites?
#230I think there's a simple google way. Just add `-bigwebsite.com` to your query. [search term] -google -youtube -facebook ... -top100website and it should work. I found a list of the top 1m alexa websites here: http://s3.amazonaws.com/alexa-static/top-1m.csv.zip An add-on with that list should do the work.
your query would obviously be too long for Google
yeah, that's sad. Google limits its queries to just 32 words.