161–170 of 236 posts
I think there's a simple google way. Just add `-bigwebsite.com` to your query. [search term] -google -youtube -facebook ... -top100website and it should work. I found a list of the top 1m alexa websites here: http://s3.amazonaws.com/alexa-static/top-1m.csv.zip An add-on with that list should do the work.
This is a great question, I also want a way to search the internet but exclude all major media domains as well as any company over a certain size. So I just want to search through old blogs, SO, non-corporate social media, weird forums, etc. There are so many cool things I remember reading on the web like 10-20 years ago that still exist that are so buried now on Google they might as well not exist. Nowadays searchin…
Heh, I was trying to do research on coronaviruses (of which COVID-19 is one of many coronaviruses), but Google sanitized the result and only showed me "official" COVID-19 resources and buried the broader coronavirus resources. https://www.google.com/search?q=coronavirus
A search engine that returns results whose pages weigh in under a certain size.
From the comments it seems most of the "cruft" filling up Google results are newer web apps, generally JS-heavy and advertising-heavy, etc.
If you had a filter for pages with (e.g.) There are plenty of false positives (particularly for "small" forums build with modern JS apps, etc), but it could be one of many filtering tools to achieve better search results.
It feels like there could be a (partial) meta solution here: A search engine that returns results whose pages weigh in under a certain size. From the comments it seems most of the "cruft" filling up Google results are newer web apps, generally JS-heavy and advertising-heavy, etc. If you had a filter for pages with (e.g.) There are plenty of false positives (particularly for "small" forums build with modern JS apps, e…
For google you can use this https://addons.mozilla.org/en-US/firefox/addon/g-search-filt... , just drop in your list of those 500 URLs, once you've decided on what the top 500 is. For other engines you can use https://addons.mozilla.org/en-US/firefox/addon/greasemonkey/ with this script https://greasyfork.org/en/scripts/1682-google-hit-hider-by-d...
https://wiby.me/ exists to solve this exact problem. I've found some pretty neat/odd websites on it in the past.
Popularity, Relevance, Age, Type, etc. type could be blog, forum, site, or video. Or like it used to be.
There is Million Short which allows you to search without the top 100, 1k, 10k, 100k, or 1m sites. Personally what I'd like to see is a search engine that only indexes webpages without ads since that should eliminate lots of the SEOd garbage. It would also be nice to use the text to code ratio to derank JS heavy sites. https://millionshort.com/
Not just ads, but also ranked by the number of third-party cookies/tracking scripts a site has.