Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is there a search engine which excludes the world's biggest websites?

news.ycombinator.com

Post reply on HN
Print view View original

51–60 of 236 posts

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#52

Post by stolenmerch »

Scoundreller wrote: post #34
noad wrote: post #4

This is a great question, I also want a way to search the internet but exclude all major media domains as well as any company over a certain size. So I just want to search through old blogs, SO, non-corporate social media, weird forums, etc. There are so many cool things I remember reading on the web like 10-20 years ago that still exist that are so buried now on Google they might as well not exist. Nowadays searchin…

Heh, I was trying to do research on coronaviruses (of which COVID-19 is one of many coronaviruses), but Google sanitized the result and only showed me "official" COVID-19 resources and buried the broader coronavirus resources. https://www.google.com/search?q=coronavirus

COVID-19 isn't a coronavirus, it's the disease caused by the SARS-CoV-2 virus.

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#54

Post by piusp »

I have used copernik in the past this was a collection of search engines, listing more than 140 search engines. It combined the search results and sorted them by the key word % matched. It also had a lot of tools inbuilt for validating he links, coping the selection/ sorting and sharing the results. Simply amazing results.

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#55

Post by erikbye »

For google you can use this https://addons.mozilla.org/en-US/firefox/addon/g-search-filt..., just drop in your list of those 500 URLs, once you've decided on what the top 500 is.

For other engines you can use https://addons.mozilla.org/en-US/firefox/addon/greasemonkey/ with this script https://greasyfork.org/en/scripts/1682-google-hit-hider-by-d...

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#56

Post by chris_f »

crawlcrawler wrote: post #23

I built a search engine for this and other, similar purposes. With Crawl Crawler you start out by searching the meta data of a Common Crawl ("CC") crawl. Then you define a sub section of that data collection by designing a query which search result includes your favorite sites. Then you enrich that sub section by linking those meta data documents (that come from CC's WAT repo) to full text extracts or HTML from CC's…

This is pretty cool. I always wondered why there wasn't a user interface search somewhere for the CommonCrawl data.

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#57

Post by Aeolun »

21xhipster wrote: post #53

https://cyber.page Its kinda new so it excludes kinda everything :-) But you can make it work better :-) https://ipfs.io/ipfs/QmQ1Vong13MDNxixDyUdjniqqEj8sjuNEBYMyhQ...

Can you explain to me what this it is (or is meant to be)? It doesn’t appear to have a search field, though the lightning effects are impressive.

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#58

Post by ganstyles »

stolenmerch wrote: post #52
Scoundreller wrote: post #34

Earlier quoted context omitted.

Heh, I was trying to do research on coronaviruses (of which COVID-19 is one of many coronaviruses), but Google sanitized the result and only showed me "official" COVID-19 resources and buried the broader coronavirus resources. https://www.google.com/search?q=coronavirus

COVID-19 isn't a coronavirus, it's the disease caused by the SARS-CoV-2 virus.

Giving you the benefit of the doubt, and assuming this isn't just pedantry, especially since you're getting downvotes (because I assume everyone thinks this is just pedantic correction) I looked it up.

In the context of "trying to do research on coronaviruses" your comment appears to be not only correct but an important distinction, rather than the pedantry it appears to be.

From Wikipedia: "...more lethal varieties [of coronaviruses] can cause SARS, MERS, and COVID-19."

And...

"Severe acute respiratory syndrome coronavirus 2 [SARS-CoV-2] is the strain of coronavirus..."

I learned something today!

Re: Ask HN: Is there a search engine which excludes the world's biggest websites?

#60

Post by docbrown »

stolenmerch wrote: post #52
Scoundreller wrote: post #34

Earlier quoted context omitted.

Heh, I was trying to do research on coronaviruses (of which COVID-19 is one of many coronaviruses), but Google sanitized the result and only showed me "official" COVID-19 resources and buried the broader coronavirus resources. https://www.google.com/search?q=coronavirus

COVID-19 isn't a coronavirus, it's the disease caused by the SARS-CoV-2 virus.

[retracted] and I hope this is just a misunderstanding. As the director of the World Health Organization (WHO) said, 2019-nCoV is a novel (new) coronavirus.[0] The CDC defines coronavirus as a virus that was not previously known — check the FAQ, “what is a novel coronavirus?”[0.5]

They changed the name of this coronavirus to reflect the disease more accurately to COVID-19.[1]

The CDC has a list of other coronavirus’ that have existed.[2]

0: https://twitter.com/DrTedros/status/1227297754499764230?s=20

0.5: https://www.cdc.gov/coronavirus/2019-ncov/faq.html

1: https://www.who.int/dg/speeches/detail/who-director-general-...

2: https://www.cdc.gov/coronavirus/types.html

——

Edit: Since there seems to be a misunderstanding from everybody’s part on this as it’s referred to as both and often interchangeably in a mainstream setting, take a look at John Hopkins guide: https://www.hopkinsguides.com/hopkins/view/Johns_Hopkins_ABX...

Post reply on HN