Live data from Hacker News

DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

torrentfreak.com

41–50 of 475 posts

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#41
post #7

Quoted post unavailable.

Google pushed the envelope on how silly the name for a major company can be, but DuckDuckGo is unlikely to ever hit mass market success with that name. (Or, more importantly, the current implementation.)

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#42
post #15

Who really needs a search engine nowadays? The google or ddg or whatever is just a search aggregator for making no need to open Wikipedia for searching who is Franko then open weather.com for figuring out the weather next weekend then open SO for quitting vim and so on. I can not remember when I really searched something general last time which is impossible to find via single-site search. And of course free porn vid…

> Who really needs a search engine nowadays? Apparently a lot of people since google processes 6B searches every day?

I have no idea what the actual number is, but that sounds low. The average HNer probably hits three digits every day easily.

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#44
post #39

Serious Question: How is the DDG search structured? Is it a cosmetic skin over Bing, or is it aggregating from other sites like Yahoo, ecosia etc additionally? If it is just Bing under the hood, how does it exist as business entity. I am sure MS will take some action to consolidate their search share rather than seeing splintered.

They aggregate from "over 400 sources" and run their own crawler: https://help.duckduckgo.com/duckduckgo-help-pages/results/so...

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#45

I suspect this is largely due to DDG using Bing under the hood, which has led to similar weirdness in the past, eg all major porn sites disappearing from the results in Singapore (while Google still showed them, mind you!). Still super disappointing though, and yet another reason why trying to build a better search engine on top of someone else's tech is a non-starter.

Having worked on Google's indexing system, I can't imagine how much it would cost to write all of the crawling and indexing code from scratch, and then run it on over the visible web. You need to bootstrap somehow form an existing index if you want to get anywhere in any reasonable time.

If there's a market for alternative search engines out there, AWS is already serving so much of the web that Amazon should really provide crawling and basic indexing (for a fee, of course) so it's done once for everyone, with Amazon Lambda processing to allow search engines to customize their indexing. I'm not sure if it would make them much money, but it makes more sense to start up a search engine on AWS using Amazon's crawl and basic indexing vs. using a search engine competitor's crawl and indexing.

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#47
post #15

Who really needs a search engine nowadays? The google or ddg or whatever is just a search aggregator for making no need to open Wikipedia for searching who is Franko then open weather.com for figuring out the weather next weekend then open SO for quitting vim and so on. I can not remember when I really searched something general last time which is impossible to find via single-site search. And of course free porn vid…

> Who really needs a search engine nowadays? Apparently a lot of people since google processes 6B searches every day?

6B showings of ad-loaded webpage does not mean 6B successful results shown. And my claim is that most of successful google searches is just a wrong choice of a search engine.

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#49
post #39

Serious Question: How is the DDG search structured? Is it a cosmetic skin over Bing, or is it aggregating from other sites like Yahoo, ecosia etc additionally? If it is just Bing under the hood, how does it exist as business entity. I am sure MS will take some action to consolidate their search share rather than seeing splintered.

They aggregate from "over 400 sources" and run their own crawler: https://help.duckduckgo.com/duckduckgo-help-pages/results/so...

Do they list their "sources"?

It reads like they are saying a website = source, and the hyperlink for the sources is dead.

Re: DuckDuckGo Removes Pirate Sites and YouTube-DL from Its Search Results

#50
Funny how the narrative on DDG has changed. I used to get downvoted to oblivion for merely mentioning they used Bing under the hood. Where are all the people that used to defend them so vigorously? I wouldn't be surprised if it's the same people now hating on them.
Post reply on HN