Live data from Hacker News

Filters to block and remove copycat-websites from DuckDuckGo, Google and other

github.com

61–70 of 114 posts

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#61
post #23

I use Kagi as a search engine and can just block the site from the search results.

Kagi filters are great for programming, but still evolving for others. I still see a lot of pinterest results. You can block domains by adding them to Kagi blocklist through Settings -> Personalized Results -> Blocked Domains.

There's also a boost/block button right on the search results page.

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#62
post #27
post #21

I never understood why Google isn't blocking these crap results, it's really making my experience of search really bad for a light of my searches

Do they do a good job at getting clickthroughs on Google ads on their site? :-/ Does the rate of ad-clicking on the results page increase if most of the "natural" results are crap? :-(

Don't be evil

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#63
post #32
post #21

I never understood why Google isn't blocking these crap results, it's really making my experience of search really bad for a light of my searches

They used to be superb on detecting duplicated content. They also were extremely good at detecting spam/ham. Nowadays it feels like they don't even care anymore and whatever filters they have are either broken or untrained.

It is an arms race.

I wonder how many players on the page generation side? The economics of it must be marginal, I guess

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#64
post #37

Earlier quoted context omitted.

Pinterest is one of those sites that really makes me want to strangle someone. It’s just an abhorrent walled garden of other people’s property.

Pinterest is one of those sites that I would block forever, if I could customise my search experience.

As much as I avoid giving google any of my money I would literally pay them to be able to block domains from results.

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#65
post #37

Earlier quoted context omitted.

Pinterest is one of those sites that really makes me want to strangle someone. It’s just an abhorrent walled garden of other people’s property.

Pinterest is one of those sites that I would block forever, if I could customise my search experience.

Add this to your browser's search engine list and make it default:

    {google:baseURL}search?q=%s+-site:pinterest.*

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#67
post #21

I never understood why Google isn't blocking these crap results, it's really making my experience of search really bad for a light of my searches

They probably are. But the clone sites are designed specifically to avoid being blocked by google.

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#68

I know there’s some serious chicken/egg issue here, and solves a different problem than Google or DDG. but I think what I need is a way to “Like” or “Favorite” a page I’m on (maybe just a bookmark?) and that triggers my personal search indexer which will then index that page. Then maybe optionally “follow” other people’s favorites as part of your own results. Imagine someone crawling Twitter or SoF and you just “foll…

In the end there is no perfect solution because the whole thing is gamed too much. Eventually spam sites will start paying popular users to like their spam page.

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#69

Earlier quoted context omitted.

For a long time now, Google has weighted behavioral signals similar to what you describe. "Bounce Rate" is the percentage of users who quickly leave your site after clicking. "Dwell Time" is the amount of time a user spends on a page. There's even a cottage industry around gaming these signals. See SerpClix and the like.

So are you suggesting that GOOG is using bounce rate on the target site (assuming it uses gAnalytics I take it - otherwise how would they know?) to alter the ranking of search results (like "90% of users bounce in the first two seconds on scam.copycat.com/seemed-useful so we're demoting its rank by 20%"?) That would be interesting, I was musing more about if GOOG does any session tracking on their end to try and infe…

Stop using stock ticker names to refer to companies. It's cringe and not even easier to type.

Re: Filters to block and remove copycat-websites from DuckDuckGo, Google and other

#70
I'm seeing a lot of Github clones on DDG lately. Some even stealing the GH favicon. I can't fathom what their goal is other than to inject exploits into devs who are high value targets. You'd think a responsible search engine would be culling these for the sake of general security.
Post reply on HN