Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I'm shadow banned by DuckDuckGo and Bing

daverupert.com

Post reply on HN
Print view View original

11–20 of 205 posts

Re: I'm shadow banned by DuckDuckGo and Bing

#11

Post by mg »

Looking around his page, I see some interesting aspects on his atom page:

https://daverupert.com/atom.xml

First, he sends it with a "content-type: application/xml" header. In contrast to most sites that send it with "content-type: application/atom+xml". Which seems to have the nice effect that it renders in Firefox instead of opening the usual "What should Firefox do with this file?" popup.

Secondly, he provides this nice header text "Yahaha, you found me! This is my RSS feed.". It seems to be fetched via this part of the code:

Pretty nice. Are those best practices? Or will "content-type: application/xml" mess with users who have a native feed reader installed and expect the reader to kick in when they click on a feed url?

Re: I'm shadow banned by DuckDuckGo and Bing

#12

Post by donatj »

This triggered me to DuckDuckGo my own site and immediately I notice the top result is someone rehosting my OSS on a page loaded with pages of crap SEO content.

Scrolling further, I don’t seem to find my own site either… https://donatstudios.com

I’ve added my site into Bing webmaster tools, we’ll see if it helps I guess.

Re: I'm shadow banned by DuckDuckGo and Bing

#13

Post by pseudolus »

You've indicated that you've used Bing's tools to see if your website has been indexed but are silent as to whether you've actually manually submitted your site to be indexed by Bing using their url submission tool [0]. If you do submit the URL and then, after a decent interval, your site still doesn't show up then there might be something to your claim.

[0] https://www.bing.com/webmasters/help/url-submission-62f2860b

Re: I'm shadow banned by DuckDuckGo and Bing

#14

Post by omgmajk »

At the bottom of the page there is a comment that says "Some results have been removed", but unlike Google you can't see them. Would be interesting to know if the domain is among the removed results or if the site has not just been indexed yet.

Re: I'm shadow banned by DuckDuckGo and Bing

#15

Post by sct202 »

You can submit a ticket to bing via their webmaster tools website. I've done it before in the past and a real human did respond at the time. In my experience bing will straight deindex full websites for unknown reasons while Google will ranking penalize but leave you searchable if their algo feels you deserve it.

Re: I'm shadow banned by DuckDuckGo and Bing

#16

Post by rzzzt »

mg wrote: post #11

Looking around his page, I see some interesting aspects on his atom page: https://daverupert.com/atom.xml First, he sends it with a "content-type: application/xml" header. In contrast to most sites that send it with "content-type: application/atom+xml". Which seems to have the nice effect that it renders in Firefox instead of opening the usual "What should Firefox do with this file?" popup. Secondly, he provides this…

XSLT is a template language where you match snippets of XML using XPath expressions and output... anything else, in this case HTML using templates that can make use of the attributes, inner content, etc. of the captured XML portion.

"An elegant weapon for a more... civilized age."

Re: I'm shadow banned by DuckDuckGo and Bing

#18

Post by Pelam »

mananaysiempre wrote: post #7

For some reason, Beej’s Guide to C Programming is also banned from Bing (and consequently DDG) [1], with the standard robotic non-explanations given when the author asked, even though the rest of the site is not. [1] https://beej.us/guide/bgc/whynoddg.html

I can find Beej.us with DDG, but not daverupert.com. Maybe Beej got the problem resolved somehow.

Re: I'm shadow banned by DuckDuckGo and Bing

#19

Post by mananaysiempre »

Pelam wrote: post #18
mananaysiempre wrote: post #7

For some reason, Beej’s Guide to C Programming is also banned from Bing (and consequently DDG) [1], with the standard robotic non-explanations given when the author asked, even though the rest of the site is not. [1] https://beej.us/guide/bgc/whynoddg.html

I can find Beej.us with DDG, but not daverupert.com. Maybe Beej got the problem resolved somehow.

He says in the link it’s specifically the C guide, the rest of the website is fine. Though... yeah, DDG queries like “beej c guide strlen” give reasonable results for me, if with an unjustifiably high-ranked position for the mirror at http://docs.hfbk.net/beej.us. Bing ones only include the mirror and the other guides (and a Scribd-hosted PDF copy, of all things, as the first result below a huge navigation card referring to https://beej.us/guides but without the C guide among the links).
Post reply on HN