Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We compete with GitHub. Bing does not show our website

codeium.com

Post reply on HN
Print view View original

51–60 of 93 posts

Re: We compete with GitHub. Bing does not show our website

#51

Post by aunch »

rjbwork wrote: post #48
jeroenhd wrote: post #45

Your website isn't quick to find by Duckduckgo or Qwant either. Yahoo doesn't seem to show much either. Startpage.com does find it, though. I do consistently get your VS Code addon in the first page of search results, though. When I open up your website I don't really see much. A brand name and some download links are all I can find. I'm not sure if there's much for search engines to find, really. Your homepage also…

DDG is powered by Bing, FWIW.

yep, DDG is honestly what got us worrying about this due to its popularity in dev circles, which is who we are trying to reach

Re: We compete with GitHub. Bing does not show our website

#52

Post by codetrotter »

doodlesdev wrote: post #36
cypress66 wrote: post #26

4chan also does not show on Bing for me, but it does for some people it seems.

You weren't kidding. Even with "safe search" off, it doesn't appear there [0] LOL. However weird, maybe that's a good thing. [0]: https://www.bing.com/search?q=4chan

I clicked your link and it came up on the very top of the page without having to scroll or anything.

https://i.imgur.com/yfmXHSa.png

I almost never use Bing, and am pretty sure I’ve never even opened Bing on my phone at all before. Settings show that “Safe search” was at “Moderate”, presumably the default.

https://i.imgur.com/1QB5PUI.png

On an unrelated note, Bing uses purple as the default color for all links? That’s confusing to me. Purple to me on the web used to mean previously visited. The only board on 4chan I visit these days is /g/ and only very rarely as well. Scrolling the Bing results, all results have purple color.

Re: We compete with GitHub. Bing does not show our website

#53

Post by aunch »

dharmab wrote: post #44
sheetjs wrote: post #40

Last year, Bing and Edge erroneously flagged our website https://sheetjs.com/ as "dangerous": https://i.imgur.com/BvA3zrk.png At the time, there was no "Safety Report" to indicate why Bing thought it was dangerous. The report page linked to https://www.bing.com/toolbox/bing-site-safety?url=https%3a%2... and it said "That web page doesn't exist" To fix it, we had to register with "Bing Webmaster Tools" ( https://www.b…

This happened to a team I was on with Google Safe Browsing. The company was a competitor to Google in certain industries. An internal domain was flagged after a security researcher set up an intentionally vulnerable service and visited it in Chrome. The particular domain was shared with some other internal services which caused an internal outage. We registered in the Google Search Console, then leveraged some indust…

oof that's rough. good to know what it took for you though, thanks!

Re: We compete with GitHub. Bing does not show our website

#55

Post by jakear »

Bing's weird with some websites. For instance it will refuse to show the bun homepage (bun.sh) with anything short of a direct copy of the title: "Bun — fast all-in-one JavaScript runtime", even then it gives you a link with a `?ref=hackernoon.com` query parameter for some reason?

It is happy to show its github repo and a bunch of blogspam about it though.

It is even happy to link you to bun.sh/install, which immediately downloads a shell script to your computer upon clicking. Bizarre.

Re: We compete with GitHub. Bing does not show our website

#56

Post by linhns »

jeroenhd wrote: post #45

Your website isn't quick to find by Duckduckgo or Qwant either. Yahoo doesn't seem to show much either. Startpage.com does find it, though. I do consistently get your VS Code addon in the first page of search results, though. When I open up your website I don't really see much. A brand name and some download links are all I can find. I'm not sure if there's much for search engines to find, really. Your homepage also…

DDG is not much different from Bing nowadays.

Re: We compete with GitHub. Bing does not show our website

#57

Post by jsnell »

> Now, is it really because we compete with Github? Honestly, probably not, but controversy drums up interest and we need interest so that someone out there on the Internet can tell us what we're doing wrong.

It's pretty slimy to imply in the clickbait title that you're being blocked due to competing with MS, when you know well that it's not the reason. Admitting it's clickbait in the last paragraph doesn't make it any better.

The HN title should really be edited to remove the "We compete with GitHub" part.

Re: We compete with GitHub. Bing does not show our website

#58

Post by arp242 »

lelandfe wrote: post #47
arp242 wrote: post #28

There's loads of stuff that Bing doesn't index very well. If you turn of JS there's almost no actual text on the site; only the FAQ has any serious amount of text. This probably doesn't help. Having the page open also really slows down my laptop and constantly uses ~50%-75% CPU and ~130M memory. No idea if that's a factor, but it takes quite a lot of computing resources to actually make the homepage render any text a…

JS-dependent sites are crawlable by bingbot, and Googlebot, and have been for years now. Otherwise, much of the modern web would be absent from search. Things can still happen, but it doesn't look like OP is doing anything unusual with rendering. If Google can crawl, I'd be surprised if Bing was entirely stumped (plus: meta descriptions). > Having the page open also really slows down my laptop and constantly uses ~50…

> JS-dependent sites are crawlable

Yes, I know; but there are limits on this, otherwise people would be mining Bitcoin via search indexers and whatnot. Like I said: I don't know if this is a factor here, but it might be. It's something that should probably be addressed either way.

The initial render time is fine. It just constantly uses CPU, according to htop and the Firefox process viewer, and it noticeably slows down everything.

Re: We compete with GitHub. Bing does not show our website

#59

Post by vertis »

joshmanders wrote: post #27
latchkey wrote: post #12

Start with a robots.txt? https://www.codeium.com/robots.txt Update: I also see that you serve your site off GitHub... so that might be part of it as well? Bing might not index those sites?

No robots.txt is basically the same as the default contents of a robots.txt saying "All bots welcome"

No robots.txt is unpredictable because it depends on the implementation of the bot.

Re: We compete with GitHub. Bing does not show our website

#60

Post by xnx »

At risk of encouraging the trend of HN turning into tech support, or worse ( guerilla-marketing bait), you should try Bing Webmaster Tools: https://www.bing.com/webmasters/about . If it's anything like Google's Search Console, there's plenty of information and tools to diagnose indexing issues.
Post reply on HN