Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

IBM Cloud was down, as well as their status page

cloud.ibm.com

Post reply on HN
Print view View original

191–200 of 201 posts

Re: IBM Cloud was down, as well as their status page

#191

Post by oehpr »

[deleted] wrote: post #189

[deleted]

Thanks for keeping us up to date.

The timing on that incident was a weird coincidence for our team. We had just rolled out a bunch of production updates, and then 5 minutes later ALL our VM's went down and I freaked out and tried to diagnose what was happening and recover before I started noticing all the other people going down.

So. Hate to ask this. But what happened to your old posts that are now just "-"'s?

I mean I can guess.

It's just that the communication blackout while the incident was happening was not appreciated. And you stepping forward to let us know what was going on was very appreciated.

Re: IBM Cloud was down, as well as their status page

#192

Post by [deleted] »

oehpr wrote: post #191
[deleted] wrote: post #189

[deleted]

Thanks for keeping us up to date. The timing on that incident was a weird coincidence for our team. We had just rolled out a bunch of production updates, and then 5 minutes later ALL our VM's went down and I freaked out and tried to diagnose what was happening and recover before I started noticing all the other people going down. So. Hate to ask this. But what happened to your old posts that are now just "-"'s? I mea…

[deleted]

Re: IBM Cloud was down, as well as their status page

#194

Post by aiisjustanif »

kitteh wrote: post #152

About a month ago their Northern Virginia region was down. All the BGP prefixes associated with it disappeared from the internet (routes withdrawn). This time (I went to check when someone mentioned it) they kept advertising, but all traffic went nowhere once it got into their network. Curious to see if there is an RFO released.

I wish we had a record of this.

Re: IBM Cloud was down, as well as their status page

#195

Post by peterwwillis »

po wrote: post #177
peterwwillis wrote: post #171

Earlier quoted context omitted.

If by "name" you mean hostname, not really. If you have a domain with multiple nameservers in multiple countries on multiple providers, and your site is similarly globally distributed, at least a few people on the internet will always be able to pull up your site. So at least some of your clients will be able to resolve a domain address from at least some of your nameservers and connect to at least some of your web s…

ok, that makes sense but you'd still at least have: if the site is down due to BGP then so is the status page that is on the same domain. I guess I'm just calling out the people who are making fun of them for having their status page dependent on the same hardware it's monitoring when it's not clear that's the case just because they are both down? I would suppose if it's a different TLD domain, then it would be more…

A status page should be a static site hosted on multiple providers in multiple regions with multiple nameservers. So, Amazon S3 hosted in 2 regions, Azure Storage hosted in 2 different regions, 2 different nameserver providers in 2 different countries using two different backend colo providers. Costs probably I'm not going to make fun of them for their status page being down, but it certainly doesn't reflect well on the brand/products.

Re: IBM Cloud was down, as well as their status page

#196

Post by FriendlyNormie »

jedberg wrote: post #79
whyleyc wrote: post #70

Earlier quoted context omitted.

Totally unrelated Jeremy, but did you know the SSL cert on https://minops.com/ has expired? (Was interested to see what you were up to these days, which is how I stumbled on it).

Lol yes. It's intentional. It stops spam bots from trying to sign up, since we aren't open for signups yet. But don't worry, you're not the first to mention it. I suppose I should just fix it and deal with the spam like normal. I liked the unintended effect of cutting down on spam. I guess a lot of spam bots are written on top of standard libraries that reject bad certs. :) Also, this was ironically a great way to pu…

No post body was provided.

Re: IBM Cloud was down, as well as their status page

#197

Post by jedberg »

mh- wrote: post #180
jedberg wrote: post #79

Earlier quoted context omitted.

Lol yes. It's intentional. It stops spam bots from trying to sign up, since we aren't open for signups yet. But don't worry, you're not the first to mention it. I suppose I should just fix it and deal with the spam like normal. I liked the unintended effect of cutting down on spam. I guess a lot of spam bots are written on top of standard libraries that reject bad certs. :) Also, this was ironically a great way to pu…

Minops is neat, first I've heard of it. (at least partly tongue-in-cheek) will it support DDL too? can I INSERT infra? or is this a read-only endeavor? :)

Read only at first, then write too. It's hard to do writes though because you have to guess at what the person intended.

If someone does 'DROP TABLE ec2.instances', what exactly are they trying to accomplish? Do they want to terminate every ec2.instance? Should we let them?

Questions like that make write access very difficult.

Re: IBM Cloud was down, as well as their status page

#198

Post by spalanis »

late2part wrote: post #118
[deleted] wrote: post #34

[deleted]

Might want to look into that sysdig maintenance too...

I'm here from the Sysdig infra team, and wanted to note that the timing was just a coincidence. Our maintenance was a pre-scheduled upgrade to our platform that was communicated in advance, and unrelated to any outage.

Re: IBM Cloud was down, as well as their status page

#199

Post by kitteh »

aiisjustanif wrote: post #194
kitteh wrote: post #152

About a month ago their Northern Virginia region was down. All the BGP prefixes associated with it disappeared from the internet (routes withdrawn). This time (I went to check when someone mentioned it) they kept advertising, but all traffic went nowhere once it got into their network. Curious to see if there is an RFO released.

I wish we had a record of this.

I do. I store all this stuff. Where should I put it?

Re: IBM Cloud was down, as well as their status page

#200

Post by dsmcr »

nojito wrote: post #181
dsmcr wrote: post #154

Earlier quoted context omitted.

FWIW - IBM Cloud today has basically no benefit over AWS, Azure or GCE or even against some of the smaller regional players like AliCloud. The notable exception would be if you need to run a bare metal solution and leverage their free backbone which is a pretty narrow use case these days. The main selling point previously was to stand up your own VMware environment but even that came with a laundry list of caveats (u…

Price isn’t a benefit?

It would be except IBM Cloud is never cheaper than AWS.
Post reply on HN