Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

IBM Cloud was down, as well as their status page

cloud.ibm.com

Post reply on HN
Print view View original

161–170 of 201 posts

Re: IBM Cloud was down, as well as their status page

#161

Post by vmh1928 »

toast0 wrote: post #146
ck2 wrote: post #115

even weather.com was down but someone broke ebay too Fastly error: unknown domain: www.ebay.com. Please check that this domain has been added to a service.

weather.com makes sense. IBM bought the weather channel a while ago, hosting is likely tied to IBM Cloud at this point (although it looks like it's fronted by Akamai)

IBM bought the technology part called the Weather Company. That's the part that gathers weather info from all over and makes it available.

The cable TV channel is still independent.

Re: IBM Cloud was down, as well as their status page

#162

Post by bberenberg »

colinbartlett wrote: post #12

My side project StatusGator monitors status pages (including IBM's ill-fated page) and I'm seeing more than 10% of the nearly 800 services we monitor having an outage right now. So it appears to affect anyone who depends on IBM Cloud.

I really wonder how people get value out of a meta status page when my experience is that status pages are often incorrect about what the actual status is. Whether they're manually updated, or it's a case of "your 9s are not my 9s", it seems like a compounded broken telephone problem.

Re: IBM Cloud was down, as well as their status page

#163

Post by vmh1928 »

In the Cloud Status History page scroll down to the 6:32 entry that says "Unable to Access IBM Cloud"

https://cloud.ibm.com/status?selected=history

- 2020-06-10 02:19 UTC - RESOLVED - The network operations team adjusted routing policies to fix an issue introduced by a 3rd party provider and this resolved the incident

Re: IBM Cloud was down, as well as their status page

#164

Post by goatherders »

jgalt212 wrote: post #134
paranoidrobot wrote: post #125

Earlier quoted context omitted.

My previous job used Softlayer heavily. Two of the biggest advantages were: Price for hardware. As a base price, their bare-metal gear was significantly cheaper than equivalent-specced AWS gear (if it was even possible to get something like that). We managed to snag quite a few 'interesting' configurations of things at various times that you just couldn't get at all in AWS. Things like PCI SSDs, very large RAM config…

I really would like to see an AWS memo which maps out common use cases and expected costs (selling points) vs actual use cases and actual costs (pain points).

Surely not from AWS themselves. They have zero reason to disclose data showing how expensive their services are relative to expectations.

Re: IBM Cloud was down, as well as their status page

#165

Post by dahfizz »

goatherders wrote: post #164
jgalt212 wrote: post #134

Earlier quoted context omitted.

I really would like to see an AWS memo which maps out common use cases and expected costs (selling points) vs actual use cases and actual costs (pain points).

Surely not from AWS themselves. They have zero reason to disclose data showing how expensive their services are relative to expectations.

> They have zero reason to disclose data showing how expensive their services are relative to expectations.

A cynic might argue that is why their pricing structure is so complicated in the first place.

Re: IBM Cloud was down, as well as their status page

#166

Post by ipsum2 »

dang wrote: post #106
toast0 wrote: post #87

Earlier quoted context omitted.

We used Softlayer (rebranded to IBM Cloud, and affected by this) at my last job. For the most part, their service pretty much just works; clearly not today. :) We had a couple thousand bare metal servers, and barely used any of their API stuff. As with any facility, there were occasional issues with electrical transfer switches, core router failures, fiber cuts, etc. Stuff happens, but we got pretty good communicatio…

HN ran on a box at Softlayer until early 2018 or so. This makes me think that the title of this post (which was submitted as "IBM Cloud down as well as their status page which looks to be hosted there") could at some point have been "IBM Cloud down as well as their status page which looks to be hosted there as well as the forum where people post these things which also looks to be hosted there".

Where does HN run now?

Re: IBM Cloud was down, as well as their status page

#167

Post by dsmcr »

Xenoamorphous wrote: post #84
ComputerGuru wrote: post #53

So what are HNers using IBM Cloud for and where do you see that it has an edge over AWS offerings (where an overlap exists, obviously)? (I figure either you’re in devops and you are putting out fires too busy to read this thread or you’re not and your work is halted because of the incident so you might have time to read and reply ;)

If we speak specifically about IBM Cloud vs AWS, we use the Natural Language Understanding API in IBM Cloud and as far as I know the equivalent AWS offering, Comprehend, doesn't provide named entity disambiguation nor links to knowledge graphs (IBM links to DBpedia). MS and Google do provide those features though.

Unfortunately, that API changes regularly and often in undocumented ways that causes breakages for customers. Its really a lot of fun to deal with when suddenly a bunch of automation breaks and it turns out an unannounced push fundamentally re-writes foundational API calls.

Re: IBM Cloud was down, as well as their status page

#168

Post by dsmcr »

dahfizz wrote: post #165
goatherders wrote: post #164

Earlier quoted context omitted.

Surely not from AWS themselves. They have zero reason to disclose data showing how expensive their services are relative to expectations.

> They have zero reason to disclose data showing how expensive their services are relative to expectations. A cynic might argue that is why their pricing structure is so complicated in the first place.

More likely their service offerings are growing so fast that trying to make the pricing structure coherent is like a hyper-aggressive game of whack-a-mole.

Re: IBM Cloud was down, as well as their status page

#169

Post by Scoundreller »

toast0 wrote: post #139
Scoundreller wrote: post #133

Earlier quoted context omitted.

Dunno if I should realize who toast0 is, but what service were/are you running?

I don't think you are expected to know who I am :) I omitted the service on purpose, but you my email is on my profile if you want to know. Apparently it was enough information for dsmcr to properly id the service though; not enough for nixgeek though, I think.

I won't ask that directly. It just seemed like I was missing something that everyone else knew.

Re: IBM Cloud was down, as well as their status page

#170

Post by FrankPetrilli »

caiobegotti wrote: post #78
all_blue_chucks wrote: post #62

Earlier quoted context omitted.

Never humiliate a coworker in public. Instead say "both options were considered but ultimately it was decided to select option B for reason Y."

My professional experience tells me that the next question will be who decided for B given Y, then you answer it and then you have a target on your SRE back, I'm afraid. Remember that the trickle-down economics works only when the shit hits the fans and what trickles down is not money.

I've worked in these types of organizations before, and it's always counter-productive to making positive changes in the environment. You as an SRE can either make it better, or find an environment that's conducive to positive changes.

If you'd like an outside resource to suggest or read up on better postmortem practices, the Google SRE Book has a chapter [0] on postmortem culture. It's an amazing change of pace and a huge stress level improvement for us SREs.

[0] https://landing.google.com/sre/sre-book/chapters/postmortem-...

Post reply on HN