Is it me or are big provider outages getting more common these days?
I think it's just you, probably recency bias. I recall the days of Gmail being globally down for hours, more than once (3 times, IIRC), back in 2009.
Google Outage in Europe
101–110 of 186 posts
Re: Google Outage in Europe
#102Earlier quoted context omitted.
Lol maybe if people actually did spend millions training their people up front we could do better?
139,995 employees at Google * 1,000,000 = $139,995,000,000 $140 billion dollars. On training. On the one hand... you know what, I'd love to work in an environment like that. Seriously. On the other hand... what's the argument you make to the CFO in support of this? Honest question, interested to hear answers.
I work part time in the Army. In the Army when you go from their equivalent of junior to mid-level they take you out of your job for eight months of dedicated personal development, before you start your first mid-level job. When you go to their equivalent of senior they take you out for a year.
I don't know how much that costs all-in, including the salaries, instructors, facilities, but might be starting to approach a million.
That's valuing training!
Re: Google Outage in Europe
#103Earlier quoted context omitted.
139,995 employees at Google * 1,000,000 = $139,995,000,000 $140 billion dollars. On training. On the one hand... you know what, I'd love to work in an environment like that. Seriously. On the other hand... what's the argument you make to the CFO in support of this? Honest question, interested to hear answers.
I work part time in the Army. In the Army when you go from their equivalent of junior to mid-level they take you out of your job for eight months of dedicated personal development, before you start your first mid-level job. When you go to their equivalent of senior they take you out for a year . I don't know how much that costs all-in, including the salaries, instructors, facilities, but might be starting to approach…
Some jobs can be learned on the job.
But I'm glad that learning to kill people (military) is not taught that way.
Re: Google Outage in Europe
#104I do wonder how many companies and businesses got affected by the outage.
Re: Google Outage in Europe
#105I do laugh at people that say "Using the cloud means less downtime than your own server", then things like this come along :D
Right? My private website on my RPI is running now 2 Years without a problem and only minimal downtime due to rebooting for the new kernels. It is amazing how much uptime you can achieve with a 5$ Computer in comparison to a 1730000000000$ (1,73 tera $) Company. Even if you compensate for dynamic content.
(Google is currently processing multiple terabits of traffic per second using several billion dollars' worth of distributed infrastructure.)
Re: Google Outage in Europe
#106Earlier quoted context omitted.
Really, downtime of google so far this year: More than 0 minutes. Downtime of my own server: 0 minutes. Of course I'm not trying to run a massively scalable service coping with millions of customers, because I don't need that.
You think that's how statistics works? Obviously it's possible to keep your own server running with 0 downtime. But you are exposed to a much higher risk of severe downtimes longer than the cloud provider would likely be. Be it hardware failure, grid, ISP, whatever.
Claim was
"It’s still less downtime than your own server"
Claim disproven
Re: Google Outage in Europe
#107Earlier quoted context omitted.
I work part time in the Army. In the Army when you go from their equivalent of junior to mid-level they take you out of your job for eight months of dedicated personal development, before you start your first mid-level job. When you go to their equivalent of senior they take you out for a year . I don't know how much that costs all-in, including the salaries, instructors, facilities, but might be starting to approach…
Some jobs can be learned on the job. But I'm glad that learning to kill people (military) is not taught that way.
If your job is something like a staff officer in a Brigade, you could learn that on the job, the Google way, because exercising is also 'the job', but they don't get you to do that - instead they take the time to fully pull you out of all work commitments for dedicated personal development. These periods of personal development are about personal skills rather than combat training, which you've already done by this point.
Re: Google Outage in Europe
#108Is it me or are big provider outages getting more common these days?
I think it's just you, probably recency bias. I recall the days of Gmail being globally down for hours, more than once (3 times, IIRC), back in 2009.
I also can't think of the last time I saw Twitter's Failwhale, which almost became their default mascot at one point.
(Yes, I know they discontinued it, but I haven't seen the service "over capacity" in some time. I say this as a casual web user of it, not an active account holder or app user).
Re: Google Outage in Europe
#109Earlier quoted context omitted.
You think that's how statistics works? Obviously it's possible to keep your own server running with 0 downtime. But you are exposed to a much higher risk of severe downtimes longer than the cloud provider would likely be. Be it hardware failure, grid, ISP, whatever.
Claim was "It’s still less downtime than your own server" Claim disproven
That claim was a direct snippet from your original comment. So unless you meant that you laugh at people who are talking specifically about your personal server, I'd say you are being selectively literal.
Re: Google Outage in Europe
#110Earlier quoted context omitted.
Googler here, not speaking on the behalf of the company, my opinions are my own People do absolutely NOT get fired over incidents. Making mistakes is human. An incident will prompt a review of the systems and safeguards in place to prevent such an incident, much like an airline incident investigation - basically "somebody fat-fingered it" is never the answer, postmortems are always blameless EDIT: now that I think of…
Yeah, this 'blameless' ethos has definitely trickled down from FAANG to decently-sized decently-reputed places I've worked at - and certainly to #EngTwitter. I think it's a bit over-applied in some cases. Does it not commit you to the theorem that every process can be made so perfect as to be completely invulnerable to one human being making a mistake? (At least, in the form exemplified by the common tweets to the ef…
I of course agree that mistakes are inevitable. That being said, the point of blameless culture is not to make a process invulnerable to mistakes. Instead during a post-mortem, we look at how to prevent that particular incident from happening again.