Still down 5 hours later. ELB won't register instances. Ugh
The ELB control plane woke up for us about 90 minutes ago; back to flying on all engines again now.
AWS Service Interuptions
31–40 of 56 posts
Re: AWS Service Interuptions
#32Anyone having problems with BJ servers? My site is not running, https://www.weisisheng.cn, I can not SSH into machine nor access login page to AWS dashboard.
Re: AWS Service Interuptions
#33Still down 5 hours later. ELB won't register instances. Ugh
The ELB control plane woke up for us about 90 minutes ago; back to flying on all engines again now.
Multiple ELB's came alive around that timeframe but our primary ELB has remained unable to re-register instances. Creating a new ELB as a test and trying to register new instances from the effected ASG has also failed.
Re: AWS Service Interuptions
#34It will take a direct hit with nuclear weapon on the datacenter for Amazon to change icon to red on service status page.
Yeah we monitor lots of Amazon & Microsoft 'cloud' services, we observe much, much higher downtime / number of outages than they ever report in a order of 50 to 1 or more. What do you expect though, both companies are known for lying through teeth to convince the IT community (or more likely the IT managers) that their services are reliable for everyone and amazing uptime and that they're not only a good option but t…
Sounds interesting. Is that data available?
Re: AWS Service Interuptions
#35It will take a direct hit with nuclear weapon on the datacenter for Amazon to change icon to red on service status page.
Nah, that'd be green with the ! icon.
Red's for heat death of the universe.
Re: AWS Service Interuptions
#36I see lots of people using ELB for load balancing. Anyone tried using DNS on top of ELB to spread the load? That might just save you from the extended downtime.
Re: AWS Service Interuptions
#37I see lots of people using ELB for load balancing. Anyone tried using DNS on top of ELB to spread the load? That might just save you from the extended downtime.
Generally the ELB should have instances in different availability zones which are data centers miles apart. If your ELB went down creating a new one should be simple if you can access the region. The problem with high availability and spreading load is how to deal with your database and recovery.
Re: AWS Service Interuptions
#38Earlier quoted context omitted.
That's interesting. Is it an Australian regulation? Curious that they'd make it in such a way that the data had to reside in the same building/zone.
Indeed it is, it was a massive struggle getting approval to move into a cloud service in the first place.
Really ? Pointing the local gov department's officer to AWS's IRAP compliance cert was all that was needed to move quite a lot of their stuff unto AWS.
Re: AWS Service Interuptions
#39Our Sydney EC2 DB instance is stuck spinning in the "stopping" state so we are basically offline right now. The team is working on getting a new DB instance set up, but I read that our payment provide, Westpac, is also having issues. So even if we do get back online, users might not be able to purchase.
What a mess.
Re: AWS Service Interuptions
#40It will take a direct hit with nuclear weapon on the datacenter for Amazon to change icon to red on service status page.
Yeah we monitor lots of Amazon & Microsoft 'cloud' services, we observe much, much higher downtime / number of outages than they ever report in a order of 50 to 1 or more. What do you expect though, both companies are known for lying through teeth to convince the IT community (or more likely the IT managers) that their services are reliable for everyone and amazing uptime and that they're not only a good option but t…
Those icons don't change unless a certain percentage of the overall count of instances in an AZ or region are affected.
Most of the time people here might be seeing good portions of their infra go away, but the number isn't statistically significant to the overall region health for them to post an outage.
Don't ask me what those numbers are, but that is the way it is determined.