Makes me glad I am in us-east-2.
We're flapping pretty hard in us-east-2 (looks API Gateway related, which is probably because it's an edge deployment which has a bunch of us-east-1 dependencies).
AWS us-east-1 outage
91–100 of 1001 posts
Re: AWS us-east-1 outage
#92Are the actual services down, or is it just the console and/or login page? For example, the sign-up page appears to be working: https://portal.aws.amazon.com/billing/signup#/start Are websites that run on AWS us-east up? Are the AWS CLIs working?
Using cli to describe instances isn't working. Instances themselves seem fine so far.
Re: AWS us-east-1 outage
#93This got me thinking, are there any major chat services that would go down if a particular AWS/GCP/etc data centre went down? You don't want your service to go down, plus your team's comms at the same time.
You should multi region something like that.
Re: AWS us-east-1 outage
#94[deleted]
Re: AWS us-east-1 outage
#95Earlier quoted context omitted.
EC2 or S3 showing red in any region literally requires personal approval of the CEO of AWS.
Uhhhhh... what if the monitoring said it was hard down? They'd still not show red?
Probably they cannot. They outsourced this dashboard and it runs on AWS now ;).
Re: AWS us-east-1 outage
#96Most of our services in us-east-1 are still responding although we cannot log into the console. However, it looks like dynamodb is timing out most requests for us.
Re: AWS us-east-1 outage
#97Are the actual services down, or is it just the console and/or login page? For example, the sign-up page appears to be working: https://portal.aws.amazon.com/billing/signup#/start Are websites that run on AWS us-east up? Are the AWS CLIs working?
My ECS, EC2, Lambda, load balancer, and other services on us-east-1 still function. But these outages can sometimes propagate over time rather than instantly.
I cannot access the admin console.
Re: AWS us-east-1 outage
#98https://status.aws.amazon.com hasn't been updated to reflect outage yest
Re: AWS us-east-1 outage
#99Are the actual services down, or is it just the console and/or login page? For example, the sign-up page appears to be working: https://portal.aws.amazon.com/billing/signup#/start Are websites that run on AWS us-east up? Are the AWS CLIs working?
Anecdotally, we're seeing a small number of 500s from S3 and SQS, but mostly our service (which is at nontrivial scale, but mostly just uses EC2, S3, DynamoDB, and some basic network facilities including load balancers) seems fine, knock on wood. Either the problem is primarily in more complex services, or it is specific to certain AZs or shards or something.
Re: AWS us-east-1 outage
#100Earlier quoted context omitted.
EC2 or S3 showing red in any region literally requires personal approval of the CEO of AWS.
Is this true or a joke? This sort of policy is how you destroy trust.
maybe we gotta consider the publicly facing status pages as something other than a technical tool (e.g. marketing or PR or something like that, dunno)