Ask HN: Is S3 down?
471–480 of 1001 posts
Re: Ask HN: Is S3 down?
#472Sysadmin: I can forgive outages, but falsely reporting 'up' when you're obviously down is a heinous transgression. Somewhere a sysadmin is having to explain to a mildly technical manager that AWS services are down and affecting business critical services. That manager will be chewing out the tech because the status site shows everything is green. Dishonest metrics are worse than bad metrics for this exact reason. Any…
It's not a lie, it's an "alternative fact" about how totally like awesome AWS is!
Re: Ask HN: Is S3 down?
#473It really is amazing how many web services are dependent on S3. For instance, the Heroku dashboard is currently down for me. Along with all of my services that are on Heroku.
Same here, but worse. Some of the apps I have hosted on Heroku (including APIs) are showing "Application Error". Like you, tried logging into dashboard and got a Heroku error page.
Turns out that not all Heroku dynos are hosted on US-East. One of my friend's dyno is still up and running great.
Re: Ask HN: Is S3 down?
#474Is there a list of all apps/services that rely on S3?
- launching AMIs (they are stored on s3)
- cloudfront
- ses
- ebs
- rds (snapshots/backups on s3)
- lambda functions (appear to be stored in s3)
perhaps others
Re: Ask HN: Is S3 down?
#475We host with TierPoint and they are reporting a massive DDOS attack
Re: Ask HN: Is S3 down?
#476Can anyone comment on mitigating issues like this with S3 Cross-region replication? I'm reading up on it now while one of my services is dead in the water.
Re: Ask HN: Is S3 down?
#477Sysadmin: I can forgive outages, but falsely reporting 'up' when you're obviously down is a heinous transgression. Somewhere a sysadmin is having to explain to a mildly technical manager that AWS services are down and affecting business critical services. That manager will be chewing out the tech because the status site shows everything is green. Dishonest metrics are worse than bad metrics for this exact reason. Any…
People were joking about this but it turns out to be true: they host the status icons on their service: https://twitter.com/awscloud/status/836656664635846656
Saw that too, sounds like a convenient excuse for being caught in a lie.
AWS Employee #1: Hey, people are catching on that our status page isn't accurate
AWS Employee #2: Tell them it's cause of S3
Re: Ask HN: Is S3 down?
#478TierPoint, a large hosting service, is reporting a massive DDOS attack on their infrastructure.
Re: Ask HN: Is S3 down?
#479After few requests timed out, started to dig a bit.
The CNAME for a bucket endpoint was pointing to s3-1-w.amazonaws.com with a TTL of at least an other 5600 secods.
Doing a full trace was giving back a new s3-3-w.amazonaws.com
The IP related to s3-1-w was/is timing out, all cool instead for the s3-3-w.
Re: Ask HN: Is S3 down?
#480Started a list of "things to do when S3 is down." https://justinjackson.ca/s3/ What else should I add?
Yes. Go for a walk and interact with people in the community. You might meet someone interesting and learn something as well!
My suggestion would be to rediscover the clarity and focus of thinking about systems and code on paper.