Tell HN: AWS appears to be down again • Hacker News Board

Re: Tell HN: AWS appears to be down again

#31

Post by pietroalbini » Wed, Dec 22, 2021, 12:40 PM UTC

lukeqsee wrote: post #15

RobertKerans wrote: post #11

Assuming crates.io is AWS-backed? Getting fun situation where direct dependencies of an application are downloading but then the sub-dependencies aren't.

crates.io is directly hosted on GitHub, but I'm sure some dependencies use S3 or other AWS services for things.

The crates.io index is hosted on GitHub, but the application/API is hosted on Heroku (so in the us-east-1 AWS region) and the downloads on S3/CloudFront. And yes crates.io is currently impacted.

Re: Tell HN: AWS appears to be down again

#32

Post by captn3m0 » Wed, Dec 22, 2021, 12:41 PM UTC

4:35 AM PST We are investigating increased EC2 launched failures and networking connectivity issues for some instances in a single Availability Zone (USE1-AZ4) in the US-EAST-1 Region. Other Availability Zones within the US-EAST-1 Region are not affected by this issue.

via https://stop.lying.cloud/

Re: Tell HN: AWS appears to be down again

#33

Post by sprite » Wed, Dec 22, 2021, 12:41 PM UTC

allocate wrote: post #28

Also running a big production app in east-1 and we're experiencing issues.

I'm also in east-1 and completely down.

Re: Tell HN: AWS appears to be down again

#34

Post by jakub_g » Wed, Dec 22, 2021, 12:41 PM UTC

jenoer wrote: post #22

potas wrote: post #13

Slack seems to have some issues because of that - I'm not sure if anyone is receiving messages, as it became completely silent for the last 15 minutes or so.

Sending and receiving messages works here, but editing them does not, it throws an error. Statuses such as "calling" also do not seem to be updated any longer. Edit: Restarting Slack does update the edited messages. Edit 15:24 CET: Slack is back up.

Same: only normal text seems kinda working

- edits failing or working with big lag;

- "Threads" view slow;

- can't emoji-react;

- can't upload images;

- people also say they can't join new channels.

Re: Tell HN: AWS appears to be down again

#35

Post by sreitshamer » Wed, Dec 22, 2021, 12:41 PM UTC

Console is sluggish for me, but S3 (us-east-1) seems to work fine.

Re: Tell HN: AWS appears to be down again

#36

Post by loudtieblahblah » Wed, Dec 22, 2021, 12:41 PM UTC

Yay! Adult snowday!

Re: Tell HN: AWS appears to be down again

#37

Post by withinboredom » Wed, Dec 22, 2021, 12:42 PM UTC

RobertKerans wrote: post #20

lukeqsee wrote: post #15

Earlier quoted context omitted.

crates.io is directly hosted on GitHub, but I'm sure some dependencies use S3 or other AWS services for things.

Yep, S3 possibly the villain here

I wonder if there's an s3 compatible service with similar pricing that can be used as a fallback? Are digital ocean s3 compatible storage accounts's backed by real s3?

Re: Tell HN: AWS appears to be down again

#38

Post by darkwater » Wed, Dec 22, 2021, 12:42 PM UTC

hnarn wrote: post #30

darkwater wrote: post #23

Fields of green here https://status.aws.amazon.com/ Anyway I can access the web console with no issue (eu-west)

I think it's pretty widely accepted that AWS' own status pages are utterly useless.

Yeah, it was just to confirm that this time was no different :)

Re: Tell HN: AWS appears to be down again

#39

Post by RobertKerans » Wed, Dec 22, 2021, 12:43 PM UTC

RobertKerans wrote: post #20

lukeqsee wrote: post #15

Earlier quoted context omitted.

crates.io is directly hosted on GitHub, but I'm sure some dependencies use S3 or other AWS services for things.

Yep, S3 possibly the villain here

Ah, back to normal now. Getting intermittent flickers on some of our apps but all seems solid-ish again

Re: Tell HN: AWS appears to be down again

#40

Post by sswaner » Wed, Dec 22, 2021, 12:43 PM UTC

Not down as of 7:40 EST. US-EAST-1 hosted site (athene.com). Cognito, API Gateway, Lambda, S3, DynamoDB, RDS, S3, Cloudfront.