Live data from Hacker News

Ask HN: Is S3 down?

news.ycombinator.com

861–870 of 1001 posts

Re: Ask HN: Is S3 down?

#861

I am having trouble sending attachments in the Signal app - seems unlikely, but could this be related? [edit- looks like they do have a pretty heavy reliance on S3, per https://github.com/WhisperSystems/Signal-Server/blob/master/... and various other sources.]

https://twitter.com/whispersystems/status/836651250842124288

Re: Ask HN: Is S3 down?

#862

Based on reports from the field, it looks like S3 was down for about three hours for most of their customers. S3 promises four nines of availability (11 nines of durability), so today we got about 3-4 years worth of downtime in one fell swoop. Oops.

durability is different from availability

Re: Ask HN: Is S3 down?

#863

Earlier quoted context omitted.

I keep telling people that in my view, Google Cloud is far superior to AWS from a technical standpoint. Most people don't believe me... Yet. I guess it will change soon.

Google Cloud is the Betamax of cloud... while it might be technically superior it's not the only factor to consider. :)

you don't comment for 4 years and THAT'S the comment you choose to return with?

Re: Ask HN: Is S3 down?

#864
post #735

Disclosure: I work on Google Cloud. Apologies if you find this to be in poor taste, but GCS directly supports the S3 XML API (including v4): https://cloud.google.com/storage/docs/interoperability and has easy to use multi-regional support at a fraction of the cost of what it would take on AWS. I directly point my NAS box at home to GCS instead of S3 (sadly having to modify the little PHP client code to point it to st…

As far as I understand the S3 API of Cloud Storage is meant as a temporary solution until a proper migration to Google's APIs. The S3 keys it produces are tied to your developer account. This means that if someone gets the keys from your NAS, he will have access to all the Cloud Storage buckets you have access to (e.g your employer's). I use Google Cloud but not Amazon. Once I wanted a S3 bucket to try with NextCloud…

Is there any equivalent to the Bucket Policies that AWS provides (http://docs.aws.amazon.com/AmazonS3/latest/dev/example-bucke...). Cloud Storage seems to be limited to relatively simple policies without conditionals. For a few AWS IAM keys I set up a policy that limits write/delete access to a range of IPs (among other things). Something like that doesn't seem possible with what Google offers. Or do I miss something?

Re: Ask HN: Is S3 down?

#865
This is why it's important to write code that doesn't depend on only a single service provider. S3 is great. But it's better to set up a Riak cluster on AWS than to actually use S3, if you can.

The only services my team uses directly are EC2 and RDS, and I'm thinking of moving RDS over to EC2 instances.

We are entirely portable. We can move my entire team's infrastructure to a different cloud host really quickly. Our only dependency is a Debian box.

I flipped the switch today and cloned our prod environment, including VPN and security rules, over to a commodity hosting provider.

Change the DNS entry for the services, and we were good to go. We didn't need to do anything because everyone was freaking out about everything else being down. But our internal services were close to unaffected.

At least for my team.

Obviously, we aren't Trello or some of the other big people affected. And we don't have the same needs they do. But setting up the DevOps stuff for my team in the way that I think was correct to begin with (no dependencies other than a Debian box) really shined today. Having a clear and correct deployment strategy on any available hardware platform really worked for us.

Or at least it would have if people weren't so upset about all our other external services being down that they paid no attention to internal services.

Lock-in is bad, mmkay?

If your company is the right size, and it makes sense, do the extra work. It's not that hard to write agnostic scripts that deploy your software, create your database, and build your data from a backup. This can be a big deal when some providers are flipping out.

All-your-junk-in-one-place is really overrated, in my opinion. Be able to rebuild your code and your data at any given point in time. If you don't have that, I don't really know what you have.

Re: Ask HN: Is S3 down?

#866

Earlier quoted context omitted.

The brilliance of open sourcing Borg (aka Kubernetes) is evident in times like these. We[0] are seeing more and more SaaS companies abstract away their dependencies on AWS or any particular cloud provider with Kubernetes. Managing stateful services is still difficult but we are starting to see paths forward [1] and the community's velocity is remarkable. K8s seems to be the wolf in sheep's clothing that will break AW…

Note that Kubernetes "builds upon 15 years of experience of running production workloads [on Borg] at Google" [0], but is different code than Borg. In addition to Rook, Minio [1] is also working to build an S3 alternative on top of Kubernetes, and the CNCF Landscape is a good way of tracking projects in the space [2]. [0] https://kubernetes.io/ [1] https://www.minio.io/ [2] https://github.com/cncf/landscape Disclosur…

Yes, I was admittedly over generalizing with my statement regarding open sourcing Borg.

Re: Ask HN: Is S3 down?

#867

Earlier quoted context omitted.

thats for below 99.9% - they are at 99.997% .. you are never getting that 10% credit..

0.1% of 28 days is 40 minutes, so it seems likely to happen.

I was calculating it for a year - maybe the availability applies to per billing cycle - you may be correct..

Re: Ask HN: Is S3 down?

#868
post #753
post #735

Disclosure: I work on Google Cloud. Apologies if you find this to be in poor taste, but GCS directly supports the S3 XML API (including v4): https://cloud.google.com/storage/docs/interoperability and has easy to use multi-regional support at a fraction of the cost of what it would take on AWS. I directly point my NAS box at home to GCS instead of S3 (sadly having to modify the little PHP client code to point it to st…

I've used both Google Cloud and AWS, and as of a year or so ago, I'm a Google Cloud convert. (Before that, you guys didn't at all have your shit together when it came to customer support) It's not in bad taste, despite other comments saying otherwise. We need to recognize that competition is good, and Amazon isn't the answer to everything.

My experience of support with Google Apps for Business makes me very wary of using anything Google for critical business infra. Google products are nice, but as soon as you hit a problem or edge case, you're on your own in my experience.

Re: Ask HN: Is S3 down?

#869

Earlier quoted context omitted.

thats for below 99.9% - they are at 99.997% .. you are never getting that 10% credit..

You got your orders of magnitude wrong ;) 99.9964583 = 100 - 153/(30*24*60) 99.6458333 = 100 * (1 - 153/(30*24*60))

I was calculating it for a year - maybe the availability applies to per billing cycle.. I am still not able to understand your math - mind explaining

Re: Ask HN: Is S3 down?

#870
post #868
post #753

Earlier quoted context omitted.

I've used both Google Cloud and AWS, and as of a year or so ago, I'm a Google Cloud convert. (Before that, you guys didn't at all have your shit together when it came to customer support) It's not in bad taste, despite other comments saying otherwise. We need to recognize that competition is good, and Amazon isn't the answer to everything.

My experience of support with Google Apps for Business makes me very wary of using anything Google for critical business infra. Google products are nice, but as soon as you hit a problem or edge case, you're on your own in my experience.

Spot on.

And good luck getting accurate documentation.

Post reply on HN