Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is S3 down?

news.ycombinator.com

Post reply on HN
Print view View original

911–920 of 1001 posts

Re: Ask HN: Is S3 down?

#911

Post by mypalmike »

scrollaway wrote: post #826
boulos wrote: post #810

Earlier quoted context omitted.

Is there something about the GCS trigger that doesn't work for you? I hear you on Python 3, but I'm also curious about "serious control over the environment". Can you be more specific?

Here are our main issues with Lambda, from highest-to-lowest priority: - It supports Python 2.7 only. We need Python 3.4+ support. - We can't increase CPU allocation without increasing RAM allocation, making them far more expensive than we need. - Using psycopg2 on it is a PITA due to their handling of system dependencies. - The system is entirely proprietary, making it impossible to run it locally for testing. - Clo…

> The system is entirely proprietary, making it impossible to run it locally for testing.

I assume that you are referring to emulating the triggering of lambdas behind API gateway...? I've found a project that sets up a node environment to do this. Very handy for js/lambda development. A google search suggests similar options may exist for python.

Re: Ask HN: Is S3 down?

#912

Post by jsmthrowaway »

twakefield wrote: post #866
dankohn1 wrote: post #852

Earlier quoted context omitted.

Note that Kubernetes "builds upon 15 years of experience of running production workloads [on Borg] at Google" [0], but is different code than Borg. In addition to Rook, Minio [1] is also working to build an S3 alternative on top of Kubernetes, and the CNCF Landscape is a good way of tracking projects in the space [2]. [0] https://kubernetes.io/ [1] https://www.minio.io/ [2] https://github.com/cncf/landscape Disclosur…

Yes, I was admittedly over generalizing with my statement regarding open sourcing Borg.

Well, you're in the ballpark. I might be wrong, but I've heard they're not averse to the idea of open sourcing Borg and Omega (it wasn't that long ago that the Borg paper would have been nigh unthinkable, interestingly), but the litany of Google specific stuff that is baked in makes refactoring for public release a nonstarter. It's a huge codebase with lots of little tendrils to other internal infrastructure.

Anyway, one needs an on-ramp to containers on Google Cloud. And one can't open source the one that one has, which despite being nearly mature enough to own a driver's license, wouldn't really fulfill the precise need that Kubernetes fills without some frontend work. So one writes Kubernetes. An almost entirely different fundamental architecture, by the way, so it's interesting for those who've seen both to compare.

In other words, you're not entirely off the mark even with the generalization.

Re: Ask HN: Is S3 down?

#913

Post by itake »

omni wrote: post #897
mabbo wrote: post #878

Earlier quoted context omitted.

> potential business lost My startup's op team had a great discussion today because of this that basically boils down to "if we hit our sales goals, an incident like this a year from now would end our company". Looks like our plans to start prepping for multi-cloud support will be a higher priority.

> an incident like this a year from now would end our company I'm genuinely curious, what kind of business are you in that a four hour outage would end the company? High frequency trading or something?

not op, but when i worked in the ticketing business if this happened during a big on sale we would get hosed.

Re: Ask HN: Is S3 down?

#914

Post by hkmurakami »

7ewis wrote: post #882
hkmurakami wrote: post #873

Earlier quoted context omitted.

>(Before that, you guys didn't at all have your shit together when it came to customer support) Sounds like it basically coincides with Diane Greene coming on board to run the show -- which is great news for all of us with increased competition on not just the technical front but also support (which is often the deal maker/breaker)

Is Diane really that good? I was at a talk last year, where she spoke, and as much as I love Google, it was one of the boat boring talks I've ever heard in my life. So monotone and uninteresting... and I'm probably one of the biggest Google fans out there.

I'm not familiar with her public speaking. But you want someone decidedly un-Google-like to run an enterprise software (non-engineering) operation.

Look at Safra Catz's public speaking (Oracle). Terrible public speaker, terrific operator [1].

[1] though we may easily disagree with their business practices.

Re: Ask HN: Is S3 down?

#915

Post by ddollar »

bananabill wrote: post #781
AtheistOfFail wrote: post #694

Earlier quoted context omitted.

Could be worse, your entire infrastructure could be hosted on Heroku. You don't use S3 but because they do, your entire infrastructure crumbles.

I didn't realize Heroku used s3 until today, when my heroku app failed. Makes me wonder why I'm using heroku instead of just aws.

If you're looking for the simplicity of Heroku but want to run on raw AWS check out Convox. It's open source and free to try.

https://convox.com

Disclosure: I'm one of the cofounders

Re: Ask HN: Is S3 down?

#916

Post by w8rbt »

Salgat wrote: post #877
ehsankia wrote: post #874

Earlier quoted context omitted.

Honestly, if you're a big service that millions of people use, you should not put all your eggs in a single basket and should probably use a mix, in case one of the clouds goes down like in this case.

That depends if you're willing to pay for the cost of hosting all your content twice and the development overhead of managing that. Twice the persistences means twice the chance of an issue occurring.

With containers, I think the devops overhead would be minimal.

Re: Ask HN: Is S3 down?

#917

Post by notyourwork »

simonebrunozzi wrote: post #801
boulos wrote: post #735

Disclosure: I work on Google Cloud. Apologies if you find this to be in poor taste, but GCS directly supports the S3 XML API (including v4): https://cloud.google.com/storage/docs/interoperability and has easy to use multi-regional support at a fraction of the cost of what it would take on AWS. I directly point my NAS box at home to GCS instead of S3 (sadly having to modify the little PHP client code to point it to st…

I keep telling people that in my view, Google Cloud is far superior to AWS from a technical standpoint. Most people don't believe me... Yet. I guess it will change soon.

One service outage determines superiority? I prefer a lot more data than a single point.

Re: Ask HN: Is S3 down?

#918

Post by pmarreck »

boulos wrote: post #735

Disclosure: I work on Google Cloud. Apologies if you find this to be in poor taste, but GCS directly supports the S3 XML API (including v4): https://cloud.google.com/storage/docs/interoperability and has easy to use multi-regional support at a fraction of the cost of what it would take on AWS. I directly point my NAS box at home to GCS instead of S3 (sadly having to modify the little PHP client code to point it to st…

Classy parley. I'll allow it.

Re: Ask HN: Is S3 down?

#919

Post by jamesblonde »

JPKab wrote: post #753
boulos wrote: post #735

Disclosure: I work on Google Cloud. Apologies if you find this to be in poor taste, but GCS directly supports the S3 XML API (including v4): https://cloud.google.com/storage/docs/interoperability and has easy to use multi-regional support at a fraction of the cost of what it would take on AWS. I directly point my NAS box at home to GCS instead of S3 (sadly having to modify the little PHP client code to point it to st…

I've used both Google Cloud and AWS, and as of a year or so ago, I'm a Google Cloud convert. (Before that, you guys didn't at all have your shit together when it came to customer support) It's not in bad taste, despite other comments saying otherwise. We need to recognize that competition is good, and Amazon isn't the answer to everything.

I just wrote a piece reflecting on the s3 outage and the limitations of s3 metadata/replication:

https://medium.com/@jim_dowling/reflections-on-s3s-architect...

Re: Ask HN: Is S3 down?

#920

Post by _fool »

frakkingcylons wrote: post #339
kylemathews wrote: post #295

Earlier quoted context omitted.

Netlify is great for hosting static sites. Free for non-commercial sites.

Netlify's status page and pre-rendering service are down due to the S3 outage. https://twitter.com/netlifystatus/status/836643259053023232

Disclaimer: I work for netlify and posted that tweet.

Yup, they took those portions of our service down, but we now have redundant status page hosting setups and prerendering that is not tied to S3 (the latter is the only part of our service that was affected, and it was fixed within an hour of the outage)

Post reply on HN