Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS, Azure, and GCP respond to cloud report

cockroachlabs.com

Post reply on HN
Print view View original

21–30 of 35 posts

Re: AWS, Azure, and GCP respond to cloud report

#21

Post by longtermd »

longtermd wrote: post #20

For me as a developer and CTO, it's still a huge pain figuring out how to properly configure and scale AWS, Azure, or GCP. In-depth reports on "How to configure your AWS EC2 for max. performance" would be great, one report each for a specific use case, e.g. realtime chat app, basic apache webserver, nodejs web app, ... If you think about it, there are only a handful common use cases.

The gold standard would be: I just click "add new server", and you start off with some basic, general compute server. The server then itself figures out the optimal network, EC2, Storage, ... and all the other parameters by itself (just by knowing what general use case you're aiming for [see above])

Re: AWS, Azure, and GCP respond to cloud report

#22

Post by grogenaut »

longtermd wrote: post #21
longtermd wrote: post #20

For me as a developer and CTO, it's still a huge pain figuring out how to properly configure and scale AWS, Azure, or GCP. In-depth reports on "How to configure your AWS EC2 for max. performance" would be great, one report each for a specific use case, e.g. realtime chat app, basic apache webserver, nodejs web app, ... If you think about it, there are only a handful common use cases.

The gold standard would be: I just click "add new server", and you start off with some basic, general compute server. The server then itself figures out the optimal network, EC2, Storage, ... and all the other parameters by itself (just by knowing what general use case you're aiming for [see above])

That'd be amazing. However servers don't see all use cases, especially ones that will break it, until it gets broken. This is why anomaly detection also only goes so far.

Worse, you're changing the equation constantly when you work on your features.

Finally when these things do happen, the server will protect itself in the interim. When it does that, things will be broken.

Re: AWS, Azure, and GCP respond to cloud report

#23

Post by chanandler_bong »

longtermd wrote: post #21
longtermd wrote: post #20

For me as a developer and CTO, it's still a huge pain figuring out how to properly configure and scale AWS, Azure, or GCP. In-depth reports on "How to configure your AWS EC2 for max. performance" would be great, one report each for a specific use case, e.g. realtime chat app, basic apache webserver, nodejs web app, ... If you think about it, there are only a handful common use cases.

The gold standard would be: I just click "add new server", and you start off with some basic, general compute server. The server then itself figures out the optimal network, EC2, Storage, ... and all the other parameters by itself (just by knowing what general use case you're aiming for [see above])

https://aws.amazon.com/lightsail/ ?

Re: AWS, Azure, and GCP respond to cloud report

#24

Post by fivre »

longtermd wrote: post #20

For me as a developer and CTO, it's still a huge pain figuring out how to properly configure and scale AWS, Azure, or GCP. In-depth reports on "How to configure your AWS EC2 for max. performance" would be great, one report each for a specific use case, e.g. realtime chat app, basic apache webserver, nodejs web app, ... If you think about it, there are only a handful common use cases.

As someone who gets questions about this often, I wonder why nobody seems to know how to answer these questions for themselves, or even how they'd begin to research them. There seems to be a dearth of developers who understand what bottlenecks their applications are likely to encounter, what options exist for profiling and analyzing their performance, or that they may need to read something and learn something new about their systems and the systems they interact with.

Everyone wants an easy button, and that might exist for something that's very well-established with a large community of users, at which point it probably just exists as an AWS service. For many things, you have to do research.

Re: AWS, Azure, and GCP respond to cloud report

#25

Post by cthalupa »

timc3 wrote: post #7

What a load of nonsense. So cloud provides X doesn’t like the test because the defaults of their services do not provide the best performance and on top of that the benchmark used doesn’t present them with the result that shows them in the best possible light. It’s like listening to failed beauty pageant contenders

The idea that you can provide a default option that is the best tuned for every workload is a very naive one.

There are many changes I would make to increase performance for one workload that would have a deleterious effect on another. An easy example is the dirty ratio in Linux - depending on the speed of your local storage, what the size of your working set of memory is, how frequently the data in the working set changes, keeping the settings the same across workloads and systems could be disastrous - it could result in extended periods where you are stuck in a synchronous flush to disk and block all other IO. That same setting on another server might be perfectly acceptable and prevent having to go to slower block storage devices sooner than necessary, increasing overall performance.

It's the same with how you configure your servers - you can throw more spindles at sequential workloads and have great performance, but a random workload really should be using flash storage, etc. etc. etc.

Most people strive to provide sane defaults that strike a good balance for the majority of workloads. This is going to be beneficial to the largest number of people. It's totally fair for someone to provide feedback on this sort of thing, and give details on how things could be further optimized to fit a specific workload. Defaults are not best practices - they are a starting point.

Re: AWS, Azure, and GCP respond to cloud report

#26

Post by eadan »

sho wrote: post #17

What a great marketing strategy - publishing interesting, valuable research in an adjacent area - thereby gaining genuine, valuable attention from exactly the type of person who'd also be interested in their product, whilst also establishing a kind of thought leadership in the "cloud performance" category. I'm not even being cynical - great work.

I actually really appreciate companies that produce research and write articles on technologies adjacent to their business. It's a great way of building trust and a community around the business' core product. Digital Ocean are a good example. Reminds me of Patrick Collison mentioning on a podcast [0] that one of the biggest drivers of new customers to Stripe in their early days was a blog they wrote on using the Python debugger.

[0] https://tim.blog/2018/12/20/patrick-collison/

Re: AWS, Azure, and GCP respond to cloud report

#27

Post by scarface74 »

plasma wrote: post #2

Is there a reliability/availability report that covers multiple months (VM uptime, PaaS services, etc)? I've personally seen the reliability differences of services in Azure vs AWS for example.

If you’re concerned about reliability and your major concern is “VM uptime”, you’ve got bigger issues. You need redundancy and automatic failover at every level based on your cost benefit analysis.

Re: AWS, Azure, and GCP respond to cloud report

#28

Post by lillecarl »

cortesoft wrote: post #16
api wrote: post #11

Earlier quoted context omitted.

Windows is the same way: absurd numbers of options. I would not be surprised if Windows 10 had over a million configuration settings between regular panels, policies, and the registry.

You think Windows has more configuration options than Linux?

If you count installing different packages to interact with your system, no. But in the Windows 10 distro there's certainly more configurability than Kubuntu for example.

Re: AWS, Azure, and GCP respond to cloud report

#29

Post by paulryanrogers »

fivre wrote: post #24
longtermd wrote: post #20

For me as a developer and CTO, it's still a huge pain figuring out how to properly configure and scale AWS, Azure, or GCP. In-depth reports on "How to configure your AWS EC2 for max. performance" would be great, one report each for a specific use case, e.g. realtime chat app, basic apache webserver, nodejs web app, ... If you think about it, there are only a handful common use cases.

As someone who gets questions about this often, I wonder why nobody seems to know how to answer these questions for themselves, or even how they'd begin to research them. There seems to be a dearth of developers who understand what bottlenecks their applications are likely to encounter, what options exist for profiling and analyzing their performance, or that they may need to read something and learn something new ab…

My guess is this could be because of the rates of change. Azure today may have significantly diverged from last year. K8s and the like including a churn of their own.

Re: AWS, Azure, and GCP respond to cloud report

#30

Post by biomcgary »

dang wrote: post #19
biomcgary wrote: post #5

Earlier quoted context omitted.

This is a new post that updates the previous post with cloud vendor responses.

That's clear! Adding links to previous threads is just a service to the curious. Not intended to imply dupiness. If it were a dupe we'd have downweighted it and probably marked it as [dupe] in the title. https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

Your link to the previous discussion was valuable, but I originally misunderstood the meaning. I've been reading HN long enough that I should know better.

However, for newbies (or the scatterbrained), perhaps you could prefix the link with something like: "For context, see discussion of earlier, related post: https://..."

Post reply on HN