Live data from Hacker News

Google Cloud Platform is the first cloud provider to offer Intel Skylake

cloudplatform.googleblog.com

131–140 of 214 posts

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#131
post #59

Earlier quoted context omitted.

Skylake is an amazing upgrade, more so than even the Haswell bump. Beyond just the clock-for-clock kind of improvements, AVX512 is a huge win for many vectorized workloads (see my other comment about waiting nearly 10 years for it...). Linear algebra (or ML if you prefer), rendering, and even string operations (operating on 512-bits per instruction is a win over 256) are all a lot faster.

what do I have to consider as a software developer to benefit from these upgrade? Do I need special tools/libraries?

Simple process improvements that make Skylake faster will just be "there" -- some code will just be faster with no changes!

For the numerical, AVX stuff -- it should be mostly automatic for you, if you're already using optimized libraries at the core -- MLK, BLAS, that kind of stuff. They'll be transparently upgraded for you -- ideally -- to take care of these things. They normally check what your CPU is at runtime, and pick the fastest implementation among a few different choices it has.

You will need toolchains to support this all, but for the most part that likely won't be a burden unless you want to get your hands dirty and start it yourself -- inevitably, this should all mostly be "pre-canned". Your optimized linear algebra, vector, and math libraries are what will mostly concern themselves with this, not you necessarily. In fact, several of the things already available can probably use these new extensions! I bet if you're using Intel MLK for example, it will probably "magically" get faster on these Skylake machines by using AVX512 automatically.

If you want to understand more: you can always go grab an SSE/AVX reference, check your /proc/cpuinfo, and write a few simple things on your own to get a feel. Your toolchain will definitely support it :)

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#132
post #130
post #16

Just for reference, since you don't choose your processor explicitly on GCP, but instead choose your zone with homogenous processors, here is their current processor/zone layout: https://cloud.google.com/compute/docs/regions-zones/regions-... Since some GCP engineers are watching: Presumably we'll see some new zones to provide these processors, or will it be a limited release within existing zones? And if so, will yo…

Bothers me a bit with "32 cores" listed when they are 16 core/32 Thread machines.

I try to consistently say "vCPUs", but yeah...

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#133
post #124
post #117

Earlier quoted context omitted.

Let's hope they are building the managed Postgres product from the ground up with an eye toward compliance!

Well, since mysql compatible Cloud SQL is, I would imagine pg would be too.

AWS launched Postgres RDS in November 2013. They covered MySQL and Oracle RDS under BAA in August 2015. But AWS didn't add Postgres RDS to the BAA until November 2016. We're hoping GCP doesn't delay covering Postgres Cloud SQL under BAA like AWS did with their managed Postgres.

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#134
post #74

Why is it important to offer Intel Skylake on cloud platforms? Is there some specific processor extensions present in Skylake that make them particularly compelling in a cloud environment for a particular industry or a particular set of needs?

MPX (hardware bounds checking) SGX (secure enclaves) TSX (Hardware Transactional Memory) SGX can store SSL keys in a hardware protected enclave that can't be accessed by hypervisors/AMT so that can be useful for security sensitive stuff. Cloudflare probably could have used MPX to prevent their recent leak with minimal performance overhead. TSX is cool.

Unfortunately MPX sounds cool but is a lot of fluff IMO. It is absolutely not "minimal overhead" in its current implementation and it is very invasive in some ways, and breaks many programs. (It also doesn't even provide temporal protection, and is slower than ASAN in those modes?) There's probably a reason almost nobody uses it from what I see; it sounds pretty half-baked...

Yes, it might have stopped the CloudFlare case, if they were willing to pay (I believe) for L4 over-read protection overheads (2x I believe, with a LOT of variance between GCC and Intel's compiler), and give up multithreading[1] in their application, and probably deal with other false positives and unsupported things.

SGX is completely neutered in Skylake and totally useless without getting your enclave signed by Intel, unless Google has struck a deal or something. You can mostly ignore it. It's good for preparation of your application against future processors where you'll have control over this, though, I guess...

TSX would be nice, yes. It's deeply annoying it's taken them so long to get right and that they've stratified that feature amongst CPUs -- is there any _real_ reason my Kaby Lake XPS13 can't support TSX? I doubt it other than "market segmentation makes us more money". I guess now I'm just ranting, though.

[1] https://intel-mpx.github.io/overview/

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#135
post #130
post #16

Just for reference, since you don't choose your processor explicitly on GCP, but instead choose your zone with homogenous processors, here is their current processor/zone layout: https://cloud.google.com/compute/docs/regions-zones/regions-... Since some GCP engineers are watching: Presumably we'll see some new zones to provide these processors, or will it be a limited release within existing zones? And if so, will yo…

Bothers me a bit with "32 cores" listed when they are 16 core/32 Thread machines.

FWIW, Azure disables hyperthreading on their servers. 1 core = 1 real core.

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#136
post #100
post #91

Earlier quoted context omitted.

How much of a boon is that, though? Isn't Kubernetes built to be self-managing on any platform?

Kubernetes manages containers, but what manages Kubernetes? GKE just makes the experience very painless, updates, etc.

It's better than fully self-managing it, but GKE is still less managed than I'd personally like. I just want to submit containers as jobs to be executed in "the cloud", with the cloud provider figuring out the details of where they get executed. On GKE, have to create a cluster in the cloud, then submit your jobs to your cluster, and set up logic to manage provisioning/resizing/etc., rather than just being able to submit your jobs to a giant abstracted cluster managed by Google. Joyent's Triton container service basically does that, so it's possible.

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#138
post #136
post #100

Earlier quoted context omitted.

Kubernetes manages containers, but what manages Kubernetes? GKE just makes the experience very painless, updates, etc.

It's better than fully self-managing it, but GKE is still less managed than I'd personally like. I just want to submit containers as jobs to be executed in "the cloud", with the cloud provider figuring out the details of where they get executed. On GKE, have to create a cluster in the cloud, then submit your jobs to your cluster, and set up logic to manage provisioning/resizing/etc., rather than just being able to su…

Have you tried Appengine flexible environment?

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#139
post #126

I've been benchmarking these against Haswell and Broadwells. Despite being 300 MHz slower, we're getting between 5 and 45% faster benchmarks on linear algebra functions that we run a lot, even without doing much work to tailor to AVX512 instructions yet. The cache is also a whopping 56 MB.

Still limited to a measly 208gb of RAM? That was pretty good back in the day, but now my desktop workstation has 128gb. AWS offers up to 488gb on their latest R4 instances, and 2tb on their X1 instances released a year ago.

damn. out of curiosity, what do u use that much ram for?

Re: Google Cloud Platform is the first cloud provider to offer Intel Skylake

#140
post #109
post #63

Earlier quoted context omitted.

AWS has a better compliance story. Compare https://aws.amazon.com/compliance/ to https://cloud.google.com/security/compliance

I know security is not compliance, and I'm not here to compare the two, but Google goes to great lengths to protect security. [0] TL;DR: - Google's global SDN is ultra-secure, and Google carries your packets on its network rather than dumping them onto public web. Google's undersea cables are shark bite-proof! [1] - Google Data Centers are mostly homogeneous and rely on Google-build hardware rather than vendors. This…

I can't find "ultra-secure" in any of our security certification docs. Is that better or worse than "super-duper secure"?

For security, I don't care whether my traffic as routed over a private network or public web as long as the data is encrypted, because a "private network" is only as private as thousands of miles of fiber and every single network facility it traverses can be. Which means 'not very'.

Does Google build it's own hard drives/SSD's and CPU's? If not, then that's at least 2 other vendors to trust since both CPU's and hard drives are related to hardware security.

Post reply on HN