Live data from Hacker News

Our container platform is in production. It has GPUs. Here's an early look

blog.cloudflare.com

71–76 of 76 posts

Re: Our container platform is in production. It has GPUs. Here's an early look

#71

Earlier quoted context omitted.

Won't apply to everyone (most?), but some compliance assurances your customers may require can't be fulfilled by Cloudflare. And personally, I would hope their laissez faire attitude towards protecting hate speech should damage their business, but I suspect most people not targeted by such just don't give a damn.

What’s hate speech to you is free speech to someone else.

That's not a real distinction, pseudo-koan aside.

Re: Our container platform is in production. It has GPUs. Here's an early look

#73

Earlier quoted context omitted.

One data point but, one among our toy services has been pushing 30TB/mo to 60TB/mo for over a year now, and we haven't got the call: https://news.ycombinator.com/item?id=39521228

Can you share what kind of toy is shuffling around so much data?

https://x.com/rethinkdns/status/1840224431773188125 / https://archive.md/9zkIF

Re: Our container platform is in production. It has GPUs. Here's an early look

#74

Edgegap has been doing this for 5 years.

I can't find any GPU capabilities on their website and it seems to be 100% focused on game backend hosting, not general workers. Do you have more information?

They do have gpu, but pricing is not on the website. They also support non gaming use case. They list stuff like virtual rehersal studio, iot and some other non-gaming use cases as their customers.

Re: Our container platform is in production. It has GPUs. Here's an early look

#75

Earlier quoted context omitted.

The short answer here is that NVIDIA doesn't like Cloud Service Partners using RTX cards, as they are "professional" cards (they are also significantly cheaper than the corresponding data center cards). IIRC, A40, L40, and L40S have ray tracing, and might be more available on CSPs. Otherwise, the GPU marketplaces that aren't "true" CSPs will likely have RTX cards. Paperspace (now DO), Vultr, Coreweave, Crusoe, should…

Incredibly helpful, thank you! We did try on the T4 and A10G but the raytracing failed even though those cards claim to support it. We ended up on Paperspace for the time being but they depreciated their support for Windows so I've been looking for alternatives. Will check out the provides you mentioned. Thanks again.

Oof, the short answer is Windows + virtualization + GPUs is hard for anyone to support. Two main difficult problems:

- Licensing Windows is really, really annoying (and expensive), and BYOL is something people seem oddly reticent to do - Installing (and updating) NVIDIA GPU drivers on Windows is something that requires GUI access (at least the first time)

Paperspace was going to be my answer, but I guess DO didn't like those problems either! NVIDIA has an RTX Cloud, though I admit I'm struggling to find mention of it on their website, maybe something like: https://www.nvidia.com/en-us/data-center/free-trial-virtual-...

Re: Our container platform is in production. It has GPUs. Here's an early look

#76

Earlier quoted context omitted.

Won't apply to everyone (most?), but some compliance assurances your customers may require can't be fulfilled by Cloudflare. And personally, I would hope their laissez faire attitude towards protecting hate speech should damage their business, but I suspect most people not targeted by such just don't give a damn.

What’s hate speech to you is free speech to someone else.

No, hate speech is hate speech. If it’s free speech to you, then you’re exactly in the group of people I’d rather not sharing infrastructure, or anything else with.
Post reply on HN