Live data from Hacker News

Alternative clouds are booming as companies seek cheaper access to GPUs

techcrunch.com

251–260 of 336 posts

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#251

Earlier quoted context omitted.

California gets a lot of flack for having too much regulation, but this change is very welcome for consumers. No more junk fees in CA. - https://www.sfgate.com/food/article/sf-restaurants-junk-fees...

Is this just restaurants?

No, it’s everything. Restaurants somehow thought they’d be exempt and the article is referencing recent explicit guidance that they will not be.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#252
post #238

Earlier quoted context omitted.

Most Americans don't realize just how huge and extensive medicare/medicaid is. They cover 65mil and 88mil people respectively, including 40mil children. That's 153mil people out of 330mil population -- that's 46% of the USA's population. Total spending is $1.9T for both. A cost of $12,400/person covered. $1.9T is 7.5% of the total US GDP of $25.44T. Medicare/medicaid is a massive program. Bigger than social security…

In that case, why not just go all the way to Medicare for All?

Unfortunately, several million people work in medical billing and insurance. No politician that is aiming to get re-elected wants to double the employment rate. It would cure inflation almost instantly though!

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#253

Earlier quoted context omitted.

At some point, nvidia does have to worry about amd getting their act together once they've annoyed all the current customers

Amd will never figure out drivers and software stuff. That’s always been their weakness

I wonder what Lisa tells the shareholders & board when they ask why billions fly past their noses in valuation. Curious why ATI/AMD never could be on par to Nvidia regarding the software stack (drivers mainly), I would assume bad leadership and goals.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#254
Skypilot is worth a mention here:

https://github.com/skypilot-org/skypilot

Open source CLI to deploy multiple gpu vm’s on all major cloud providers, with an option to use spot pricing with 1 cheap vm used as a controller to always make sure you have the most inexpensive deployment available with failover and load balancing.

It’s like beating the cloud providers at their own game I wouldn’t be surprised if they banned it.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#255

Earlier quoted context omitted.

Amd will never figure out drivers and software stuff. That’s always been their weakness

I wonder what Lisa tells the shareholders & board when they ask why billions fly past their noses in valuation. Curious why ATI/AMD never could be on par to Nvidia regarding the software stack (drivers mainly), I would assume bad leadership and goals.

I'd call it a focus on very profitable ventures, like gaming.

Nvidia effectively created this AI world by building tooling and software for something we didn't know existed up until not too long ago. AI was created on the shoulders of the work that was done.

AMD wasn't taking the risk on the unknown, for whatever reason.

Water under the bridge. The ship is certainly busy course correcting now. Give it some time.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#256
post #246

Earlier quoted context omitted.

It's more than a box in a rack. These providers do actively monitor and fix these boxen. They can all be rebooted remotely as if you physically hit the button, you've got interfaces to access the machine as if you were logging in physically with a DB-9/RS232/ethernet/whatever console, etc. It's not just "space in a rack and you deal with the servers yourself and you come to fix them if they break". These companies kn…

You're missing the point. There's a massive difference between getting a box service, and getting a highly available regionally distributed service with a semblance of a SLA of bandwidth to anywhere on the planet. To quote a former manager, its not even apples and oranges, is apples and pumpkins. They simply aren't in any way the same scope.

What do you mean? The big bare metal providers have multiple datacenters with fat pipelines and peering. You can put those geo-separated servers in the same subnet. Europe and US is covered, it looks like Asia a black spot for Hetzner, I will give you that. I doubt that so many business have such size and global reach, that world wide latency is a priority. If it would be, the average site would not connect to 20 domains to load megabytes of javascripts, trackers and what not.

(Also, at Hetzner you can even rent their network hardware if you want to make custom solutions.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#257

Earlier quoted context omitted.

At some point, nvidia does have to worry about amd getting their act together once they've annoyed all the current customers

Amd will never figure out drivers and software stuff. That’s always been their weakness

Amd will never have a CPU with more core's than Intel.

I'm sure people said that too and look at where we are at today.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#258
post #22

Over the weekend a coworker was helping someone in our lab prepare data for an important conference talk. We accidentally ran up a rather large bill because while the EFS storage pricing was simple enough, the usage pricing bit us. It seems like AWS' entire business model is making the pricing so confusing that you don't know what it will cost until after you've used it. It feels weirdly similar to the US healthcare/…

> It seems like AWS' entire business model is making the pricing so confusing that you don't know what it will cost until after you've used it. It feels weirdly similar to the US healthcare/insurance situation. Not just the healthcare situation, but everything. There's nothing much more stereotypically American than "not knowing what you're going to pay for something until you're billed." Dozens of little fees on you…

Dont forget the runaway interest that accumulates on the credit you used to pay for it. It really never ends. The IRS even has a few pitfalls that allow you to pay taxes you don't really owe, that can't be refunded.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#259
post #16

We're absolutely seeing the same thing even in non-GPU traditional servers. Here is an estimated monthly cost breakdown for a new GCP instance type, the n4-standard-2, in us-central1: 2 vCPU + 8 GB memory: $69.18 10 GB Hyperdisk Balanced: $0.80 3060 provisioned IOPS: $15.30 155 MB/s provisioned throughput: $6.20 Total: $91.48 Like, you can tear apart that $69/mo for 2vCPU + 8gb of memory, no problem. That's utterly i…

The $22/mo hyperdisk is for customers who want effortless durability. The $25 NVMe device is for applications where the data is worthless (not pejorative; there are many worthwhile applications where the data written to storage is of no durable value). It makes sense that there are two different price points.

Re: Alternative clouds are booming as companies seek cheaper access to GPUs

#260

Earlier quoted context omitted.

> It seems like AWS' entire business model is making the pricing so confusing that you don't know what it will cost until after you've used it. It feels weirdly similar to the US healthcare/insurance situation. Not just the healthcare situation, but everything. There's nothing much more stereotypically American than "not knowing what you're going to pay for something until you're billed." Dozens of little fees on you…

People complain about this relentlessly, but never change. Additionally, every single business owner I know complains that whatever it is they're selling, (1) it isn't worth the brain damage to sell to customers looking for the lowest price, (2) as long as people comparison shop in a harebrained way, hook pricing (aka up front pricing that looks low and turns out high) is only rational. It's not like they're providin…

[deleted]
Post reply on HN