291–300 of 336 posts
How are people using these GPU clouds with their data residing in one of the big cloud providers like AWS or Azure? Are they paying for egress to get data onto the GPU clouds?
Yes.... you eat the egress cost. Pretty soon, these specialists will build object storage and all of the other "costs" that the legacy hyperscalers already incur.
Earlier quoted context omitted.
> It seems like AWS' entire business model is making the pricing so confusing that you don't know what it will cost until after you've used it. Maybe I'm naive, but I don't think that's intentional. I think it's just a byproduct of trying to build something that works for everyone and every use case. As you make your target market bigger and bigger, you continually hit edge case after edge case that you try and solve…
So you're saying that they can't implement a hard limit, yet are able to provide hard-limited trials / student credits? It's impossibly hard to believe they couldn't implement the pre-paid model
I have good reasons to believe that all this capex into GPUs will backfire. Metrics aren’t looking good for AI adoption, and growth rate is slowing down while inference and training costs are plummeting.
Besides Alibaba Cloud and AWS, are there other FPGA cloud services?
Earlier quoted context omitted.
>hook pricing (aka up front pricing that looks low and turns out high) is only rational. Yes, many deceptive business practices are rational acts on the part of the businesses. That doesn't mean they should be tolerated.
I have begun to think of this as a "large population error", and I'm noticing it in a lot of different markets. At small scales, annoying your customers is bad business. You only need to lose a few before it begins to hurt. Customer complaints are more likely to be a consideration in business decisions. At larger scales, a business can begin to preferentially adopt practices intended to drive away some customers. Per…
I'm not really sure what you mean. The EU has managed to put together much better consumer protections in a lot of areas. There are large businesses there.
Earlier quoted context omitted.
> There is no reason you can't show final price including tax on the label in a physical shop. Sure there is. When the price label is affixed by the factory/warehouse then you would have to track where everything is going and be unable to share inventory. Also, if the sales tax rate changes then all the labels become wrong. These would ultimately increase costs for consumers. Adding sales tax is also not at all misle…
> When the price label is affixed by the factory/warehouse then you would have to track where everything is going and be unable to share inventory. Price tags are pretty much universally handled at the stores. There are some goods where the price tag is attached, but that's more the exception and not the rule. This is a solvable problem. So much so that if you've traveled in most nations you'll see that all prices in…
Advertising isn't. If the same ad is viewable by people in different states, what price are they supposed to put on it? Shouldn't this be the same price as what they show in the stores, or else people will have trouble knowing if the advertising was deceptive?
> This is a solvable problem. So much so that if you've traveled in most nations you'll see that all prices include tax.
Don't most of those other nations have a uniform tax rate?
Earlier quoted context omitted.
Yeah, Hetzner has 20 vCPU 64GB RAM i5-13500 servers for $40/mo: https://www.hetzner.com/dedicated-rootserver/matrix-ex/ This is ~10x cheaper than the closest AWS option, and without the extra fees. Also of note that Hetzner is profitable, which means AWS has been operating at an insane markup.
Yeh but a pragmatic decision like a $40pcm box won't go down well with your now very bored team of SREs, DevOps and distributed systems engineers(tm) who demand more playtime with the magic cloud toybox (for a 100DAU internal app).
There's also middle ground in the form of Digital ocean's kubernetes which runs noticeably cheaper than big tech cloud offerings.
Earlier quoted context omitted.
So you're saying that they can't implement a hard limit, yet are able to provide hard-limited trials / student credits? It's impossibly hard to believe they couldn't implement the pre-paid model
would you want your services to just turn off when a certain threshold is hit? If so, this problem is solved, set an alarm when cost hits X, use that alarm to trigger a Lambda to turn off the unwanted infra. AWS provides all the tools you need, you just need to use them.
Earlier quoted context omitted.
Yeah, Hetzner has 20 vCPU 64GB RAM i5-13500 servers for $40/mo: https://www.hetzner.com/dedicated-rootserver/matrix-ex/ This is ~10x cheaper than the closest AWS option, and without the extra fees. Also of note that Hetzner is profitable, which means AWS has been operating at an insane markup.
Yeh but a pragmatic decision like a $40pcm box won't go down well with your now very bored team of SREs, DevOps and distributed systems engineers(tm) who demand more playtime with the magic cloud toybox (for a 100DAU internal app).
Earlier quoted context omitted.
Yeah, Hetzner has 20 vCPU 64GB RAM i5-13500 servers for $40/mo: https://www.hetzner.com/dedicated-rootserver/matrix-ex/ This is ~10x cheaper than the closest AWS option, and without the extra fees. Also of note that Hetzner is profitable, which means AWS has been operating at an insane markup.
Yeh but a pragmatic decision like a $40pcm box won't go down well with your now very bored team of SREs, DevOps and distributed systems engineers(tm) who demand more playtime with the magic cloud toybox (for a 100DAU internal app).
Good ol' bare metal is real nice, but it won't save you from application complexity, security requirements, and so on - you still need to manage it somewhat. If you're not a startup looking for market fit at least.