Live data from Hacker News

AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

ir.amd.com

11–20 of 53 posts

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#11
post #9

Such a weird & cruel modernity, where these releases are purely in the abstract. No, you still won't be able to buy a MI300X in Q4 2024. The enhanced edition will absolutely not be available. (I miss the old PC era where the world at large was benefiting in tandem from new things happening (or falling behind from not adapting)).

I think that's where short-sighted financial gain leads AMD to. Where's the money? -- datacenter. So let's focus the good stuff on datacenter exclusivelly. What about "the rest" (gamers, hobbist, students)? There's no money there, let's give theme crap RDNA that we make sure can't be used for any real work; just pretent we're catering for their needs. I think their "consumer GPU" did so bad recently that AMD could ju…

The RX 7900s are pretty good. You get 24GB of RAM in a consumer GPU. If you're interested in GenAI that's a good offering for your "gamers, students, hobbyists" category.

And they announced a workstation version with 48GB: https://www.phoronix.com/news/AMD-Radeon-PRO-W7900-Dual-Slot

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#12

Such a weird & cruel modernity, where these releases are purely in the abstract. No, you still won't be able to buy a MI300X in Q4 2024. The enhanced edition will absolutely not be available. (I miss the old PC era where the world at large was benefiting in tandem from new things happening (or falling behind from not adapting)).

> No, you still won't be able to buy a MI300X in Q4 2024. they're 15k - who exactly is disappointed they won't be able to buy one?

I mean it's the price of 2 * Apple Mac Pro's. It isn't exactly unheard of.

Just a few weeks ago I spoke to someone who shelled out $10k for running LLM's locally. I've seen more expensive builds as well.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#13
post #8
post #6

Earlier quoted context omitted.

> (I miss the old PC era where the world at large was benefiting in tandem from new things happening (or falling behind from not adapting)) Paper launches aren't anything new. It's always been a thing especially in hardware.

What is kind of new is that hyperscalers sometimes get chips 1-2 years before the rest. If the new chip is 3x-4x faster that looks pretty unfair.

> What is kind of new is that hyperscalers sometimes get chips 1-2 years before the rest.

That's not new. Replace hyperscalers with crypto miners and we've had a similar situation for a while.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#14
post #5

The claim that the next generation would be 35x faster, felt like an "Osborne moment" to me, but if demand is robust enough...

(Re: Osborne effect) It's going to be released in 2 years. Rarely can businesses wait that long, they're going to be ordering the MI300 now.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#15
post #11
post #9

Earlier quoted context omitted.

I think that's where short-sighted financial gain leads AMD to. Where's the money? -- datacenter. So let's focus the good stuff on datacenter exclusivelly. What about "the rest" (gamers, hobbist, students)? There's no money there, let's give theme crap RDNA that we make sure can't be used for any real work; just pretent we're catering for their needs. I think their "consumer GPU" did so bad recently that AMD could ju…

The RX 7900s are pretty good. You get 24GB of RAM in a consumer GPU. If you're interested in GenAI that's a good offering for your "gamers, students, hobbyists" category. And they announced a workstation version with 48GB: https://www.phoronix.com/news/AMD-Radeon-PRO-W7900-Dual-Slot

Indeed for me that's the only standout from this release, 48gb not too overpriced.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#16

Such a weird & cruel modernity, where these releases are purely in the abstract. No, you still won't be able to buy a MI300X in Q4 2024. The enhanced edition will absolutely not be available. (I miss the old PC era where the world at large was benefiting in tandem from new things happening (or falling behind from not adapting)).

[deleted]

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#17

Such a weird & cruel modernity, where these releases are purely in the abstract. No, you still won't be able to buy a MI300X in Q4 2024. The enhanced edition will absolutely not be available. (I miss the old PC era where the world at large was benefiting in tandem from new things happening (or falling behind from not adapting)).

> No, you still won't be able to buy a MI300X in Q4 2024. they're 15k - who exactly is disappointed they won't be able to buy one?

As someone who's buying them, that is not the price. Nor can you just buy one at a time. They are on a OAM/UBB, which is 8.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#18
post #14
post #5

The claim that the next generation would be 35x faster, felt like an "Osborne moment" to me, but if demand is robust enough...

(Re: Osborne effect) It's going to be released in 2 years. Rarely can businesses wait that long, they're going to be ordering the MI300 now.

[deleted] See below, I did not understand the Osborne effect comment.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#19
post #13
post #8

Earlier quoted context omitted.

What is kind of new is that hyperscalers sometimes get chips 1-2 years before the rest. If the new chip is 3x-4x faster that looks pretty unfair.

> What is kind of new is that hyperscalers sometimes get chips 1-2 years before the rest. That's not new. Replace hyperscalers with crypto miners and we've had a similar situation for a while.

Crypto miners no longer buy up large quantities of GPUs. That market died off when ETH switched from PoW to PoS.

Re: AMD Instinct MI325X in Q4 2024, 288GB of HBM3E

#20
post #14

Earlier quoted context omitted.

(Re: Osborne effect) It's going to be released in 2 years. Rarely can businesses wait that long, they're going to be ordering the MI300 now.

[deleted] See below, I did not understand the Osborne effect comment.

You're going to wait for the MI350 and not order any more MI300s?
Post reply on HN