Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AMD Ryzen AI Halo – $4k AI Dev Kit

lttlabs.com

Post reply on HN
Print view View original

201–210 of 274 posts

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#201

Post by icedchai »

hamdingers wrote: post #195
827a wrote: post #142

Earlier quoted context omitted.

Framework, weirdly, overcharges considerably for their SSDs. You can currently get a Samsung 990 Pro 2TB on Amazon for $390; Framework charges $625 for the Sandisk 850x 2TB, which has similar performance (and is being sold on Amazon for $530). If you DIY your own SSD, you can spec a Framework Desktop for below $4k; but not much below. Roughly the same price.

If you can supply your own SSD, case, and 120mm fan the mainboard is "only" $3,149

And it was "only" $1700 last year!

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#202

Post by icedchai »

ahmadyan wrote: post #173
c7b wrote: post #131

Earlier quoted context omitted.

You're the one making things up. An M3 Ultra with 128GB RAM doesn't exist, the M3 Max has 410GB/s bandwidth [0]. I was of course talking about the M4 Max with 546GB/s, which was closer to twice the price of a Strix Halo mini PC in a typical configuration when it was still available. And memory bandwidth isn't everything, NVidia's lead in software is substantial, look up any tests comparing them side-by-side. [0] http…

Google is your friend: https://www.apple.com/mac-studio/specs/ Apple M3 Ultra chip 819GB/s memory bandwidth They have 96, 128, 256, and 512GB variants my friend.

They stopped selling anything greater than the 96 gig variant a while back. If you want more RAM, be prepared to bid high on ebay.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#203

Post by fc417fc802 »

danielrmay wrote: post #162
Mogzol wrote: post #157

Earlier quoted context omitted.

This hardware was just released this week? The CPU is from last year, but this dev kit is brand new.

Can you explain which benchmarking differences you'd expect to see from this hardware, considering?

Can you articulate which new hardware you would have preferred them to look at and why?

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#204

Post by fc417fc802 »

Rzor wrote: post #172
onraglanroad wrote: post #138

I think I might be tempted to wait for the Butlerian market crash and pick up stuff from the firesale. Depends how long this market can remain utterly loony though.

>Depends how long this market can remain utterly loony though. Probably way, way longer than we'd ideally like. Every now and then, you hear that this is the new normal, that it'll last until 2032 or something, and I can practically smell the paid advertising or cult-like messaging behind attempts to destroy any speck of hope consumers have so they'll just pay the toll. But man, it really could be exactly that. There…

> There's just too much money to be made for all the involved parties.

Even setting that aside, depending on the pace of datacenter buildout even a round of new fab capacity coming online might not be enough to bring prices down. I think there's a decent chance we have to wait for investors to get tired of building new datacenters which could easily be 5+ years.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#205

Post by numpad0 »

codedokode wrote: post #197
bronson wrote: post #110

Earlier quoted context omitted.

This is an odd comment. Pins are seriously expensive. Companies don't just throw them in for fun. Usually they're necessary for signal integrity or packaging constraints.

Yes but not $1000 level expensive, right? It is just a tiny piece of metal, and on laptops there are no pins at all.

I think this is about semiconductor design and/or die packaging related difficulties/costs. idk exactly why, but "pin count" in this exact expression is not rare at all on chip marketing materials.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#206

Post by cthalupa »

kristianp wrote: post #193
dabinat wrote: post #62

Earlier quoted context omitted.

A Mac Studio is a much better buy in terms of memory bandwidth, but impossible to buy in a 128 GB configuration. Honestly there aren’t great options right now and it’s probably better to wait for the market to be less insane.

The Mac Studio M3 Ultra with 96GB of RAM with 1Tb SSD costs $6799, but has triple the memory bandwidth [1]. It's almost twice the price of Strix Halo and when the M5 Ultras come out it will be interesting to see how much they go for. I expect a lot of demand for them! There was a post recently, that showed the DGX spark is twice as fast as the M3 Ultra at prompt processing, but half as fast at output tokens [2]. They…

I’ve got a 128gb m5 max mbp and two sparks. For my real-world use cases, a single spark running DS4 Flash will have fully responded by the time my Mac has even started generating tokens. I figured I’d have more generation heavy work when I also bought the Mac, but it has done very little work running LLMs since I got the first Spark.

I mostly run them clustered for DS4 and am quite happy with the performance, and the cost isn’t that much more for two than the MBP while giving me double the unified memory.

I’ll probably pick up a third to run multiple smaller models. I don’t understand why people would buy a halo over a spark at comparable prices, particularly because if you want to cluster, the cx7 be beats the shit out of them when it comes to latency and throughput

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#207

Post by cowmix »

qingcharles wrote: post #180
cowmix wrote: post #148

Earlier quoted context omitted.

I got the EVO-X2 for $1,599! In 44+ years of buying computers, I've seen some appreciation, but nothing like this. Going from $1,599 to ~$3,500 in a year is just insane.

I've never seen appreciation in buying PCs. They were always like cars, once you drive them off the lot...

Well, GPUs sorta went up in the past 5 years.. but nothing like now.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#208

Post by dofm »

sarjann wrote: post #99
Tenoke wrote: post #63

Earlier quoted context omitted.

I looked for one and it's impossible to find, let alone at a reasonable price + it does suffer from being harder to train/use less common models and workflows (e.g. arbitrary comfyui ones). Spark at least doesnt have that drawback, while AMD has both drawbacks. Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.

No, equities naturally trend up with economic growth. RAM is up because of a supply shock, as new capacity comes on prices will drop, it’s a commodity.

But it could get worse for two years yet.

Re: AMD Ryzen AI Halo – $4k AI Dev Kit

#209

Post by dofm »

hadlock wrote: post #134
dabinat wrote: post #62

Earlier quoted context omitted.

A Mac Studio is a much better buy in terms of memory bandwidth, but impossible to buy in a 128 GB configuration. Honestly there aren’t great options right now and it’s probably better to wait for the market to be less insane.

Apple rumor mill is suggesting that we may see M5 Mac Studio announced in September at that event. Apple just increased their pricing across the board, so I'm not holding my breath that they will be reasonably priced. They also cancelled development of their M6 in favor of the future M7 which I suspect will be a major, AI-focused upgrade compared to the M4->M5 upgrade

They cancelled the higher-end M6 models (including the Pro, this time).

There will be a basic M6.

Post reply on HN