331–340 of 437 posts
Looks like just rebranded DGX in laptop form, the biggest miss is the weak memory speed, 1/2 of the M5 laptop memory speed, and 1/3 of the M3 ultra that is now years old...
Earlier quoted context omitted.
Press releases are easy. Delivering on promises, not so much.
This thread is almost 1:1 identical to when Apple released their own silicon. This has the potential to be a worthy competitor for the Windows ecosystem, precisely because of NVidia’s moat as the grandparent pointed out. Microsoft pulls in their weight as well, so this seems like it has a decent chance of getting industry support.
Earlier quoted context omitted.
This thread is almost 1:1 identical to when Apple released their own silicon. This has the potential to be a worthy competitor for the Windows ecosystem, precisely because of NVidia’s moat as the grandparent pointed out. Microsoft pulls in their weight as well, so this seems like it has a decent chance of getting industry support.
Yes, there is a chance but it could also turn into another Itanium. Just because it is a superior product and backed by giants, doesn't necessarily guarantee success.
Kinda underwhelming. I was hoping to see that they improved their memory bandwidth to move toward competing with the M5 Max. But this is more akin to the Strix Halo.
From what I'm reading it's probably the same chip that's used in the DGX Spark, the memory bandwidth at 300MB/s is equivalent to an M5 Pro, however you can't get an M5 Pro with 128GB of RAM. Apple pushes you to the biggest M5 Max chip, which at the 14 inch form factor, costs you $5099. You can get an ASUS GB10 machine with 2TB storage for $4000, so I guess the RTX Spark laptops will be more than that due to battery a…
Earlier quoted context omitted.
This thread is almost 1:1 identical to when Apple released their own silicon. This has the potential to be a worthy competitor for the Windows ecosystem, precisely because of NVidia’s moat as the grandparent pointed out. Microsoft pulls in their weight as well, so this seems like it has a decent chance of getting industry support.
That said, Apple still deserves a lot of credit. They had a 5+ year edge, especially around the vision of tightly integrating the NPU and unified memory.
This seems to be an attempt to compete with people running local models on Apple hardware—even though those local Mac Mini setups aren't really powerful. I expect we'll get there in a few years, so perhaps this is Nvidia taking an early step in that direction. In that case, this goes against Anthropic and OpenAI's business models. Which is a double whammy after Jensen Huang's recent comment about how agentic coding w…
I don't believe Anthropic and OpenAI are any more fearful of local AI than Google or Microsoft are of people hosting their own email. Local AI capabilities are growing at a rapid pace, but so is hosted AI. While you can do a surprising amount of useful work with a model occupying a few to a few hundred gigs of VRAM, the hosted models are going to be way ahead for a long time.
Google/Microsoft and hosting your own email is a byproduct of how difficult (socially, not technically) hosting your own email has become - mostly because SMTP protocol is inherently broken by spam and patched by social construct (trusted nodes, abuse@, 3+ DNS entries and counting, etc). Purely technical solutions, such HashCash etc, got discontinued in exchange for social ones. Central providers made (sometimes in exchange for, sometimes as excuse of, spam protection) self-hosting socially hard.
Now, I wonder if, and how, once Anthropic and OpenAI need to demonstrate profitability, could hamstring local AI. Which has been /so far/ very valuable for me in doing things that hosted providers don't want liability for, and align against (even if totally lawful and fair use!).
For anyone curious to know how this will fare against Macbooks, at least in CPU perf: DGX Spark has the exact same GPU and CPU as the top RTX Spark laptops will, so you can just directly compare from that. Of course, DGX Spark is a miniPC, so laptops will likely be slower due to power limits/throttling.
DGX Spark is really poor at inference due to the memory bandwidth so hopefully they’ve fixed that before touting this as a way to run local models.
Earlier quoted context omitted.
That said, Apple still deserves a lot of credit. They had a 5+ year edge, especially around the vision of tightly integrating the NPU and unified memory.
Like gaming consoles they calculated that unified memory will be cheaper for them in the long run. The funny thing is that while it gave them a unintended edge on local A.I, the "cheaper" calculation, didn't work out so well for them.
Earlier quoted context omitted.
Like gaming consoles they calculated that unified memory will be cheaper for them in the long run. The funny thing is that while it gave them a unintended edge on local A.I, the "cheaper" calculation, didn't work out so well for them.
In what way hasn't it worked out for Apple? Some of their products are totally sold out.
Earlier quoted context omitted.
Press releases are easy. Delivering on promises, not so much.
This thread is almost 1:1 identical to when Apple released their own silicon. This has the potential to be a worthy competitor for the Windows ecosystem, precisely because of NVidia’s moat as the grandparent pointed out. Microsoft pulls in their weight as well, so this seems like it has a decent chance of getting industry support.