Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia RTX Spark

nvidia.com

Post reply on HN
Print view View original

91–100 of 437 posts

Re: Nvidia RTX Spark

#91

Post by pitched »

LatencyKills wrote: post #73

First: > "Our goal is to deliver unmetered intelligence to every home and every desk with Windows," said Satya Nadella, chairman and head of Microsoft. Then: > However, Ian Fogg, Research Director at industry analyst firm FDM CCS Insight said the change was "likely to come with a significant price tag" and Nvidia would be targeting "those looking for workstation-class performance". So... not every desk with Windows.

First, make it possible. Then, expand the market. The early adopters help pay R&D for later efforts. Every desk is a good goal, even if not hit by the first doodad.

It just feels too much like what they said about Apple II and early Windows. A play at nostalgia instead putting real thought into it.

Re: Nvidia RTX Spark

#92

Post by dom96 »

I’m getting more and more convinced that we will end up running LLMs in our personal computers. Which makes me wonder where Anthropic/OpenAIs moats will come from.

Re: Nvidia RTX Spark

#94

Post by Iolaum »

PunchyHamster wrote: post #87

The fact they advertise it as some step forward in PCs is outright bizzare. It's just worse Strix Halo, as you are landing square in middle of Windows ARM problems

Strix Halo chips have around 210+ GB/sec gpu memory bandwidth and announcements put the new nvidia chip at around 300GB/sec gpu memory bandwidth.

I 'd say that is an improvement if you want to run local llm inference. Still well below with what you can achieve with Apple chips though.

Re: Nvidia RTX Spark

#95

Post by itake »

dom96 wrote: post #92

I’m getting more and more convinced that we will end up running LLMs in our personal computers. Which makes me wonder where Anthropic/OpenAIs moats will come from.

My biggest concern with local LLMs is there just isn't enough RAM or HD space to run multiple models, and the generic LLMs are too generic...

Re: Nvidia RTX Spark

#98

Post by VMG »

dom96 wrote: post #92

I’m getting more and more convinced that we will end up running LLMs in our personal computers. Which makes me wonder where Anthropic/OpenAIs moats will come from.

Convince me

1. in order to run LLMs, especially the best ones, you need complicated devices which are expensive

2. if you buy one for your personal use, you are probably not going to utilize it all the time and it will be idle a lot

It seems to me that it will always be more economical that the LLM-running devices are in a datacenter where it is easier to make sure they are always utilized

Re: Nvidia RTX Spark

#99

Post by aseipp »

The GB10 itself is pretty good and I love using mine for broad Linux development. But it's too expensive for consumer level pricing, and even for the "prosumer" the price is pretty stiff. Even if they dropped the CX-7 and halfed the RAM and shipped a smaller hard drive, would it be below, say, $2500 USD? I guess we'll see, but this variant is coming out pretty late so maybe it's just best to wait for the 2nd generation.

Re: Nvidia RTX Spark

#100

Post by ocdtrekkie »

The thing I think is really funny is that if this takes off, frontier model companies and datacenters will end up holding the bag, and as per usual after the last few tech hype cycles, NVIDIA will still be selling.

Eventually a lot of inference will get right-sized into something you affordably run yourself.

Post reply on HN