Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia to buy assets from Groq for $20B cash

cnbc.com

Post reply on HN
Print view View original

211–220 of 424 posts

Re: Nvidia to buy assets from Groq for $20B cash

#211

Post by _fizz_buzz_ »

Workaccount2 wrote: post #114
impulser_ wrote: post #97

Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…

Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".

> their main trick for model improvement is distilling the SOTA models

Could you elaborate? How is this done and what does this mean?

Re: Nvidia to buy assets from Groq for $20B cash

#212

Post by p1esk »

impulser_ wrote: post #162
nl wrote: post #152

Earlier quoted context omitted.

NVIDIA release some of the best open source models around. Almost all open source models are trained and mostly run on NVIDIA hardware. Open source is great for NVIDIA. They want more open source, not less. Commoditize your complement is business 101.

Then why are they spending $20 billion dollars to handicap an inference company that giving open source models a major advantage over closed source models?

they spending $20 billion dollars to handicap an inference company

Inference hardware company

Re: Nvidia to buy assets from Groq for $20B cash

#213

Post by lumost »

gchadwick wrote: post #72
nickysielicki wrote: post #34

Groq press release: https://groq.com/newsroom/groq-and-nvidia-enter-non-exclusiv... > Today, Groq announced that it has entered into a non-exclusive licensing agreement with Nvidia for Groq’s inference technology. The agreement reflects a shared focus on expanding access to high-performance, low cost inference. > As part of this agreement, Jonathan Ross, Groq’s Founder, Sunny Madra, Groq’s President, and other member…

Another example of the growing trend of buying out key parts of a company to avoid any actual acquisition? I wonder if equity holding employees get anything from the deal or indeed if all the investors will be seeing a return from this?

I wonder if such deals will create employee lawsuits. I'd certainly be looking at legal options if I was one of the founding employees.

Re: Nvidia to buy assets from Groq for $20B cash

#214

Post by wmf »

lumost wrote: post #213
gchadwick wrote: post #72

Earlier quoted context omitted.

Another example of the growing trend of buying out key parts of a company to avoid any actual acquisition? I wonder if equity holding employees get anything from the deal or indeed if all the investors will be seeing a return from this?

I wonder if such deals will create employee lawsuits. I'd certainly be looking at legal options if I was one of the founding employees.

The employees are getting paid twice.

Re: Nvidia to buy assets from Groq for $20B cash

#215

Post by MobiusHorizons »

_fizz_buzz_ wrote: post #211
Workaccount2 wrote: post #114

Earlier quoted context omitted.

Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".

> their main trick for model improvement is distilling the SOTA models Could you elaborate? How is this done and what does this mean?

I am by no means an expert, but I think it is a process that allows training LLMs from other LLMs without needing as much compute or nearly as much data as training from scratch. I think this was the thing deepseek pioneered. Don’t quote me on any of that though.

Re: Nvidia to buy assets from Groq for $20B cash

#216

Post by quesera »

bonesss wrote: post #86
agency wrote: post #27

Earlier quoted context omitted.

> Groq raised $750 million at a valuation of about $6.9 billion three months ago. Investors in the round included Blackrock and Neuberger Berman, as well as Samsung, Cisco, Altimeter and 1789 Capital, where Donald Trump Jr. is a partner.

They made Jimmy Carter sell his peanut farm…

That's the thing though -- no one made Jimmy Carter sell his farm[0].

But Jimmy Carter was an honorable human, and, well...there are fewer people fitting that description sitting behind the Resolute desk, today.

[0] He didn't sell it, he put it into a blind trust. He should have sold it. When he left office, the farm was $1MM in debt.

Re: Nvidia to buy assets from Groq for $20B cash

#217

Post by piskov »

refulgentis wrote: post #203
piskov wrote: post #135

Earlier quoted context omitted.

Because this is exactly the demonstration of abstraction: the same stuff allows direct gpu communication so that even mac nvidia thing is possible. It is not tied to nvidia as well. This is the power of tinygrad

My deepest apologies, I can't parse this and I earnestly tried: 5 minutes of my own thinking, then 3 llms, then a 10 minute timer of my own thinking over the whole thing. My guess is you're trying to communicate "tinygrad doesn't need gpu drivers" which maybe is transmutated into "tinygrad replaces CUDA" and you think "CUDA means other GPUs can't be used for LLMs, thus nvidia has a strangehold" I know George has push…

> Compute Workload Test: This will be add soon

Wonder what happened that it never came.

> Willy's got his i3-12100 Gen RTX3090 hosted on Ubuntu with Juice Server

E-gpu my ass

Re: Nvidia to buy assets from Groq for $20B cash

#218

Post by Demiurge »

impulser_ wrote: post #127
Workaccount2 wrote: post #114

Earlier quoted context omitted.

Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".

They don't need to catch up. They just need to be good enough and fast as fuck. Vast majority of useful tasks of LLMs has nothing to do with how smart they are. GPT-5 models have been the most useless models out of any model released this year despite being SOTA, and it because it slow as fuck.

I get GPT 5.2 responses on copilot faster than for any other model, almost instantly. Are you sure they’re slow as fuck?

Re: Nvidia to buy assets from Groq for $20B cash

#219

Post by biggc »

DivingForGold wrote: post #158
justincormack wrote: post #45

Earlier quoted context omitted.

So it is not structured as an acquisition to avoid anti trust but effectively it probably is.

Indeed, as justincormack comments: ”It is not structured as an outright acquisition to avoid US Gov't anti trust scrutiny, but effectively it probably is”. “Non-exclusive” ? Ummmm, yeah, right, sure. You can probably bet there is an private understanding that Groq will no longer offer it's “top of the line” best technology to competitors of Nvidia. Some may see this as a clever, “slight of the hand” attempt for Nvidi…

What generated this comment?

Re: Nvidia to buy assets from Groq for $20B cash

#220

Post by richardw »

This is smart as hell. I’ve long wondered how they’d combat ASIC’s without diluting their own benefits. This gives them a bit more time to figure out the moats, which is useful because Groq was going places. This juices Groq’s distribution, production, ability to access a wider range of skills where necessary.

I expect China to want to compete with this. Simpler than full-blown Nvidia chips. Cue much cheaper and faster inference for all.

Post reply on HN