Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nvidia to buy assets from Groq for $20B cash

cnbc.com

Post reply on HN
Print view View original

151–160 of 424 posts

Re: Nvidia to buy assets from Groq for $20B cash

#151

Post by aschobel »

impulser_ wrote: post #127
Workaccount2 wrote: post #114

Earlier quoted context omitted.

Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".

They don't need to catch up. They just need to be good enough and fast as fuck. Vast majority of useful tasks of LLMs has nothing to do with how smart they are. GPT-5 models have been the most useless models out of any model released this year despite being SOTA, and it because it slow as fuck.

For coding I don’t use any of the previous gen models anymore.

Ideally I would have both fast and SOTA; if I would have to pick one I’d go with SOTA.

There a report by OpenRouter on what folks tend to pay for it; it generally is SOTA in the coding domain. Folks are still paying a premium for them today.

There is a question if there is a bar where coding models are “good enough”; for myself I always want smarter / SOTA.

Re: Nvidia to buy assets from Groq for $20B cash

#152

Post by nl »

impulser_ wrote: post #97

Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…

NVIDIA release some of the best open source models around.

Almost all open source models are trained and mostly run on NVIDIA hardware.

Open source is great for NVIDIA. They want more open source, not less.

Commoditize your complement is business 101.

Re: Nvidia to buy assets from Groq for $20B cash

#153

Post by cavisne »

pinkmuffinere wrote: post #146

> Groq will continue to operate as an independent company with Simon Edwards stepping into the role of Chief Executive Officer. Kindof feel bad for Simon Edwards, lol. I wonder what the plan is for the future of Groq

I would assume this is a very well paid position, and with basically nothing to do.

Re: Nvidia to buy assets from Groq for $20B cash

#154

Post by nl »

impulser_ wrote: post #127
Workaccount2 wrote: post #114

Earlier quoted context omitted.

Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".

They don't need to catch up. They just need to be good enough and fast as fuck. Vast majority of useful tasks of LLMs has nothing to do with how smart they are. GPT-5 models have been the most useless models out of any model released this year despite being SOTA, and it because it slow as fuck.

GPT 5 Codex is great - the best coding model around except maybe for Opus.

I'd like more speed but prefer more quality than more speed.

Re: Nvidia to buy assets from Groq for $20B cash

#155

Post by nabla9 »

yousif_123123 wrote: post #115

Not good. This shouldn't be allowed. What would be better is if groq and cerebras combined, and maybe other companies invested in them to help them scale. Why would the major cloud providers not lobby against this? Usually antitrust is for consumers, but here I think companies like Microsoft and AWS would be the biggest beneficiaries of having more AI chip competition.

It's a non-exclusive deal.

No reason for antitrust action whatsoever.

Re: Nvidia to buy assets from Groq for $20B cash

#156

Post by nutjob2 »

exasperaited wrote: post #93
bdangubic wrote: post #89

Earlier quoted context omitted.

as useful as it was before this administration when big tech was sucking up to whomever was running the country (e.g. “macho man” Zuck was getting ready to tattoo DEI on his forehead couple of years ago) or just now it’ll be magically useful?

You miss my point. This is a list of people engaging in something flat-out corrupt . The ballroom is an inherently corrupt project. It will prove to be simple corruption.

If justice is served it'll be knocked down by the next admin, if it is ever built.

Re: Nvidia to buy assets from Groq for $20B cash

#157

Post by ymck »

impulser_ wrote: post #97

Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…

I'd say that it's probably not a play against open source, but more trying to remove/change the bottlenecks in the current chip production cycle. Nvidia likely doesn't care who wins, they just want to sell their chips. They literally can't make enough to meet current demand. If they split off the inference business (and now own one of the only purchasable alternatives) they can spin up more production.

That said, it's completely anti-competitive. Nvidia could design a inference chip themselves, but instead the are locking down one of the only real independents. But... Nobody was saying Groq was making any real money. This might just be a rescue mission.

Re: Nvidia to buy assets from Groq for $20B cash

#158

Post by DivingForGold »

justincormack wrote: post #45
nickysielicki wrote: post #34

Groq press release: https://groq.com/newsroom/groq-and-nvidia-enter-non-exclusiv... > Today, Groq announced that it has entered into a non-exclusive licensing agreement with Nvidia for Groq’s inference technology. The agreement reflects a shared focus on expanding access to high-performance, low cost inference. > As part of this agreement, Jonathan Ross, Groq’s Founder, Sunny Madra, Groq’s President, and other member…

So it is not structured as an acquisition to avoid anti trust but effectively it probably is.

Indeed, as justincormack comments: ”It is not structured as an outright acquisition to avoid US Gov't anti trust scrutiny, but effectively it probably is”. “Non-exclusive” ? Ummmm, yeah, right, sure. You can probably bet there is an private understanding that Groq will no longer offer it's “top of the line” best technology to competitors of Nvidia. Some may see this as a clever, “slight of the hand” attempt for Nvidia to maintain it's perceived dominance & lead in GPU-TPU development. “Non-exclusive” does not in any form or fashion spell out that all Nvidia's competitors can and will obtain the very top, cutting edge Groq technology as Nvidia will obtain . . .

Re: Nvidia to buy assets from Groq for $20B cash

#160

Post by bdangubic »

mrbungie wrote: post #133
exasperaited wrote: post #93

Earlier quoted context omitted.

You miss my point. This is a list of people engaging in something flat-out corrupt . The ballroom is an inherently corrupt project. It will prove to be simple corruption.

Why is that relevant if there is no one willing to prosecute and convict?

it is completely irrelevant but people still waste internet bandwidth with nonsense :)
Post reply on HN