Biggest surprise for me is that they chose to announce this on Christmas Eve.
I’d love to have been in the room when that was decided. The big, exciting news doesn’t typically get announced during a major holiday week.
Nvidia to buy assets from Groq for $20B cash
201–210 of 424 posts
Re: Nvidia to buy assets from Groq for $20B cash
#202Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…
Nvidia just released their Nemotron models, and in my testing, they are the best performing models on low-end consumer hardware in both terms of speed and accuracy.
Re: Nvidia to buy assets from Groq for $20B cash
#203Earlier quoted context omitted.
Who cares? Nobody is building large scale inference services with macs.
Because this is exactly the demonstration of abstraction: the same stuff allows direct gpu communication so that even mac nvidia thing is possible. It is not tied to nvidia as well. This is the power of tinygrad
My deepest apologies, I can't parse this and I earnestly tried: 5 minutes of my own thinking, then 3 llms, then a 10 minute timer of my own thinking over the whole thing.
My guess is you're trying to communicate "tinygrad doesn't need gpu drivers" which maybe is transmutated into "tinygrad replaces CUDA" and you think "CUDA means other GPUs can't be used for LLMs, thus nvidia has a strangehold"
I know George has pushed this idea for years now, but, you have to look no further than AMD/Google making massive deals to understand how it works on the ground.
I hope he doesn't victimize you further with his rants. It's cruel of him to use people to assuage this own ego and make them look silly in public.
Re: has someone else does this? https://github.com/albertstarfield/apple-slick-rtx (May 2024, 19 months ago. didn't bother looking further than 4th google result for "apple silicon external gpu")
Re: Nvidia to buy assets from Groq for $20B cash
#204Hopefully prices stay the same, I run my small apps on groq. I get good enough summarization and simple agents from gpt120b which is on 15 cents for a million input tks.
Can you list any internet facing apps you have that use Groq? Looking into them myself because of the speed
Re: Nvidia to buy assets from Groq for $20B cash
#205Earlier quoted context omitted.
They don't need to catch up. They just need to be good enough and fast as fuck. Vast majority of useful tasks of LLMs has nothing to do with how smart they are. GPT-5 models have been the most useless models out of any model released this year despite being SOTA, and it because it slow as fuck.
For coding I don’t use any of the previous gen models anymore. Ideally I would have both fast and SOTA; if I would have to pick one I’d go with SOTA. There a report by OpenRouter on what folks tend to pay for it; it generally is SOTA in the coding domain. Folks are still paying a premium for them today. There is a question if there is a bar where coding models are “good enough”; for myself I always want smarter / SOT…
FWIW coding is one of the largest usages for LLM's where SOTA quality matters.
I think the bar for when coding models are "good enough" will be a tradeoff between performance and price. I could be using Cerebras Code and saving $50 a month, but Opus 4.5 is fast enough and I value the piece-of-mind I have knowing it's quality is higher than Cerebras' open source models to spend the extra money. It might take a while for this gap to close, and what is considered "good enough" will be different for every developer, but certainly this gap cannot exist forever.
Re: Nvidia to buy assets from Groq for $20B cash
#206I remember when Google acquired YouTube in 2006 for $1.65 billion in stock. Media said it was crazy back then, well I think this sounds a lot crazier but hindsight is 20/20.
And now we’re told that bet was such a sure thing that regulators should have blocked it!
Re: Nvidia to buy assets from Groq for $20B cash
#207Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…
They acquired in order to have an ASICs competitor to Google TPU.
Re: Nvidia to buy assets from Groq for $20B cash
#208Earlier quoted context omitted.
They don't need to catch up. They just need to be good enough and fast as fuck. Vast majority of useful tasks of LLMs has nothing to do with how smart they are. GPT-5 models have been the most useless models out of any model released this year despite being SOTA, and it because it slow as fuck.
Confused. Is ‘fuck’ fast or slow? Or both at the same time? Is there a sort of quantum superposition of fuck?
[deleted]
Re: Nvidia to buy assets from Groq for $20B cash
#209From the comment below: > Groq raised $750 million at a valuation of about $6.9 billion three months ago. Investors in the round included Blackrock and Neuberger Berman, as well as Samsung, Cisco, Altimeter and 1789 Capital, where Donald Trump Jr. is a partner. Makes it very hard not to think of this as a way to give money to the current administration. I know, this sounds conspiracy theory grade, but 20b is too much…
It's not a conspiracy theory. It's basically a bribe to Chamath, Don Jr. and Sacks.
Re: Nvidia to buy assets from Groq for $20B cash
#210Not good. This shouldn't be allowed. What would be better is if groq and cerebras combined, and maybe other companies invested in them to help them scale. Why would the major cloud providers not lobby against this? Usually antitrust is for consumers, but here I think companies like Microsoft and AWS would be the biggest beneficiaries of having more AI chip competition.
It's a non-exclusive deal. No reason for antitrust action whatsoever.
That’s a loophole. Regulation hasn’t caught up to the innovation of non-exclusive licensing deal. Hopefully we’ll get some competence back in government soon-ish and can rectify the mistake