291–300 of 424 posts
The near exclusive global provider of AI chips taking key employees from and “licensing” the technology of the only serious competitor while quite specifically describing it as “not acquiring Groq as a company” seems quite obviously anti-competitive, and quite clearly an attempt to frame it as not.
Earlier quoted context omitted.
fast but furiously expensive
Honestly cerebras is good. I can recommend it. I talked to their team once on discord as a literal free user so that was something really nice personally They were also the faster one compared to groq but they were always a little slow on adding new models compared to groq but not sure what changed right now. Definitely recommend cerebras tho now that groq's been eaten up from inside basically
Is there less regulatory oversight when purchasing assets instead of the company, or do Nvidia really believe the FTC/DOJ are that blind? (Or doesn’t it matter in the current climate?) The near exclusive global provider of AI chips taking key employees from and “licensing” the technology of the only serious competitor while quite specifically describing it as “not acquiring Groq as a company” seems quite obviously an…
Earlier quoted context omitted.
I am by no means an expert, but I think it is a process that allows training LLMs from other LLMs without needing as much compute or nearly as much data as training from scratch. I think this was the thing deepseek pioneered. Don’t quote me on any of that though.
No, distillation is far older than deepseek. Deepseek was impressive because of algorithmic improvements that allowed them to train a model of that size with vastly less compute than anyone expected, even using distillation. I also haven’t seen any hard data on how much they do use distillation like techniques. They for sure used a bunch of synthetic generated data to get better at reasoning, something that is now co…
The world needs much stronger anti trust laws.
Following the age old playbook of monopolies. https://www.arte.tv/en/videos/103517-001-A/capitalism-in-ame... (Use a vpn if outside EUR) A free market is a regulated market. Otherwise you will end up with monopolies and a dead market.
…except they are a rather small hardware startup, there is a dozen other rather small hardware startups they did not buy, and there will be more such startups funded just on the news that NVIDIA bought one at a big premium.
Hardware startups are not easy. If the effect is that the most likely way to make money is to be bought by the behemoth, then this distorts the market even more and suffocates innovation.
Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…
The open source economy relies on the wisdom of crowds. But that implies and equal access to experimentation platforms. The democratization of PC and consumer hardware brings the previous open source era that we all love, I am afraid the tech mongols had identified the chokehold of LLM ecosystem and found ways to successfully monopolized it
Are they buying them to try and slow down open source models and protect the massive amounts of money they make from OpenAI, Anthropic, Meta ect? It quite obvious that open source models are catching up to closed source models very fast they about 3-4 months behind right now, and yeah they are trained on Nvidia chips, but as the open source models become more usable, and closer to closed source models they will eat i…
Shy of an algo breakthrough, open source isn't going to catch up with SOTA, their main trick for model improvement is distilling the SOTA models. That's why they they have perpetually been "right behind".