111–120 of 142 posts
Earlier quoted context omitted.
I can't run my business without electricity. Yet we don't fear of its access being revoked. Sam makes the comparison of intelligence to electricity a lot. So we are on the path to these systems becoming utilities.
Electricity is heavily regulated. Is there any evidence that LLMs will be the same?
Nemotron is:
1. Not just open weight, but open data (to the limits of what is feasible), open recipe, open technique
2. In the future built by a coalition of organizations coming together to build great openly developed AI.
Nemotron 3 Super is our most successful model yet. [1]
Ultra is coming soon. And then Nemotron 4.
We can afford to do this because when AI grows, NVIDIA's opportunity also grows.
[1] https://kaitchup.substack.com/p/the-fastest-and-cheapest-120...
Earlier quoted context omitted.
Electricity is heavily regulated. Is there any evidence that LLMs will be the same?
Was electricity regulated in the first decade of its existence?
but the basic premise (shared among a lot of ai-doomers and ai-shamers), is that the bigs have somehow raped society (by training on everything available). this needs to be challenged: it implies quite a strong model of IP ownership, which is not what appears in law, or in founding documents (which are quite different from current law).
mythos has not been demonstrated doing anything dramatically different than other models. so as other comments say: very premature. but the basic premise (shared among a lot of ai-doomers and ai-shamers), is that the bigs have somehow raped society (by training on everything available). this needs to be challenged: it implies quite a strong model of IP ownership, which is not what appears in law, or in founding docum…
Earlier quoted context omitted.
>> We saw yesterday that expert orchestration around small, publicly available models can produce results on the level of the unreleased model. This is false. Yesterday's article did not actually show this, and there are many comments in the discussion from actual security people (like tptacek) pointing that out.
From what I can tell, this was not clearly settled. Your example author, actually corrected themselves saying LLMs “possibly” could perform successfully: https://news.ycombinator.com/item?id=47732696
>> No, they didn't. They distinguished it, when presented with it. Wildly different problem.
Some of these concerns are precisely why we are building Nemotron at NVIDIA. We want to make it possible for people to invent and deploy AI in all sorts of new and unforeseen ways. Nemotron is: 1. Not just open weight, but open data (to the limits of what is feasible), open recipe, open technique 2. In the future built by a coalition of organizations coming together to build great openly developed AI. Nemotron 3 Supe…
This feels really premature. The announcement was a week ago. The “this model is too powerful for the general public” sounds like marketing to me. Give it a few months and it will be just another model they are selling, but the NEWER model is just too powerful for the public.
Sure, I could get more performance out of proprietary models on much more expensive hardware, but there's diminishing returns, and consumer hardware and open models keep getting better.
I don't think the big investments into hosting models will pay off, especially as the base-line capabilities of integrate GPUs become enough to run a good model at home.