51–60 of 96 posts
I can’t wait until I can run this shit locally without spending $10,000 on clusters of GPU’s. The models will be trained using some distributed P2P-like technology that “The Man” can’t stop. Imagine running a model trained by the degenerates on 4chan. Models that encourage you to cheat on your homework, happily crank out photos of world leaders banging farm animals, and gleefully generate the worst gore imaginable. A…
Earlier quoted context omitted.
To be totally honest, the only thing I can distill from this is that perhaps you should have picked an education in CS instead of EE. I mean this is like saying that a class for building compilers sucked. Still, companies make compilers, and they aren't all >$1B companies. In fact, hobbyists make compilers.
I did study CS as well. That you are comparing designing and writing a compiler with designing and manufacturing a neural processor is only testimony to the futility of my attempt to impress on everyone the difference. So I'll take my leave. You have a good day sir or ma'am.
[flagged]
You're right. It's time to ban the evil numbers from being matrix multiplied. Contact your local representative about CPU control.
The point of nuclear weapons bans, for instance, isn't to control "evil atoms from touching", it's to prevent the higher-order effects that those atoms touching can cause.
If Nvidia were interested in "open" AI, they would spend time to collaborate with AMD, etc. to build an (updated) open alternative to CUDA. That's probably the most closed part of the whole stack right now.
Not sure what's with the HN tone on this announcement. AI2 are really some of the best people around for creating truly open artifacts for the whole ecosystem. Their work on OLMo and Molmo is some of the most transparent and educational material you can find on model building. This is just great news for everyone.
Maybe because many of us are not from the US. The stated goal is US dominance of the AI field, and sorry if the rest of us don't see that as a good thing nor particularly open.
Any country tries to dominate any field if they can do it, it's just human nature. Why is that a bad thing?
That constant competition for superiority between nations is how humanity has evolved from hunter gatherer to having tractors, microwave ovens, airplanes, internet and penicillin.
Earlier quoted context omitted.
Maybe because many of us are not from the US. The stated goal is US dominance of the AI field, and sorry if the rest of us don't see that as a good thing nor particularly open.
>The stated goal is US dominance of the AI field Any country tries to dominate any field if they can do it, it's just human nature. Why is that a bad thing? That constant competition for superiority between nations is how humanity has evolved from hunter gatherer to having tractors, microwave ovens, airplanes, internet and penicillin.
[Insert xkcd new standard image here]
Earlier quoted context omitted.
But AI depends on a small number of tensor operators, primitives which can be relatively easily implemented by competitors, so compute is very close to being a commodity when it comes to AI. A company like Cerebras (founded in 2015) proves that this is true. The moat is not in computer architecture. I'd say the real moat is in semiconductor fabrication.
Have you ever tried to run a model from huggingface on an AMD GPU? Semiconductor fabrication is a high risk business. Nvidia invested heavily in CUDA and out-competed AMD (and Intel). They are working hard to keep their edge in developer mindshare, while chasing hardware profits at the same time.
Yes. I'd never touched any of that stuff and then one day decided to give it a shot. Some how-to told me how to run something on Linux which had a choice of a few different LLMs. I picked one of the small ones (under 10B) and had it running on my AMD APU inside of 15 minutes. The weights were IIRC downloaded from huggingface. The wrapper was not. Anyway, what's the problem?
BTW that convinced me that small LLMs are basically worthless. IMA need to go bigger next time. BTW my "old" 5700G has 64GB of RAM, next build I'll go at least double that.
Not sure what's with the HN tone on this announcement. AI2 are really some of the best people around for creating truly open artifacts for the whole ecosystem. Their work on OLMo and Molmo is some of the most transparent and educational material you can find on model building. This is just great news for everyone.
Maybe because many of us are not from the US. The stated goal is US dominance of the AI field, and sorry if the rest of us don't see that as a good thing nor particularly open.
The stated "US dominance" goal just pays lip service to what appeals to the funders, kind of like how supercomputing projects traditionally claim that they contribute to curing disease or producing clean energy. (Even if it's something far removed from concrete applications, like high fidelity numerical simulations of aqueous solutions.)
Earlier quoted context omitted.
>The stated goal is US dominance of the AI field Any country tries to dominate any field if they can do it, it's just human nature. Why is that a bad thing? That constant competition for superiority between nations is how humanity has evolved from hunter gatherer to having tractors, microwave ovens, airplanes, internet and penicillin.
As an American, I obviously can get behind it, but I can easily see how a declared goal of superiority of others would rub those others the wrong way (and possibly prevent their contribution) [Insert xkcd new standard image here]
So what? Does that change anything in how things work in reality? Everyone knows it, so why pussyfoot around it?.
Why are people nowadays so sensitive about saying the truth of how things work? Have people been coddled that much that they've can't handle reality? A good life lesson is that the world does not revolve around your feelings.