Earlier quoted context omitted.
It seems like rocm is already fully ready for transformer inference, so you are just referring to training?
ROCm is buggy and largely undocumented. That’s why we don’t use it.
It is actively improving every day.
Open source AI is the path forward
631–640 of 936 posts
Re: Open source AI is the path forward
#632Who knew FB would hold OpenAI's original ideals, and OpenAI now holds early FB ideals/integrity.
Mark Zuckerberg was attacked by the media when it suited their tech billionaire villain narrative. Now there's Elon Musk so Zuckerberg gets to be on the good side again
Re: Open source AI is the path forward
#633Earlier quoted context omitted.
I wouldn’t even say hi alone my name to someone wearing a Meta headset out in public. And if facial recognition becomes that common for wearers, most of the population is going to adorn something to prevent that. And if it’s at work, I’m not working there and I have to think many would agree. Coworkers don’t and wouldn’t tolerate coworkers taking videos or pictures of them.
This is not how the overwhelming majority of the world works though. > if facial recognition becomes that common for wearers, most of the population is going to adorn something to prevent that "Most of the population" is going to be "the wearers". > Coworkers don’t and wouldn’t tolerate coworkers taking videos or pictures of them. Here is a fun experience you can try: just hit "record" on every single Teams or Meet m…
You are probably right, but that is truly a cyberpunk dystopian situation. A few megacorps will catalog every human interaction and there will be no way to opt out.
Re: Open source AI is the path forward
#634I don't think weights is the source. Data is the source. But still better than nothing.
Re: Open source AI is the path forward
#635Earlier quoted context omitted.
In Australia at least, anyone who is enrolled at or works at a university can use the taxpayer-subsidised "Gadi" HPC which is part of the National Computing Infrastructure ( https://nci.org.au/our-systems/hpc-systems ). I also do mean anyone, I have an undergraduate student using it right now (for free ) to fine-tune several LLMs. It also says commercial orgs can get access via negotiation, I expect a random member o…
Australia's peak HPC has a total of: "2 nodes of the NVIDIA DGX A100 system, with 8 A100 GPUs per node". It's pretty meagre pickings!
Well, one, it has:
> 160 nodes each containing four Nvidia V100 GPUs
and two, well, it's a CPU-based supercomputer.
Re: Open source AI is the path forward
#636“The Heavy Press Program was a Cold War-era program of the United States Air Force to build the largest forging presses and extrusion presses in the world.” This ”program began in 1944 and concluded in 1957 after construction of four forging presses and six extruders, at an overall cost of $279 million. Six of them are still in operation today, manufacturing structural parts for military and commercial aircraft” [1].…
How about using some of that money to develop CUDA alternatives so everyone is not paying the Nvidia tax?
Or just develop the next wave of chips designed for specifically transformer-based architectures (and ternary computing), and bypass the needs for GPUs and CUDA altogether
Re: Open source AI is the path forward
#637Earlier quoted context omitted.
They don't "[allow] developers to modify its code however they want", which is a critical component of "open source", and one that Meta is clearly trying to leverage in branding around its products. I would like them to start calling these "public weight models", because what they're doing now is muddying the waters so much that "open source" now just means providing an enormous binary and an open source harness to r…
Feels a bit like you are splitting hair for the pleasure of semantic arguments to be honest. Yes there are no source in ML, so if we want to be pedantic it shouldn't be called open source. But what really matters in the open source movement is that we are able to take a program built by someone and modify it to do whatever we want with it, without having to ask someone for permission or get scrutinized or have to pay…
> The same applies here, you can take those models and modify them to do whatever you want without having to ask for permission, get scrutinized or pay someone.
The "Additional Commercial Terms" section of the license includes restrictions that would not meet the OSI definition of open source. You must ask for permission if you have too many users.
Re: Open source AI is the path forward
#638I've summarized this entire thread in 4 lines (didn't even use AI for it!) Step 1. Chick-Fil-A releases a grass-fed beef burger to spite other fast-food joints, calls it "the vegan burger" Step 2. A couple of outraged vegans show up in the comments, pointing out that beef, even grass-fed beef, isn't vegan Step 3. Fast food enthusiasts push back: it's unreasonable to want companies to abide by this restrictive definit…
More like vegetarians show up claiming to be vegans, then vegans show up and explain why eating animal products is still wrong. That's the difference between open source and free software.
Yeah the moral step up from the status quo is still laudable. Open weights are still much improved over the closed creepy spy agency clusterfucks that OpenAI/Microsoft/Google/Apple are bringing to the table.
Re: Open source AI is the path forward
#639“The Heavy Press Program was a Cold War-era program of the United States Air Force to build the largest forging presses and extrusion presses in the world.” This ”program began in 1944 and concluded in 1957 after construction of four forging presses and six extruders, at an overall cost of $279 million. Six of them are still in operation today, manufacturing structural parts for military and commercial aircraft” [1].…
I just watched this 1950s DoD video on the heavy press program and highly recommend it: https://www.youtube.com/watch?v=iZ50nZU3oG8
Re: Open source AI is the path forward
#640You first, Zuck.