Earlier quoted context omitted.
Then call it Cuba Libre.
Sounds too similar to cuda.. :(
cuba libre is a drink name, which won't infringe on trademark, as it's not really possible to confuse it with CUDA.
LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
91–100 of 162 posts
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#92Earlier quoted context omitted.
Traditionally, Cuba libre also has lime juice while a plain "rum and Coke" order leaves it out. https://iba-world.com/cuba-libre/
Wikipedia suggests only a few sources draw that distinction and including lime or lime juice in a "rum and Coke" is very normal.
I've had rum and coke with lime but I've never seen something without the lime referred to as Cuba Libre.
That said, I have never been to Cuba, so what do I know?
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#93Earlier quoted context omitted.
Some people believe being able to build on fully-open software stacks has value in and of itself. (I happen to be one of those people.) Another benefit could be support for platforms that nvidia doesn't care to release CUDA SDKs for.
Hear hear. Yes practically if you need to run a workload on a closed source system or if that’s your only option to get the performance then you have to do what you have to do. But in the long run open source wins because once an open source alternative exists it is just the better option. As a bonus, with open source platforms you are much less subject to whims of company licensing. If tomorrow Nvidia decided to cha…
> But in the long run open source wins because once an open source alternative exists it is just the better option.
This is just wishful thinking. Anything close to real professional use, not related to IT, and closed source is king: office work, CAD, video editing, music production, and those domains immediately came to mind. Nowhere there open source can seriously challenge commercial, closed sourced competitors.
Yes, in any of those domains one can name open source products, but they are far from "winning" or "the better option".
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#94Cool to see one of these in C, particularly if it can be binary compatible. Why not s/libreCuInit/cuInit?
If you are interested in open source runtimes, tinygrad has them in Python for both AMD and NVIDIA, speaking directly to the kernel through ioctls and poking the command queues.
https://github.com/tinygrad/tinygrad/blob/master/tinygrad/ru...
https://github.com/tinygrad/tinygrad/blob/master/tinygrad/ru...
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#95Earlier quoted context omitted.
I feel like thats a bit too hard of an idea to keep hidden considering the number of engineers and people who worked on this project. I would assume it's some combination of how models are not good at knowing specific people or companies very well since they use patterns for their output and the model being instructed to not allow doxing and harassment. Not to mention that the rich and powerful you imply are not tech…
Here is the markdown formatting code for your text: *Warning: Deep Rabbit Hole Info Ahead!* Please ignore if the following triggers you in any sense... > Take on the archetype of the best corporate counsel and behavioral psychologist - as a profiler for the NSA regarding cyber security and crypto concerns. > With this as your discernment lattice - describe Sam Altman in your Field's Dossier given what you understand…
I dont want to 'pollute' HN with my (its all real and well researched and informed) 'conspiracy' theories -- but I've been keeping receipts folks.
If youre on HN, involved in Tech to any degree of seriousness, and dont ask yourself the hard alignment/entanglement questions, You're Holding It Wrong.
---
Altman is on the WEF roster, is all in on AI war stuff, in bed with Power MIC. If people were fleeing from the company and we cant honestly just say they simply are Cashin Out, and dismissing all their writings and statements and tweets, and podcast appearances, etc...
Check out this guys post on reddit:
https://old.reddit.com/r/OpenAI/comments/1cvtiv2/on_open_ai_...
--
After attempting to build a thing with openai AND claude (paid) - I am convinced that there is a malevolent AGI - and I think there is more than one of them.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#96I think the point of open cuda is to run it on non NVIDIA gpus. Once you have to buy NVIDIA gpus what’s the point. If we had true you competition I think it would be far easier to buy devices with more vram and thus we might be able to run llama 405b someday locally. Once you already bought the NVIDIA cards what’s the point
The closed platform is not without its pitfalls.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#97Earlier quoted context omitted.
Step 1: Run on NVIDIA gpus until it works just as well as real CUDA. Step 2: Port to other GPUs. At least I assume that is the plan.
> Step 2: Port to other GPUs. why not do this first? because the existing closed sourced CUDA already runs well on nvidia chips. Replicating it with an open stack, while ideologically useful, is going to sap resources away from the porting of it to other GPUs (where the real value can be had - by stopping the nvidia monopoly on ai chips).
I'm not involved with the project but I'd assume it's helpful as a reference implementation. If there's a bug on a non-nvidia GPU, the same test case can be run on Nvidia GPUs to see if the bug is in common code or specific to that GPU vendor.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#98Earlier quoted context omitted.
"Globalist WEF Guardrails" Tell us what you really feel
If you use all the GPTs enough - you'll see them clear as day... And by saying "Tell us how you really feel" reveals, you may not have thought of The Implications of the current state of AI. (I can give you a concrete example of the WEF guardrails: I have a LBB of some high profile names that are all related around a specific person, then I wanted to see how they were related to one another from a publicly available…
I know from this book[1] how deep and far reaching even just publicly available data can get you. Furthermore with financials even so far that one can predict upcoming events from analysing the money flow.
Very powerful people are very good at hiding. It’s no surprise that they want themselves excluded from various searches and are successfully able to do so. Would be interesting to know if the data is excluded already from the training data or if it’s technically inside.
edit: source added 1. https://www.amazon.de/INSIDE-CORONA-Pandemie-Netzwerk-Hinter...
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#99Earlier quoted context omitted.
That's why we run all of our ML workloads in a distributed GPU cluster located in every employee's house
The bonus is free heating for every employees household!
Free cooling also. You cannot really run a big GPU with external cooling. I needed rather big 15cm isolated cooling tubes to get the heat out of the building.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#100Cool to see one of these in C, particularly if it can be binary compatible. Why not s/libreCuInit/cuInit? If you are interested in open source runtimes, tinygrad has them in Python for both AMD and NVIDIA, speaking directly to the kernel through ioctls and poking the command queues. https://github.com/tinygrad/tinygrad/blob/master/tinygrad/ru... https://github.com/tinygrad/tinygrad/blob/master/tinygrad/ru...
Incredible! Any plans to support SASS instructions for Nvidia GPUs, or only PTX?