Earlier quoted context omitted.
Worse, some functions are prefixed libreCu which in Portuguese means "free ass hole".
Maybe better use 'lcu'.
[deleted]
LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
31–40 of 162 posts
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#32Why is there a need to do this?
1. To learn, how.
2. Nvidia needs to be challenged with OSS. They are far too big to be left alone.
3. To have some fun.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#33Such a missed opportunity to call it CUDA Libre...
Can you explain this joke? I don't get it.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#34Since ZLUDA was taken down (by request from AMD of all parties), it would be better to have some ZLUDA replacement as a general purpose way of breaking CUDA lock-in. I.e. something not tied to Nvidia hardware.
That's a problem on a different level of the CUDA stack. Having a compiler that takes a special C++ or python dialect and compiles it to GPU suitable llvm-ir and then to a GPU binary is one thing (and there's progress on that side: triton, numba, soonish mojo), being able to launch that binary without going through the nvidia driver is another problem.
Cannot Vulcan compute be used to execute code on GPU without relying on proprietary libs? Why not?
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#35Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#36Earlier quoted context omitted.
That's a problem on a different level of the CUDA stack. Having a compiler that takes a special C++ or python dialect and compiles it to GPU suitable llvm-ir and then to a GPU binary is one thing (and there's progress on that side: triton, numba, soonish mojo), being able to launch that binary without going through the nvidia driver is another problem.
Cannot Vulcan compute be used to execute code on GPU without relying on proprietary libs? Why not?
You still require a Vulkan driver to do anything with it. Until last year, Nvidia hardware required a proprietary Vulkan driver (prior to Nvvk), and anything pre-Pascal still requires that.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#37Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#38The authors better start thinking about the trademark infringement notice coming their way
Name it “Barra”.
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#39I think the point of open cuda is to run it on non NVIDIA gpus. Once you have to buy NVIDIA gpus what’s the point. If we had true you competition I think it would be far easier to buy devices with more vram and thus we might be able to run llama 405b someday locally.
Once you already bought the NVIDIA cards what’s the point
Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime
#40Earlier quoted context omitted.
Like anything open source it allows you to know and see exactly what your machine is doing. I don’t want to speculate too much but I remember there being discussions around whether or not nvidia could embed licensing checks and such at the firmware level.
> licensing checks and such at the firmware level. Could you imaging an age where the NVIDIA firmware does LLM/AI/GPU license checking before it does operations on your vectors? (Hello Oracle on SUN e650, My old Friend) ((Worse would be a DRM check against deep-faking or other Globalist WEF Guardrails)) ((oracle had(has) an age olde function where if you bought a license for a single proc and threw it inot a dual pro…
"Globalist WEF Guardrails"
Tell us what you really feel