Live data from Hacker News

LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

github.com

41–50 of 162 posts

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#41

Earlier quoted context omitted.

Can you explain this joke? I don't get it.

There is a drink called "Cuba Libre" (White Rum + Coke).

Traditionally, Cuba libre also has lime juice while a plain "rum and Coke" order leaves it out. https://iba-world.com/cuba-libre/

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#42

I have limited experience with CUDA but will this help solve the CUDA/CUDNN dependency version nightmare that comes with running various ML libraries like tensorflow or onnx?

My experience, over 10 years building models with libraries using CUDA under the hood, this problem has nearly gone away in the past few years. Setting up CUDA on new machines and even getting multi GPU/nodes configuration working with NCCL and pytorch DDP, for example, is pretty slick. Have you experienced this recently?

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#43
post #20

Earlier quoted context omitted.

something like kudo ?

https://news.ycombinator.com/item?id=41195332

kudo seems to be in keeping with your comment. I am not sure what you are getting at.

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#44

Earlier quoted context omitted.

> licensing checks and such at the firmware level. Could you imaging an age where the NVIDIA firmware does LLM/AI/GPU license checking before it does operations on your vectors? (Hello Oracle on SUN e650, My old Friend) ((Worse would be a DRM check against deep-faking or other Globalist WEF Guardrails)) ((oracle had(has) an age olde function where if you bought a license for a single proc and threw it inot a dual pro…

"Globalist WEF Guardrails" Tell us what you really feel

If you use all the GPTs enough - you'll see them clear as day...

And by saying "Tell us how you really feel" reveals, you may not have thought of The Implications of the current state of AI.

(I can give you a concrete example of the WEF guardrails:

I have a LBB of some high profile names that are all related around a specific person, then I wanted to see how they were related to one another from a publicly available data-set "that which is searchable on the open internet"

And several GPTs stated "I do not feel comfortable revelaing the connections between these people without their consent"

I was trying to get a list of public record data for whom the owners and affiliates of shared companies were...

If you go down political/financial/professional rabbit holes using various data-mining techniques with augmenting searches and connections via public GPTs (paid even) -- You see the guardrails real fast (hint - they invlove power, money, and particular names and organizations that you hit guardrails against)

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#45
post #36

Earlier quoted context omitted.

Cannot Vulcan compute be used to execute code on GPU without relying on proprietary libs? Why not?

You still require a Vulkan driver to do anything with it. Until last year, Nvidia hardware required a proprietary Vulkan driver (prior to Nvvk), and anything pre-Pascal still requires that.

Yes but you can use any GPU with Vulkan, not only NVIDIA.

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#46

Earlier quoted context omitted.

Naming anything is hard and I don’t have better suggestions but when you’re doing something that’s already poking at something a big corp holds dearly hitting on trademark while you’re at it makes it really easy for them.

You can't have the CUDA substring in the name or anything a court would deem potentially confusing. Even if "CUDA" wasn't registered, using a similar name could be seen as an attempt to pass off the product as affiliated with or endorsed by NVIDIA. The similarity in names could be construed as an attempt to unfairly benefit from NVIDIA's reputation and market position. If the open-source project implements techniques…

I wonder to what ends trademark protections reach.

Firsthand example, both SpaceX and Subaru have services called Starlink. Subaru Starlink was first, but SpaceX Starlink is more famous. I've been confused and I've seen others be confused by the two.

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#47
post #46

Earlier quoted context omitted.

You can't have the CUDA substring in the name or anything a court would deem potentially confusing. Even if "CUDA" wasn't registered, using a similar name could be seen as an attempt to pass off the product as affiliated with or endorsed by NVIDIA. The similarity in names could be construed as an attempt to unfairly benefit from NVIDIA's reputation and market position. If the open-source project implements techniques…

I wonder to what ends trademark protections reach. Firsthand example, both SpaceX and Subaru have services called Starlink. Subaru Starlink was first, but SpaceX Starlink is more famous. I've been confused and I've seen others be confused by the two.

Those are two totally different businesses and industries, so their trademarks dont clash

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#48

Such a missed opportunity to call it CUDA Libre...

Unfortunately both would seem to be infringing on nvidia's trademark... We just can't have nice things..

A trademark isn't a total prohibition on using someone else's name.

You can still use their name where there is no likelihood of consumer confusion.

Obviously many companies choose not to to avoid a lawsuit over the issue - but it's unlikely NVidia would win over this method name.

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#49

Such a missed opportunity to call it CUDA Libre...

Worse, some functions are prefixed libreCu which in Portuguese means "free ass hole".

I feel like every name or phrase will inevitably be offensive in some language.

Re: LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime

#50

I think the point of open cuda is to run it on non NVIDIA gpus. Once you have to buy NVIDIA gpus what’s the point. If we had true you competition I think it would be far easier to buy devices with more vram and thus we might be able to run llama 405b someday locally. Once you already bought the NVIDIA cards what’s the point

The NVidia software stack has the "no use in datacenters" clause. Is this a workaround for that?
Post reply on HN