Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hacked Nvidia 4090 GPU driver to enable P2P

github.com

Post reply on HN
Print view View original

71–80 of 365 posts

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#71

Post by jsheard »

steeve wrote: post #61
formerly_proven wrote: post #15

Earlier quoted context omitted.

RTX 40 doesn’t have NVLink on the PCBs, though the silicon has to have it, since some sibling cards support it. I’d expect it to be fused off.

Some do: https://wccftech.com/gigabyte-geforce-rtx-4090-pcb-shows-lef...

I'm pretty sure that's just a remnant of a 3090 PCB design that was adapted into a 4090 PCB design by the vendor. None of the cards based on the AD102 chip have functional NVLink, not even the expensive A6000 Ada workstation card or the datacenter L40 accelerator, so there's no reason to think NVLink is present on the silicon anymore below the flagship GA100/GH100 chips.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#72

Post by the8472 »

dvdkon wrote: post #64
the8472 wrote: post #49

Earlier quoted context omitted.

Freely flying through the sky on wings was scifi before the wright brothers. Something sounding like scifi is not a sound argument that it won't happen. And unlike lizard people we do have exponential curves to point at. Something stronger than a vibes-based argument would be good.

I consider the burden of proof to fall on those proclaiming AGI to be an existential threat, and so far I have not seen any convincing arguments. Maybe at some point in the future we will have many anthropomorphic robots and an AGI could hack them all and orchestrate a robot uprising, but at that point the robots would be the actual problem. Similarly, if an AGI could blow up nuclear power plants, so could well-funde…

You say you have not seen any arguments that convince you. Is that just not having seen many arguments or having seen a lot of arguments where each chain contained some fatal flaw? Or something else?

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#73

Post by z33k »

mschuster91 wrote: post #59
HeatrayEnjoyer wrote: post #55

Earlier quoted context omitted.

Wires, flash, and resistors can be replaced

Not at the scale we're talking about here. These structures are very thin, far thinner than bond wires which is about the largest structure size you can handle without a very, very specialized lab. And you'd need to unsolder the chip, de-cap it, hope the fuse wire you're trying to override is at the top layer, and that you can re-cap the chip afterwards and successfully solder it back on again. This may be workable f…

You’re absolutely right. In fact, some billion dollar megacorps use fuses as a part of hardware DRM for this reason.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#74

Post by postalrat »

sambull wrote: post #60
ivanjermakov wrote: post #54

I was always fascinated by George Hotz's hacking abilities. Inspired me a lot for my personal projects.

He's got that focus like a military pilot on a long flight.

Any time I open guys steam half of it is some sort of politics

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#75

Post by aftbit »

Aerroon wrote: post #42
logicchains wrote: post #11

Earlier quoted context omitted.

Looks like we're only a few years away from a bona fide cyberpunk dystopia, in which only governments and megacorps are allowed to use AI, and hackers working on their own hardware face regular raids from the authorities.

I find it baffling that ideas like "govern compute" are even taken seriously. What the hell has happened to the ideals of freedom?! Does the government own us or something?

The government sure thinks they own us, because they claim the right to charge us taxes on our private enterprises, draft us to fight in wars that they start, and put us in jail for walking on the wrong part of the street.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#76

Post by userbinator »

I wish more hardware companies would publish more documentation and let the community figure out the rest, sort of like what happened to the original IBM VGA (look up "Mode X" and the other non-BIOS modes the hardware is actually capable of - even 800x600x16!) Sadly it seems the majority of them would rather tightly control every aspect of their products' usage since they can then milk the userbase for more $$$, but IMHO the most productive era of the PC was also when it was the most open.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#77

Post by andy99 »

aftbit wrote: post #75
Aerroon wrote: post #42

Earlier quoted context omitted.

I find it baffling that ideas like "govern compute" are even taken seriously. What the hell has happened to the ideals of freedom?! Does the government own us or something?

The government sure thinks they own us, because they claim the right to charge us taxes on our private enterprises, draft us to fight in wars that they start, and put us in jail for walking on the wrong part of the street.

Taxes, conscription and even pedestrian traffic rules make sense at least to some degree. Restricting "AI" because of what some uninformed politician imagines it to be is in a whole different league.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#78

Post by Jerrrry »

erikbye wrote: post #68
snakeyjake wrote: post #62

Earlier quoted context omitted.

I love the HN dystopian fantasies. They're simply adorable. They're like how jesusfreaks are constantly predicting the end times, with less mass suicide.

We already have export restrictions on cryptography. Of course there will be AI regulations.

>Of course there will be AI regulations.

Are. As I and others have predicted, the executive order was passed defining a hard limit on the processing/compute power allowed without first 'checkin in' with the Letter boys.

https://www.whitehouse.gov/briefing-room/presidential-action...

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#80

Post by andersa »

Incredible! I'd been wondering if this was possible. Now the only thing standing in the way of my 4x4090 rig for local LLMs is finding time to build it. With tensor parallelism, this will be both massively cheaper and faster for inference than a H100 SXM.

I still don't understand why they went with 6 GPUs for the tinybox. Many things will only function well with 4 or 8 GPUs. It seems like the worst of both worlds now (use 4 GPUs but pay for 6 GPUs, don't have 8 GPUs).

Post reply on HN