Live data from Hacker News

Hacked Nvidia 4090 GPU driver to enable P2P

github.com

21–30 of 365 posts

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#21
post #18

Does this appear to be intentionally left out by NVidia or an oversight?

Seems more like an oversight, since you have to stitch together a bunch of suboptimal non-default options?

It does seem like an oversight, but there's nothing "suboptimal non-default options" about iteven if the implementation posted here seems somewhat hastily hacked together.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#22
post #16

Earlier quoted context omitted.

Mere raids from the authorities? I thought EliY was out there proposing airstrikes.

In the sense that any other government regulation is also ultimately backed by the state's monopoly on legal use of force when other measures have failed. And contrary to what some people are implying he also proposes that everyone is subject to the same limitations, big players just like individuals. Because the big players haven't shown much of a sign of doing enough.

> In the sense that any other government regulation is also ultimately backed by the state's monopoly on legal use of force when other measures have failed.

Good point. He was only (“only”) really calling for international cooperation and literal air strikes against big datacenters that weren’t cooperating. This would presumably be more of a no-knock raid, breaching your door with a battering ram and throwing tear gas at the wee hours of the morning ;) or maybe a small extraterritorial drone through your window

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#23
post #6

Skimming the readme this is p2p over PCIe and not NVLink in case anyone was wondering.

RTX 40 doesn’t have NVLink on the PCBs, though the silicon has to have it, since some sibling cards support it. I’d expect it to be fused off.

How to unfuse it?

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#25
post #10

If we end up with a compute governance model of AI control [1], this sort of thing could get your door kicked in by the CEA (Compute Enforcement Agency). [1] https://podcasts.apple.com/us/podcast/ai-safety-fundamentals...

Looks like we're only a few years away from a bona fide cyberpunk dystopia, in which only governments and megacorps are allowed to use AI, and hackers working on their own hardware face regular raids from the authorities.

That is not different from any other very powerful dual-use technology. This is hardly a new concept.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#26
post #10

If we end up with a compute governance model of AI control [1], this sort of thing could get your door kicked in by the CEA (Compute Enforcement Agency). [1] https://podcasts.apple.com/us/podcast/ai-safety-fundamentals...

Looks like we're only a few years away from a bona fide cyberpunk dystopia, in which only governments and megacorps are allowed to use AI, and hackers working on their own hardware face regular raids from the authorities.

On one hand I'm strongly against letting that happen, on the other there's something romantic about the idea of smuggling the latest Chinese LLM on a flight from Neo-Tokyo to Newark in order to pay for my latest round of nervous system upgrades.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#27
post #3

Was it George himself, or a person working for a bounty that was set up by tinycorp? Also, a question for those knowledgeable about the PCI subsys: it looked like something NVIDIA didn't care about, rather than something they actively wanted to prevent, no?

[deleted]

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#28
post #16

Earlier quoted context omitted.

In the sense that any other government regulation is also ultimately backed by the state's monopoly on legal use of force when other measures have failed. And contrary to what some people are implying he also proposes that everyone is subject to the same limitations, big players just like individuals. Because the big players haven't shown much of a sign of doing enough.

> In the sense that any other government regulation is also ultimately backed by the state's monopoly on legal use of force when other measures have failed. Good point. He was only (“only”) really calling for international cooperation and literal air strikes against big datacenters that weren’t cooperating. This would presumably be more of a no-knock raid, breaching your door with a battering ram and throwing tear ga…

... after regulation, court orders and fines have failed. Which under the premise that AGI is an existential threat would be far more reasonable than many other reasons for raids.

If the premise is wrong we won't need it. If society coordinates to not do the dangerous thing we won't need it. The argument is that only in the case where we find ourselves in the situation where other measures have failed such uses of force would be the fallback option.

I'm not seeing the odiousness of the proposal. If bio research gets commodified and easy enough that every kid can build a new airborne virus in their basement we'd need raids on that too.

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#29
as a technical feat this is really cool! though as others mention i hope you don't get into too much hot water legally

seems anything that remotely lets "consumer" cards canibalize anything with the higher end H/A-series cards Nvidia would not be fond of and they've the laywers to throw at such a thing

Post reply on HN