Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hacked Nvidia 4090 GPU driver to enable P2P

github.com

Post reply on HN
Print view View original

131–140 of 365 posts

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#131

Post by metadat »

magicalhippo wrote: post #106
HeatrayEnjoyer wrote: post #55

Earlier quoted context omitted.

Wires, flash, and resistors can be replaced

These are part of the chip, thus microscopic and very inaccessible. There are some good images here[1] of various such fuses, both pristine and blown. Here's[2] a more detailed writeup examining one type. It's not something you fix with a soldering iron. [1]: https://semiengineering.com/the-benefits-of-antifuse-otp/ [2]: https://www.eetimes.com/a-look-at-metal-efuses/

I miss the days when you could do things like connecting the L5 bridges on the surface of the AMD Athlon XP Palomino [0] CPU packaging with a silver trace pen to transform them into fancier SMP multi-socket capable Athlon MPs, e.g. Barton [1].

https://arstechnica.com/civis/threads/how-did-you-unlock-you...

Some folks even got this working with only a pencil, haha.

Nowadays, silicon designers have found highly effective ways to close off these hacking avenues, with techniques, such as the microscopic, nearly invisible, and as parent post mentions, totally inaccessible e-fuses.

[0] https://upload.wikimedia.org/wikipedia/commons/7/7c/KL_AMD_A...

[1] https://en.wikichip.org/w/images/a/af/Atlhon_MP_%28.13_micro...

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#132

Post by CYR1X »

sparky_ wrote: post #103
llm_trw wrote: post #47

Earlier quoted context omitted.

Yes, the point here is that you do a direct write from one cards memory to the other using PCIe. In older NVidia cards this could be done through a faster link called NVLink but the hardware for that was ripped out of consumer grade cards and is only in data center grade cards now. Until this post it seemed like they had ripped all such functionality of their consumer cards, but it looks like you can still get it wor…

I take it this is mostly useful for compute workloads, neural networks, LLM and the like -- not for actual graphics rendering?

yes

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#135

Post by spxneo »

does this mean you can horizontally scale to GPT-4-esque LLM locally in the near future? (i hear you need 1TB of VRAM)

Is Apple's large VRAM offering like 196gb offer the fastest bandwidth and if so how will pairing a bunch of 4090s like in the comments work?

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#136

Post by Topgamer7 »

nolongerthere wrote: post #130
mikepurvis wrote: post #110

Earlier quoted context omitted.

Yes, but he spent several years in self-driving cars ( https://comma.ai ), which while interesting is also a space that a lot of players are in, so it's not the same as seeing him back to doing stuff that's a little more out there, especially as pertains to IP.

Did he abandon this effort? That would be pretty sad bec he was approaching the problem from a very different perspective.

He stepped down from it. https://geohot.github.io//blog/jekyll/update/2022/10/29/the-...

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#137

Post by the8472 »

stale2002 wrote: post #123
cjbprime wrote: post #88

Earlier quoted context omitted.

It doesn't sound like you gave serious thought to the arguments. The AGI doesn't need to hack robots. It has superhuman persuasion, by definition; it can "hack" (enough of) the humans to achieve its goals.

AI mind control abilities are also on the level of an extraordinary claim, that requires extraordinary evidence. It's on the level of "we better regulate wooden sticks so Voldemort doesn't use the imperious curse on us!". That's how I treat such claims. I treat them the same as someone literally talking about magic from Harry potter. There isn't nothing that would make me believe that. But it requires actual evidence…

Voldemort is fictional and so are bumbling wizard apprentices. Toy-level, not-yet-harmful AIs on the other hand are real. And so are efforts to make them more powerful. So the proposition that more powerful AIs will exist in the future is far more likely than an evil super wizard coming into existence.

And I don't think literal 5-word-magic-incantation mind control is essential for an AI to be dangerous. More subtle or elaborate manipulation will be sufficient. Employees already have been duped into financial transactions by faked video calls with what they assumed to be their CEOs[0], and this didn't require superhuman general intelligence, only one single superhuman capability (realtime video manipulation).

[0] https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-ho...

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#139

Post by spxneo »

llm_trw wrote: post #47
ot1138 wrote: post #35

Earlier quoted context omitted.

Is this really efficient or practical? My understanding is that the latency required to copy memory from CPU or RAM to GPU negates any performance benefits (much less running over a network!)

Yes, the point here is that you do a direct write from one cards memory to the other using PCIe. In older NVidia cards this could be done through a faster link called NVLink but the hardware for that was ripped out of consumer grade cards and is only in data center grade cards now. Until this post it seemed like they had ripped all such functionality of their consumer cards, but it looks like you can still get it wor…

so whats stopping from somebody buying a ton of GPUs that are cheap and wiring it up via P2P like we saw with crypto mining

Re: Hacked Nvidia 4090 GPU driver to enable P2P

#140

Post by stale2002 »

the8472 wrote: post #137
stale2002 wrote: post #123

Earlier quoted context omitted.

AI mind control abilities are also on the level of an extraordinary claim, that requires extraordinary evidence. It's on the level of "we better regulate wooden sticks so Voldemort doesn't use the imperious curse on us!". That's how I treat such claims. I treat them the same as someone literally talking about magic from Harry potter. There isn't nothing that would make me believe that. But it requires actual evidence…

Voldemort is fictional and so are bumbling wizard apprentices. Toy-level, not-yet-harmful AIs on the other hand are real. And so are efforts to make them more powerful. So the proposition that more powerful AIs will exist in the future is far more likely than an evil super wizard coming into existence. And I don't think literal 5-word-magic-incantation mind control is essential for an AI to be dangerous. More subtle…

> Toy-level, not-yet-harmful AIs on the other hand are real.

A computer that can cause harm is much different than the absurd claims that I am disagreeing with.

The extraordinary claims that are equivalent to saying that the imperious curse exists would be the magic computers that create diamond nanobots and mind control humans.

> that more powerful AIs will exist in the future

Bad argument.

Non safe Boxes exist in real life. People are trying to make more and better boxes.

Therefore it is rational to be worried about Pandora's box being created and ending the world.

That is the equivalent argument to what you just made.

And it is absurd when talking about world ending box technology, even though Yes dangerous boxes exist, just as much as it is absurd to claim that world ending AI could exist.

Post reply on HN