I got myself a NVIDIA DGX Spark to build on unified-memory hardware at home. Now running a health-AI node for all my longitudinal health data - insights are generated on the box so that raw data never leaks.
Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't
61–62 of 62 posts
Re: Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't
#62Earlier quoted context omitted.
It is and it doesn't. You only get into disk writes if the system starts paging out to disk.
No one can reliably track uses of "it", and definitely not multiple uses, so please take your time to qualify everything explicitly. Currently I have no idea what each "it" is referring to.
Reads off your SSD don't age it prematurely.