Earlier quoted context omitted.
> You can get that much ddr5 today for like $400 Not comparable. M2 Ultra with 128GB RAM has 800 GB/s bandwidth. Maximum bandwidth for a DDR5 Intel 14900K system is 89.6 GB/s. https://www.intel.com/content/www/us/en/products/sku/236773/...
You can only get 2tb of storage max i believe, you are probably bottlenecked elsewhere if you are actually needing to move that much data that fast into memory in practice. I wonder what the temps would even be doing something that maxes that ram bandwidth
The temps will be completely normal since that is normal operation. TDP is only 80 watts for M2 Ultra.
> You can only get 2tb of storage max i believe, you are probably bottlenecked elsewhere
No. Just no. This is not the issue. The models are loaded into GPU memory.