Earlier quoted context omitted.
Weren't there some frameworks recently released to allow Macs to stream weights from fast SSDs and thus fit way more parameters than what would normally fit in RAM? I have never tried one yet but I am considering trying that for a medium sized model.
Do you have the links for those? Very interested
Note: these were just two that I starred when I saw them posted here. I have not looked seriously at it at the moment,