Running Modern LLMs on a 2GB GPU
medium.com
Running Modern LLMs on a 2GB GPU
1–3 of 3 posts
Re: Running Modern LLMs on a 2GB GPU
#2[deleted]
Re: Running Modern LLMs on a 2GB GPU
#3I've got boxes of mismatched old parts rather than one built machine — any rule of thumb for what's worth assembling vs. what's too old to bother with for this kind of use case?