interesting approach but for inference localops.tech has a simpler compatibility checker - just punch in your gpu and see what actually fits
MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU
71–71 of 71 posts
71–71 of 71 posts