I want run open source LLMs on this prebuilt AI. Anyone tested this before?
1–5 of 5 posts
Re: I want run open source LLMs on this prebuilt AI. Anyone tested this before?
#2seems a tad expensive for (nerfed) consumer-grade GPUs IMO
Re: I want run open source LLMs on this prebuilt AI. Anyone tested this before?
#3cool case, i'll go for opt 2 as they have Threadripper.
Re: I want run open source LLMs on this prebuilt AI. Anyone tested this before?
#4good point is that this integrates some existing models for you to use. You can test different models with this. But still need to upgrade if you wanna try larger models. The more Vram the better
Re: I want run open source LLMs on this prebuilt AI. Anyone tested this before?
#5It reminds me of a similar product [0] from George Hotz