Earlier quoted context omitted.
Hopefully it will come down to that price point or cheaper again in the next 3-4 years?
Hopefully... If it doesn't, mere mortals like us consumers are going to be priced out of computers altogether. It'll be the end of the personal computing era and a return to big iron mainframes.
Thelio Mira AI Linux Workstation: 192 GB GPU Memory
131–134 of 134 posts
On the highest end maybe. But people have had some sucess DIYing some semi-modern lithography semiconductor production.
Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory
#132Earlier quoted context omitted.
none of them are Nvidia GPU FAST
But more memory is available so a larger model can be loaded. It depends on the use case which is better. Any chat or voice model will have better UX with nvidia but document or code generation will be better with apple.
it's not a binary thing. At some point Apple becomes too slow with very large models. If you can just run a model at 1 token per second and it takes 30 mins to process a long context, it's useless
Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory
#133A bit ridiculous , a Maxed Mac studio would beat that in most of the AI cases
Re: Thelio Mira AI Linux Workstation: 192 GB GPU Memory
#134I find it hard to believe any enterprise willing to drop over $40k on a workstation PC would choose `Pop!_OS 24.04 LTS with the COSMIC Desktop Environment` over Ubuntu.
Why? It is built from Ubuntu[1]. I am a very happy full-time daily user. Anecdotally it is more stable and productive than Windows ever was for me, and plenty of enterprises use windows… [1] https://system76.com/support/difference-between-pop-ubuntu
When did Windows come into the picture? I was just talking about Ubuntu.