261–264 of 264 posts
The rumor from Gurman is that the M5 Ultra Mac Studio ships in the first half of this year. This may just be a sign that the M5 Ultra Mac Studio is shipping sooner rather than later, as it's common for Apple to push out ship dates for soon to be replaced products. We do have leaked benchmarks showing that the M5 Max outperforms the M3 Ultra currently shipping in the Mac Studio, so buying an M3 Ultra Studio right now…
Now how am I supposed to develop Electron apps and use Chrome? In all seriousness, though, as one of the uninitiated, what would be the value of hosting LLMs on a machine like this that has a lot of memory that you pay for up front versus some sort of VPC-based approach?
Earlier quoted context omitted.
The second I saw llms run on gpus i started trying to predict the last year that nvidia produces a consumer GPU product.
I am doing the reverse, and trying to predict the last year that LLMs use NVIDIA GPUs. It's just an accident of history that video game cards are useful for LLMs, and there is absolutely nothing that NVIDIA is doing from a design standpoint that the big hyperscalers can't do on their own, cutting NVIDIA out, and doing a better job of it as they know their own unique needs. The only advantage NVIDIA has is supply chai…
I don't think there will ever be a hard announcement. Just one day people will start asking when the next GPU line is coming out and it will never come. They won't even plan it they simply won't have the skills to do GPU design anymore.