11–20 of 199 posts
Some context: - In 2017, the v100 was a ~$10,000 GPU. I believe there was a PCI-e version but this is probably so cheap because SXM2 is going to be harder to use; - A 5090 has 1800GB/s of internal memory bandwidth (compared to 900GB/s in the 9 year old GPU). Of course a 5090 is substantially more expensive; - A 5090 has ~21k CUDA cores vs ~5k; - The current $10k NVidia GPU is the RTX 6000 Pro w/ 96GB of VRAM. It has…
A little bit of local copium but neat read. Isn't a rasbpi with 16gb of RAM $300 now?
> The compute is still real. The VRAM is still real. And the memory bandwidth is where it gets genuinely surprising. Because humans write exactly like this /s
Classic LLM writing style.
A little bit of local copium but neat read. Isn't a rasbpi with 16gb of RAM $300 now?
Had to stop there. Annoying. I can't stand AI use for writing. It makes any otherwise great article feel so disingenuous.
The AMD MI250X GPUs are also interesting - 128GB of HBM2E at 3TB/s, sometimes you see them second-hand for under $1k, the catch obviously is that it needs an OAM socket. Never seen an easy way to hook them up to a regular mainboard.