Waiting for Intel Battlemage, latest rumors says 16 GB of memory, a 256-bit wide bus, RTX 4080 level of performance in compute for 450$ MSRP. Wait and see Q3 2024. Intel software stack is more likely to challenge Nvidia's than AMD's.
New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
101–110 of 135 posts
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#102Earlier quoted context omitted.
Most people don’t upgrade to the same generation super card. Most people upgrade from a 10, 20 or less so 30 series card. They are selling upgrades to older generations.
But everybody who is upgrading is trying to figure out which card to upgrade to, and are doing comparisons between the current gen cards, not between their old card and the new ones.
It is likely that there will be no choice between Super and non-Super.
At least 4070 Ti and 4080 have become completely obsolete when their Super variants are much better, and in the case of 4080 Super, even cheaper too.
I suppose that they have stopped producing the non-Super variants, as nobody would want those where the Super cards are available.
I am still using a 2060 Super from 2019, and the same has happened in that year when the RTX 2000 Super series has replaced the previous RTX 2000 series.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#103Earlier quoted context omitted.
Of course
Your comment, pre-edit, had something of a severe tone given that consideration. Having said that, I've trained/finetuned image models just fine on an RTX 2070 Super with 8 GB of VRAM. This was back when doing so was more fruitful than simply training a more robust model in the first place. Given that is the current status quo - I'm curious what sort of training you're doing whole-network that actually produces resul…
[deleted]
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#104Earlier quoted context omitted.
Most people don’t upgrade to the same generation super card. Most people upgrade from a 10, 20 or less so 30 series card. They are selling upgrades to older generations.
But everybody who is upgrading is trying to figure out which card to upgrade to, and are doing comparisons between the current gen cards, not between their old card and the new ones.
I think people shop based on, have card A and get X fps and I can get Y fps with card B.
Card A is old, and card B is new.
The availability of original and super cards that compete in the same price point will be very short, and most people won’t really have that choice.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#105Earlier quoted context omitted.
It seems they’re being very careful not to undercut their enterprise offerings or even the 4090. Assuming they’re not completely tone deaf, I can only assume this is the explanation.
The Jetson AGX Orin Developer Kit [1] has 64 GB of unified 256-bit LPDDR5 memory. It costs $2,000 and might get some people someplace interesting. [1]: https://developer.nvidia.com/embedded/learn/getting-started-...
5FP32 TFLOPs, if not doing sparse low precision inference it seems to be about in line with mid-high end 2014 Nvidia consumer card performance (gtx 980), one decade old.
For running sparsified/quantized llama2 it might be good, not sure about for fine tuning. I didn't see any FP16 numbers.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#106Earlier quoted context omitted.
Generally a wise decision when it comes to anything that has this type of release schedule, from phones to 3D printers. Buy one generation, skip one, maybe upgrade the next, depending on relevant improvements.
With CPUs I'd say skip more than 1. I've been doing every 4 generations, and given how poorly Intel's 14th gen performed, I'm waiting another still. The improvements are very small in this space right now, for the most part.
1080ti and 8700k still goin' strong
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#107Earlier quoted context omitted.
I wouldn't be shocked if the 5090 is also the only one with 24GB. Seems like NVidia is trying their hardest to suppress memory increases.
Because the 5090 ostensibly targets gaming which only needs sufficient vram to display images on 4k textures on 4k, 5k and ultra-wide monitors. A large portion of the 5090 audience is not doing ML training and that vram would sit idle for a few monitor generations. As a gamer I would be kind of upset if they included that very expensive unneeded vram in their already very expensive cards.
As someone who is a gamer but also wants to dabble in ML, it kind of hurts tbh that this is probably true.
The xx90 cards (3090, 4090, etc) have always been aimed at the gamer with a lot of cash. But games aren't really designed with that hardware in mind, so you won't see games that will take advantage of that much VRAM, so NVIDIA isn't inclined to increase the memory on them.
I have a 3080 right now, so haven't really been able to play around with training a model, but I'd like to see the 5090 have 32 GB, but I'm having my doubts.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#108Earlier quoted context omitted.
To me it's a bit strange because it assumes a buy / not buy perspective rather than a buy this / buy that perspective.
Welcome to PC hardware. People rarely switch camps or price tier. People who have 4070 today are the people who had 1070/2070/3070.
Rather 1080/2080/3080 with current prices.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#109Earlier quoted context omitted.
I wouldn't be shocked if the 5090 is also the only one with 24GB. Seems like NVidia is trying their hardest to suppress memory increases.
When you can sell an enterprise-grade card with 40-80GB of VRAM for $50k, selling consumer cards with 24GB for $2k is almost a form of charity, by comparison. AMD and Intel GPUs do not have the software ecosystem for AI workloads that Nvidia does, though AMD is rapidly improving. Nvidia has had an effective monopoly on the AI hardware space for the last year or so, and continues to have an effective near-monopoly, bu…
> When you can sell an enterprise-grade card with 40-80GB of VRAM for $50k
ADA 6000 RTX (48GB) — an enterprise (workstation) cars — is about $10K sticker price. The differentiator between those and data center cards in the 40GB-80GB range is, obviously, not just VRAM.
Re: New GeForce RTX 4080 Super, RTX 4070 Ti Super, RTX 4070 Super
#110Earlier quoted context omitted.
The two parent 2080s were lost in a tragic cryptocurrency mining accident when the bitcoin ceiling collapsed. Please send donations to the Aboveground Miners fund in your choice of shitcoin.
I get that it's supposed to be funny, but I wonder how many people still think bitcoin mining happens on GPUs, particularly Nvidia ones. Pretty sure that stopped being the case like 14 years ago or something? Anyway...
All tokens are effectively "slaved" to the BTC tokens due to paper thin real liquidity of all of them. Therefore GPUs were very much affected by the BTC volatility, just via proxy, and likely still are. It should be obvious really for anyone.