51–60 of 64 posts
On a related topic: does anyone know why NVIDIA keeps reducing the bus width on their latest gen cards? A 2060 has a 192-bit bus. A 3060 has a 192-bit bus. A 4060 has a 128-bit bus! ### A 2070 has a 256-bit bus. A 3070 has a 256-bit bus. A 4070 has a 192-bit bus!
Wafer prices have increased and so has Nvidia's greed so you get less hardware for your money every generation.
Earlier quoted context omitted.
This is not a good comparison. Nvidia doesn't have a fab, but they are the lead player in the AI chip space. Intel had both and look where it got them. TSMC has a good model, and you can basically take any of your designs for the same node and manufacture it in any of their plants. Same strategy can be applied to Samsung, and they already help a lot on the memory segment. The new HBM3E memory chips for H200s might be…
NVIDIA Ampere consumer line was manufactured in Samsung fabs: https://en.m.wikipedia.org/wiki/GeForce_30_series
* Arc A770 seems to provide 16GB for * Older NVidia card go up to 48GB for about the cost of a modern 24GB card, and some can be paired. Will it work for [X] (here, LLMs and large resolution image generation require lots of RAM)?
I wish there was some kind of chart of compatibility and support.
Earlier quoted context omitted.
You mean Vega. Volta is a Nvidia arch. Vega's marketing pushed Nvidia to make what is ending up to be the best product series they will ever make: series 10. That isn't much of a joke, it scared the shit out of Nvidia, and they blinked. Vega was too late in the pipeline to stop, and Raja was ultimately let go for his role in the whole thing. He refused to start making more gamer-friendly cards, and was obsessed with…
>Its why AMD won against Nvidia. Won how? >Nvidia still has no real answer to AMD's success Which success? Answer to what? Are you from a paralel multiverse? In this reality, it's the other way around. Nvidia is making so much money from the AI hype than AMD is the one trying to play catch-up.
On a related topic: does anyone know why NVIDIA keeps reducing the bus width on their latest gen cards? A 2060 has a 192-bit bus. A 3060 has a 192-bit bus. A 4060 has a 128-bit bus! ### A 2070 has a 256-bit bus. A 3070 has a 256-bit bus. A 4070 has a 192-bit bus!
Both the 2070 and 3070 have a memory bandwidth of 448GB/s the 4070 with its smaller bus has a memory bandwidth of 504GB/s.
Earlier quoted context omitted.
At most points in the product stack, memory frequency increased by enough to compensate for the narrower bus. Dropping to a narrower bus and putting more RAM on each channel allowed for some 50% increases in memory capacity instead of having to wait for a doubling to be economical. And architecturally, the 4000 series has an order of magnitude more L2 cache than the previous two generations (went from 2–6MB to 24–72M…
With respect: Have you actually measured performance or are you merely quoting Nvidia marketing?
If you were specifically referring to the performance impact of the big L2 cache increase: I don't know how big a difference that made, but it obviously wasn't zero.
Earlier quoted context omitted.
At most points in the product stack, memory frequency increased by enough to compensate for the narrower bus. Dropping to a narrower bus and putting more RAM on each channel allowed for some 50% increases in memory capacity instead of having to wait for a doubling to be economical. And architecturally, the 4000 series has an order of magnitude more L2 cache than the previous two generations (went from 2–6MB to 24–72M…
Seems to have gone badly for the 4060 & 4060 Ti specifically though, as they're at the same performance level as the previous gen 3060. People could buy a 2nd hand 3070 for less money.
Earlier quoted context omitted.
>Its why AMD won against Nvidia. Won how? >Nvidia still has no real answer to AMD's success Which success? Answer to what? Are you from a paralel multiverse? In this reality, it's the other way around. Nvidia is making so much money from the AI hype than AMD is the one trying to play catch-up.
Yeah, and before that they ruled the bitcoin craze. You literally couldn't buy Nvidia cards for an insanely long time time because the 30 series was so cost effective at mining that everyone and their uncle wanted in on the deal. AMD has some edge in the non high end server niche, but Nvidia rules everything else. In the AI craze AMD is not even an afterthought anymore, as everyone wants Nvidia. Even companies like G…
Nvidia strongly missed the boat by continually pushing CUDA lock in, while being on the Khronos steering committee and having made important contributions to OpenGL, OpenCL, Vulkan, and the SPIR-V ecosystem while simultaneously having pretty poor support for standard APIs in their software stack.
Highest perf per watt and perf per dollar is AMD land. AMD keeps moving fowards while Nvidia keeps making weird missteps. There is a reason why I said series 10 is the best they will ever make, there will never be a return to that: they're stuck in the same loop Raja was: make everything bigger for the sake of bigger, instead of making actual performance improving changes.
[flagged]
> There are is a new wave of silicon companies that use photonics, in memory compute, deterministic/fogs data flow, etc Those innovations are really cool sounding and make for great press releases, but are much less amenable to third-party benchmarking and analysis on account of those "innovations" largely still being stuck in the lab and small-scale proof of concept products, whereas Nvidia's GPUs are mass-market pr…
Google TPU for example has been shipped.
Earlier quoted context omitted.
> There are is a new wave of silicon companies that use photonics, in memory compute, deterministic/fogs data flow, etc Those innovations are really cool sounding and make for great press releases, but are much less amenable to third-party benchmarking and analysis on account of those "innovations" largely still being stuck in the lab and small-scale proof of concept products, whereas Nvidia's GPUs are mass-market pr…
So they ship because they aren't innovative? Google TPU for example has been shipped.
Ok, you're clearly not trying to make sense here.
And there's no way you can believe that Google's TPUs have shipped as broadly as Nvidia's GPUs (or even just Nvidia's datacenter GPUs).