Earlier quoted context omitted.
Note that they said the _Mac Studio_ which in the M2 model has between 400GB/s and 800GB/s memory bandwidth. https://www.apple.com/mac-studio/specs/ Edit: since my reply you have edited your comment to mention the Studio, but the fact remains that the M2 Max has at least ~40% greater bandwidth than the number you quoted as an example.
Yeah, sorry, I realized that as well so I edited my post to add a higher end example with multiple 3090s or similar cards. A single 3090 has just under 1TiB/sec of memory bandwidth. One more edit: I'd also like to point out that memory bandwidth is important, but not sufficient for fast inference. My entire point here is that Apple silicon does have high memory bandwidth for sure, but for inference it's very much hel…
It's definitely not what you'd want for your data center, but for home tinkering it has a very clear niche.