M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
1–10 of 15 posts
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#2It's not a conclusive test because the net is too lightweight. Such networks don't utilise the compute at maximum, so it's not showing what it would do under heavy load. At least try a ResNet-50.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#3Has anybody here tried out the 8 GB model? Thinking about getting one for the kids but not sure if 8 GB will be enough. This blog seems to be a +1.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#4At a few hundred microseconds per step, the benchmark steps start to approach the overhead of GPU kernel invocation and memory allocation.
1875 training steps means a batch size of 32, which is hardly optimal given the extremely small model size here.
The same effect is the reason why CPUs remain latency competitive for batch size 1 inference, especially for small models.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#5[deleted]
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#6This seems to be really short training - I though modern NN took hours to train (for prod scale), even with hardware acceleration?
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#7Another apples to oranges comparison. OP should have compared each systems' TPU not GPU. He should redo the benchmark with a proper setup as requested in the comments here and on Medium, otherwise his post is quite misleading.
To facilitate Nvidia's tensor cores OP had to use Nvidia's own TF distr./image and configure it explicitly. Something PyTorch does out of the box. Nobody knows why Google doesn't do this, maybe they want to push their own Cloud TPUs.
> Adding PyTorch support would be high on my list.
Won't happen. PyTorch needs Apple's help bc of the lack of docs, they've asked already and Apple hasn't commented or promised any kind of support, nothing. That they've chose TF instead of the current market leader doesn't give me too much hope and might come from backroom deals we don't know of.
Wondering why OP didn't invest the money into a 2nd 2080 Ti.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#8This is a very bad and unprofessional article. Given his test code, dataset size and training time I am sure if he'd check his GPU load, it would be under 4% because all the time would be wasted moving data to and from GPU.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#9Has anybody here tried out the 8 GB model? Thinking about getting one for the kids but not sure if 8 GB will be enough. This blog seems to be a +1.
Unless your kids are in university working on large models, I'm pretty sure the 8 gig version will more than suffice for general computing.
I picked up the baseline model for $699 (8 GB unified RAM, 8/8/16 cores version with 256 GB of storage) and I've mostly been tinkering, as I use Windows 10 Pro / Fedora 33 on my workstation / gaming computer, but I can tell you it runs World of Warcraft: Shadowlands at 60 FPS 1440p resolution with Ultra settings, which is pretty damn astounding... I mean, I know WOW is running on a nearly 20 year old engine, but that engine has seen a hell of a lot of refinement over the years, and many advanced features have been added.
The M1 is a testament to Apple's engineering team. I really look forward to seeing what they could do if went buck wild and gave themselves a 95 - 180 watt TPU range to compete with Ryzen 5000 / Threadripper 3000 series parts.
We've seen that the M1 is competitive in low power scenarios... I want to know if it can be scaled up and be competitive when power is no concern.
Re: M1 Mac Mini Scores Higher Than My RTX 2080Ti in TensorFlow Speed Test
#10Has anybody here tried out the 8 GB model? Thinking about getting one for the kids but not sure if 8 GB will be enough. This blog seems to be a +1.
Unless your kids are in university working on large models, I'm pretty sure the 8 gig version will more than suffice for general computing. I picked up the baseline model for $699 (8 GB unified RAM, 8/8/16 cores version with 256 GB of storage) and I've mostly been tinkering, as I use Windows 10 Pro / Fedora 33 on my workstation / gaming computer, but I can tell you it runs World of Warcraft: Shadowlands at 60 FPS 144…
If GP looks for a general purpose computer for their kids, M1s are a clear yes but for DL? No way, as long as PyTorch is not running on M1s and an Nvidia GPU in some cheap PC shell has the same price tag.