Earlier quoted context omitted.
The rumors say they’re going to have a high end of 128 gpu cores by using 4 32 gpu core chiplets.
Does that mean they will actually produce a laptop with adequate cooling? Might be worth looking at.
Apple M1 support for TensorFlow 2.5 pluggable device API
91–100 of 124 posts
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#92I'm still trying to find a way to monitor the Neural Engine on my Macbook air M1, but the APIs are non-existent, there's barely anything in the docs and no answer from Apple. My models train fast, 3x faster than most i7 computers with GPU, which is excellent for a fanless ultraportable computer but I wish Apple would treat the NE as a 1st class citizen on these machines, with Mac SDK APIs and usage visualization in t…
> 3x faster than most i7 computers with GPU Can you back that statement up with anything, or at least clarify it? You seem to suggesting a non-mac i7 with a separate GPU. Also, just an FYI, "i7" says pretty much nothing. The i7s have existed since 2009. I don't know. The statement is just so vague and ridiculous. The M1 is probably the worst hardware you could have picked in 2020-2021 if computational power was your…
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#93Earlier quoted context omitted.
So Apple would need 16x its GPU Core, or 128 GPU Core to reach Nvidia 3090 Desktop Performance. Or roughly 480mm2 Die Size, 192W TDP excluding memory controller and interconnect. Doesn't look too bad for Nvidia, especially when you consider 3090 is still on Samsung 8nm, which is equivalent to TSMC 10nm, compared to 5nm on Apple M1.
If Apple could just scale up their GPU and trounce a 430B market cap competitor's premiere product at 1/2 the power, 60% of the die size, that actually looks pretty bad for nvidia, doesn't it? Scaling is more difficult than that, and who knows if they could so easily, but who thought Apple would render both Intel and nvidia irrelevant? Regardless, Apple's threat to vendors like that is their complete vertical integra…
Also, Apple desperately needs to support a real graphics API. Metal is a joke, and even the translation tools like MoltenVK, while impressive, still end up beholden to Apple's arbitrary limitations. If they don't end up supporting Vulkan on the M1, it's a moot point for me. You could have the most powerful GPU in the world, but I won't use it if it's bottlenecked by the shittiest modern graphics API.
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#94I'm still trying to find a way to monitor the Neural Engine on my Macbook air M1, but the APIs are non-existent, there's barely anything in the docs and no answer from Apple. My models train fast, 3x faster than most i7 computers with GPU, which is excellent for a fanless ultraportable computer but I wish Apple would treat the NE as a 1st class citizen on these machines, with Mac SDK APIs and usage visualization in t…
> 3x faster than most i7 computers with GPU Can you back that statement up with anything, or at least clarify it? You seem to suggesting a non-mac i7 with a separate GPU. Also, just an FYI, "i7" says pretty much nothing. The i7s have existed since 2009. I don't know. The statement is just so vague and ridiculous. The M1 is probably the worst hardware you could have picked in 2020-2021 if computational power was your…
Who compares ultrabook to desktop for the multithreaded computation power? Assume you only want that without any regards to power or space or cost, by your logic you could buy 1000 mac mini and the computational power will be more than any desktop computer.
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#95Earlier quoted context omitted.
So Apple would need 16x its GPU Core, or 128 GPU Core to reach Nvidia 3090 Desktop Performance. Or roughly 480mm2 Die Size, 192W TDP excluding memory controller and interconnect. Doesn't look too bad for Nvidia, especially when you consider 3090 is still on Samsung 8nm, which is equivalent to TSMC 10nm, compared to 5nm on Apple M1.
This won't scale like this, also for deep learning CUDA and CUDNN will be still probably 2-5x faster then AMD/Metal drivers as was proven before (in case of AMD shitty deep learning drivers)
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#96Earlier quoted context omitted.
> 3x faster than most i7 computers with GPU Can you back that statement up with anything, or at least clarify it? You seem to suggesting a non-mac i7 with a separate GPU. Also, just an FYI, "i7" says pretty much nothing. The i7s have existed since 2009. I don't know. The statement is just so vague and ridiculous. The M1 is probably the worst hardware you could have picked in 2020-2021 if computational power was your…
If you thought a MacBook Air was going to replace a purpose-built machine learning workstation of course buying it would be a mistake, because it won’t do that. It only supports up to 16GB of RAM! But what other computer in that form factor comes close? The argument is that the higher efficiency will translate into more powerful chips in HEDT products too. I wouldn’t take that on faith but I think they have a decent…
Basically all of them, as long as you aren't training your models on your CPU like it's 2011.
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#97Earlier quoted context omitted.
> 3x faster than most i7 computers with GPU Can you back that statement up with anything, or at least clarify it? You seem to suggesting a non-mac i7 with a separate GPU. Also, just an FYI, "i7" says pretty much nothing. The i7s have existed since 2009. I don't know. The statement is just so vague and ridiculous. The M1 is probably the worst hardware you could have picked in 2020-2021 if computational power was your…
> That the M1 is computationally powerful is a myth started out by exceedingly misleading marketing and reinforced with hard-to-compare benchmarks It feels like you've constructed quite the straw-man to tear down. Praise for the M1 is in the context of the form factors it exists in and the efficiency it works at. Of course you can find more powerful hardware in larger form factors drawing 10x the power from the mains…
> Then don't buy a bloody M1. The M1 has always been Apple's entry-level efficiency-first processor.
No, I gotta disagree. Apple's marketing around the M1 was intentionally deceptive: they were forced to revoke their claim of having the "fastest CPU cores" after it was vehemently disproven. Their "faster than 97% of Windows laptops" conveniently didn't compare itself to AMD laptops or laptops with dedicated graphics. I'm just not really impressed. I seriously worry for Apple if this is all they were able to get out of the 5nm node on ARM. Considering how poorly ARM scales with higher TDPs, I don't think I want to see their "Pro stuff".
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#98Earlier quoted context omitted.
Ohhhh snapppppp! Excitement level just shot way up. Thank you. God, it’ll be nice having a gpu for tensorflow. I’ve dreamed about this for like… a long time.
... and it worked on linux and windows for years already.
Re: Apple M1 support for TensorFlow 2.5 pluggable device API
#99I find the benchmarks confusing. If we normalize, is Apple close to beating Nvidia?