It's interesting to see that ML performance is about equal on iPhone X and older iPhones, considering that iPhone X (and 8) has a neural engine and the other phones do not.
IIRC the neural engine was only available to first party apps in iOS 11.
iOS 12 Core ML Benchmarks
11–20 of 59 posts
Re: iOS 12 Core ML Benchmarks
#12I've noticed on my SE that everything is running much much faster with iOS 12. It seems like the app store is actually really usable now. Does anyone have any idea what they did?
Re: iOS 12 Core ML Benchmarks
#13I've noticed on my SE that everything is running much much faster with iOS 12. It seems like the app store is actually really usable now. Does anyone have any idea what they did?
The biggest change was ramping up processor instantly, and then back down to maximize performance. So for launching an app / scrolling, CPU reaches highest state, until that portion is over, and immediately get back to efficiency setting for preserving battery life. Previously CPU time would ramp up slowly.
Re: iOS 12 Core ML Benchmarks
#14I've noticed on my SE that everything is running much much faster with iOS 12. It seems like the app store is actually really usable now. Does anyone have any idea what they did?
I noticed it on my SE as well. The WWDC keynote from this year highlights some of the performance improvements that iOS 12 brings to old phones. Something about ramping up processor activity and quickly ramping it down when you don't need it..I don't remember the details.
The end result is that with iOS 12, apps launch twice as fast, camera app opens 70% faster, and the keyboard comes up twice as fast too.
Re: iOS 12 Core ML Benchmarks
#15Re: iOS 12 Core ML Benchmarks
#16I've noticed on my SE that everything is running much much faster with iOS 12. It seems like the app store is actually really usable now. Does anyone have any idea what they did?
The biggest change was ramping up processor instantly, and then back down to maximize performance. So for launching an app / scrolling, CPU reaches highest state, until that portion is over, and immediately get back to efficiency setting for preserving battery life. Previously CPU time would ramp up slowly.
It's probably paranoia, but I feel like my 5S battery is draining faster since the update.
That being said, the performance upgrade is well worth it.
Re: iOS 12 Core ML Benchmarks
#17It's interesting to see that ML performance is about equal on iPhone X and older iPhones, considering that iPhone X (and 8) has a neural engine and the other phones do not.
The neural engine is a huge boost, but also remember it's a logarithmic scale so the iPhone X is a faster 5x slower than the 6s.
Re: iOS 12 Core ML Benchmarks
#18Impressive but with a specialized coprocessor it's not unexpected. It's a bit of a gamble for Apple though, as other ARM SoC's are probably able to bridge the gap in raw single-core and multi-core performance in a year. The whole ML thing is a bit fuzzy for a lot of people even for programmers like me that are still wondering how their regular applications are going to benefit from all this silicon.
Other ARM SoC's haven't been able to bridge the relative gap in raw single-core performance going on 5+ years, and haven't hit multi parity since iDevices went beyond 2 cores. I don't really see a gamble here at all - adding ML blocks is relatively cheap and icing on the cake.
Take Geekbench (and any other benchmarks) with a grain of salt of course, but benchmarks & reviews all corroborate the same story. See these GB4 results for instance:
Android [1] - 3323 single, 8894 multi
iPhone XS [2] - 4794 single, 11151 multi
It's actually a structural / incentive problem that keeps Apple at an advantage in this case, so I wouldn't count on the gap being bridged or even reduced anytime soon. Apple has built an incredible flywheel that lets them earn much more $ per chip than Qualcomm or Samsung by bundling them into super high-margin, high-volume iPhones.
Everything equal, my wild-ass guess is Apple can probably throw at least 33% more transistors at workloads than the competition, due to being on leading edge nodes, being comfortable with lower yields, running multiple chip teams in parallel for maximum efficiency & manual layout, etc. This means huge caches, fancy pipelines, lots and lots of specialized silicon, etc. They also have arguably the most talented chip team in the industry.
And that's just the chip. Because Apple is so vertically integrated, they're better able to optimize the device as a whole. That means more expensive components like faster ram & disk, better integration between IP blocks like CPU/GPU/ML, and more optimized OS/drivers that all play into overall performance and differentiated use cases. It's a business structure that is nearly impossible to replicate and will continue to create a lasting advantage.
With regard to how ML is used, it fits the approach Apple is taking to keep things on-device (vs in the cloud) as much as possible. So any use cases where ML is used in the cloud are potential use cases for ML on the device.
[1] https://browser.geekbench.com/android-benchmarks
Re: iOS 12 Core ML Benchmarks
#19Earlier quoted context omitted.
The biggest change was ramping up processor instantly, and then back down to maximize performance. So for launching an app / scrolling, CPU reaches highest state, until that portion is over, and immediately get back to efficiency setting for preserving battery life. Previously CPU time would ramp up slowly.
It's probably paranoia, but I feel like my 5S battery is draining faster since the update. That being said, the performance upgrade is well worth it.
It's not, my 6S did the same thing with intensive apps, like Instagram. With IG it's probably ALWAYS ramped up constantly scrolling, playing , downloading. They definitely sacrificed battery life for speed in older phones. My XS lasts like two days though.
Re: iOS 12 Core ML Benchmarks
#20Earlier quoted context omitted.
It's probably paranoia, but I feel like my 5S battery is draining faster since the update. That being said, the performance upgrade is well worth it.
It's not, my 6S did the same thing with intensive apps, like Instagram. With IG it's probably ALWAYS ramped up constantly scrolling, playing , downloading. They definitely sacrificed battery life for speed in older phones. My XS lasts like two days though.
What the heck are you doing to get 2 days from your XS? I barely get one!