Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

developer.apple.com

Post reply on HN
Print view View original

51–60 of 75 posts

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#51

Post by Dylan16807 »

SuperShibe wrote: post #50
mynegation wrote: post #36

Earlier quoted context omitted.

Did you mean to say signal-to-noise [ratio] is _low_? Meaning that you get way too much noise for the amount of signal. Or did you mean to say it needs to be high (I.e. low noise) to be useful?

For every good fitness app that does what it promises (-> signal) there are at least 50 bad fitness apps that promise too much and let you pre-pay for the (broken) features you wanted, money you'll never get back (-> noise). The amount of noise in Fitness apps is so high, nobody really dares to try out small apps. Therefore cool implementations from small devs like the workout-correction might stay unnoticed for year…

Right, and SNR is signal dividied by noise.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#53

Post by fnordpiglet »

whywhywhywhy wrote: post #3
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

I think they seem to be doing fairly well as a company, and part of that is not letting themselves be tethered by a standard to allow competitors equal access to their walled garden. Whether you like that or not, it’s the strategy they’ve taken. They would rather not have your app than distort their platform to accommodate its ability to run on another platform.

For developers the reason to adopt the apple ecosystem is fairly simple. People willing to pay for an apple device are likely willing to pay for a subscription. The apple model is essentially you buy a subscription to their hardware - they release at a regular clip, they anticipate most customers will refresh, there’s no meaningful upgrade path, etc. As a developer I prefer subscriptions over one time purchases because it incentives my maintenance and growth of features for existing customers rather than a never ending grab for new customers. As a consumer while my pocket book certainly prefer one time pay, I actually do see the benefit in incentivizing continuous improvements for existing customers. (I do however wish that apple didn’t hide the subscriptions management so deeply and made it very prominent, and until they do it falls into the abusive category IMO)

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#55

Post by countvonbalzac »

wlesieutre wrote: post #39
dingledork69 wrote: post #38

Earlier quoted context omitted.

> But if you are successful, there is a chance of getting sherlocked, so its a risky business model. What does this even mean? Watson shows up to help out?

Watson was an independent search application on Mac OS, until Apple basically photocopied it and named theirs Sherlock. Since then it's become a verb for when Apple takes your app and builds it into the OS. Another blatant example was Dashboard, which copied Konfabulator, Night Shift is a copy of F.lux, etc.

I still use F.lux, it's much better than night shift IMO, just wish they had it for iOS.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#56

Post by anonymoose4 »

supermatt wrote: post #31
scottymac wrote: post #25

Earlier quoted context omitted.

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand…

The signal to noise in fitness apps is high. The mainstream ones don’t do this, or if they do the implementation is so bad it’s not worth using, and discovery of anything else is fraught with shitware that wants a subscription to “unlock” it’s unknown potential.

Yeah you mean low

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#57

Post by dimatura »

itake wrote: post #43

(feel free to correct me if I am wrong), but my main gripe against mobile ML frameworks (Android too) is they require the app to embed the ML model with the app (as opposed to the OS storing the model like a shared library). People with limited storage on low-end device don't have enough memory to store the apps.

CoreML has various models already built-in, although as black boxes that accomplish some task like OCR or rectangle detection. There's also a "feature print" model which I believe are intended to be used as hard-coded features for simple ML tasks. In either case I strongly suspect that when you use them, they're not being embedded in the app.

Another thing to consider is that you don't have to embed the model in your app; at least in CoreML you can download (and update) the model weights over the network.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#58

Post by itake »

dimatura wrote: post #57
itake wrote: post #43

(feel free to correct me if I am wrong), but my main gripe against mobile ML frameworks (Android too) is they require the app to embed the ML model with the app (as opposed to the OS storing the model like a shared library). People with limited storage on low-end device don't have enough memory to store the apps.

CoreML has various models already built-in, although as black boxes that accomplish some task like OCR or rectangle detection. There's also a "feature print" model which I believe are intended to be used as hard-coded features for simple ML tasks. In either case I strongly suspect that when you use them, they're not being embedded in the app. Another thing to consider is that you don't have to embed the model in your…

People have lower HD size (think 64GB iPhone X/iPhone SE) on unreliable internet networks. Downloading five 200MB models to perform five layers of processing (OCR, rm background, object detection, etc.) would take hours and consume too much cellular data.

Sending a 10kb image to the cloud for processing is much faster and user friendly.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#59

Post by iFire »

To be clear does it mean access on Apple devices and not like an Apache 2 licensed Github repository?

https://twitter.com/yeemachine/status/1656391928223768576?s=...

https://mediapipe-studio.webapps.google.com/demo/face_landma...

https://github.com/google/mediapipe

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#60

Post by agentdrtran »

nbaugh1 wrote: post #32
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There a home gym setup called Tempo that claims to do this. I have the scaled down mobile app version so idk if the full setup is more informative, but it doesn't really give a lot of feedback at all. It basically just tracks the movement of the dumbbell plates that they send you to count your reps, and if you aren't moving the weight to the correct position your rep won't count. It definitely doesn't do anything lik…

I switched from the Move to the Studio (freestanding version) and the form feedback triggers __slightly__ more often but it's still not worth bothering about imo. the rep counting not working bothers me way more.
Post reply on HN