Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

developer.apple.com

Post reply on HN
Print view View original

61–70 of 75 posts

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#61

Post by nerdbert »

codeflo wrote: post #13
whywhywhywhy wrote: post #3

Earlier quoted context omitted.

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

It's not just the machine learning stuff, they have a non-portable approach for everything, including the platform's primary programming language. They still seem to live in a world where a significant niche of developers targets Apple platforms and their bespoke APIs only. The problem with that world view is that (a) everything with a network effect can't target a single platform anymore, and (b) the business model…

Unlike Microsoft? Windows APIs are just as "bespoke".

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#62

Post by deeesstoronto »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

I'm part owner of a company (Halterix) that used pose detection (alternately via smartwatch accelerometer) and machine learning to quantify how well exercises are performed.

We built a demo app for use in physiotherapy to improve outcomes and ran a few clinical studies. The detection accuracy was excellent and patient reception was warm.

There are a number of competitors, some with multi-sensor systems targetted to pros, some with vision systems, etc.

We met with all the big fitness app makers and found generally while they weree somewhat interested in pose detection/accuracy assessment and feedback, it's not at the top of their list of priorities to implement (even to incorporate our 3rd party service).

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#63

Post by carstenhag »

itake wrote: post #43

(feel free to correct me if I am wrong), but my main gripe against mobile ML frameworks (Android too) is they require the app to embed the ML model with the app (as opposed to the OS storing the model like a shared library). People with limited storage on low-end device don't have enough memory to store the apps.

On Android, you can choose to include the ML model dependency "bundled into your app in compile time" or shipped through Google Play Services. Saves many megabytes. Drawback there: if the device doesn't have Play Services, nothing works. Also, on first download it takes some seconds to work.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#64

Post by cj »

tracerbulletx wrote: post #52

Is there an app using this for coaching running form, or doing a custom bike fitting? That would be awesome.

There's nothing technically stopping us from doing that even 10 years ago.

MTailor [0] is/was a company that, using your phone camera, could measure you for pants/shorts/shirts/etc... it was a YC company 2014 and also on Shark Tank.

I hope the AI hype brings back some of these sort of use cases that might have been ahead of their time.

[0] https://apps.apple.com/in/app/mtailor-custom-clothing/id8160...

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#65

Post by reaperducer »

Tempest1981 wrote: post #27
CrampusDestrus wrote: post #16

Earlier quoted context omitted.

Seems logical, most people interact with their pets which are mostly cats and dogs. Horses will probably be next

Short-legged pets like hamsters and rabbits might be trickier. vs goldfish, which are easier: the pose is simply "Live" or "Dead".

I am now going to use goldfish for all of my booleans.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#66

Post by rahimnathwani »

tough wrote: post #37
dmix wrote: post #9

Earlier quoted context omitted.

The big question is whether it's even capable of making recommendations like that. You'd have to combine it with your own model. Having read books on strength training and tried to learn stuff like squatting perfectly myself I'm skeptical it could be to grasp the nuance. But for dancing and other stuff where it doesn't matter as much it could be useful (health/safety wise when carrying load).

Could you share some reads?

The standard recommendation for strength training is 'Starting Strength'.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#67

Post by dbtc »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

For a more immediate and quite practical solution, I've had good results from simply taking videos of various movements and watching them right afterwards.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#68

Post by YouWhy »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

Proper disclosure: I had been formerly involved with them.

Try Kemtai.com.

There's a demo section at https://app.kemtai.com/sample-workouts

We took workout experience super seriously, and in my biased view, got it to be a usability joy.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#69

Post by YouWhy »

TL;DR: Good step for the entire market, productization is the harder problem.

I had been formerly involved with Kemtai, which built a fantastic physical therapy/fitness experience (in my biased view) using motion tracking.

If anyone's interested, it is running well and quickly over WebGL on a pretty impressive share of regular phones and laptops across all platforms with WebGL (not just Apple)

My learnings is that the hard part is the productization on top of motion tracking: what constitutes an exercise? What is a "good" performance? How to build the authoring workflow for the many hundreds to low thousands of exercises necessary to reach a typical user base?

In any case, that's awesome news. There are literally billions of people whose condition is going to be better via motion tracking based health and fitness. May it grow there, and quickly!

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#70

Post by supermatt »

mynegation wrote: post #36
supermatt wrote: post #31

Earlier quoted context omitted.

The signal to noise in fitness apps is high. The mainstream ones don’t do this, or if they do the implementation is so bad it’s not worth using, and discovery of anything else is fraught with shitware that wants a subscription to “unlock” it’s unknown potential.

Did you mean to say signal-to-noise [ratio] is _low_? Meaning that you get way too much noise for the amount of signal. Or did you mean to say it needs to be high (I.e. low noise) to be useful?

i did mean low, yes :)
Post reply on HN