Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

developer.apple.com

Post reply on HN
Print view View original

31–40 of 75 posts

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#31

Post by supermatt »

scottymac wrote: post #25
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand…

The signal to noise in fitness apps is high. The mainstream ones don’t do this, or if they do the implementation is so bad it’s not worth using, and discovery of anything else is fraught with shitware that wants a subscription to “unlock” it’s unknown potential.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#32

Post by nbaugh1 »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There a home gym setup called Tempo that claims to do this. I have the scaled down mobile app version so idk if the full setup is more informative, but it doesn't really give a lot of feedback at all. It basically just tracks the movement of the dumbbell plates that they send you to count your reps, and if you aren't moving the weight to the correct position your rep won't count. It definitely doesn't do anything like correct your form based on your body position like "hey straighten your back" or anything

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#33

Post by [deleted] »

enlyth wrote: post #11
lukko wrote: post #10

Just in case you were wondering, animals seems to be just cats and dogs: https://developer.apple.com/documentation/vision/vnanimalide...

> static let cat: VNAnimalIdentifier This feels funny to read, like from one of those inheritance tutorials on object oriented programming

[deleted]

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#34

Post by layer8 »

Tempest1981 wrote: post #27
CrampusDestrus wrote: post #16

Earlier quoted context omitted.

Seems logical, most people interact with their pets which are mostly cats and dogs. Horses will probably be next

Short-legged pets like hamsters and rabbits might be trickier. vs goldfish, which are easier: the pose is simply "Live" or "Dead".

Schrödinger should have used a goldfish.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#35

Post by pzo »

whywhywhywhy wrote: post #19
lwkl wrote: post #8

Earlier quoted context omitted.

> It’s telling to me that the biggest tech apps of the last 2 years all ran web/desktop first. What are the two apps that you are referring to? No snark just curious. Because the only thing I can think of are video calls or social media (which are arguably older than two years).

ChatGPT, Stable Diffusion. Both web/terminal first. Think 5-8 years ago at least one of them would have been app first.

You already have native chatgpt app by openai. Also Microsoft have integration on native edge browser, SwiftKey keyboard and Bing app.

There are also many mobile stable diffusion apps and even native mobile discord app which is UI for midjourney

And since all those app require a lot of typing or prompt tweaking they where better suited for desktop first

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#36

Post by mynegation »

supermatt wrote: post #31
scottymac wrote: post #25

Earlier quoted context omitted.

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand…

The signal to noise in fitness apps is high. The mainstream ones don’t do this, or if they do the implementation is so bad it’s not worth using, and discovery of anything else is fraught with shitware that wants a subscription to “unlock” it’s unknown potential.

Did you mean to say signal-to-noise [ratio] is _low_? Meaning that you get way too much noise for the amount of signal. Or did you mean to say it needs to be high (I.e. low noise) to be useful?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#37

Post by tough »

dmix wrote: post #9
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

The big question is whether it's even capable of making recommendations like that. You'd have to combine it with your own model. Having read books on strength training and tried to learn stuff like squatting perfectly myself I'm skeptical it could be to grasp the nuance. But for dancing and other stuff where it doesn't matter as much it could be useful (health/safety wise when carrying load).

Could you share some reads?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#38

Post by dingledork69 »

jessekv wrote: post #4
whywhywhywhy wrote: post #3

Earlier quoted context omitted.

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

There are still a few, e.g. https://halide.cam/ But if you are successful, there is a chance of getting sherlocked, so its a risky business model.

> But if you are successful, there is a chance of getting sherlocked, so its a risky business model.

What does this even mean? Watson shows up to help out?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#39

Post by wlesieutre »

dingledork69 wrote: post #38
jessekv wrote: post #4

Earlier quoted context omitted.

There are still a few, e.g. https://halide.cam/ But if you are successful, there is a chance of getting sherlocked, so its a risky business model.

> But if you are successful, there is a chance of getting sherlocked, so its a risky business model. What does this even mean? Watson shows up to help out?

Watson was an independent search application on Mac OS, until Apple basically photocopied it and named theirs Sherlock. Since then it's become a verb for when Apple takes your app and builds it into the OS.

Another blatant example was Dashboard, which copied Konfabulator, Night Shift is a copy of F.lux, etc.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#40

Post by scyzoryk_xyz »

dingledork69 wrote: post #38
jessekv wrote: post #4

Earlier quoted context omitted.

There are still a few, e.g. https://halide.cam/ But if you are successful, there is a chance of getting sherlocked, so its a risky business model.

> But if you are successful, there is a chance of getting sherlocked, so its a risky business model. What does this even mean? Watson shows up to help out?

"Getting sherlocked means that Apple just announced the software, or feature that a developer built their business on."

https://www.howtogeek.com/297651/what-does-it-mean-when-a-co...

Post reply on HN