Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

developer.apple.com

Post reply on HN
Print view View original

21–30 of 75 posts

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#21

Post by yyyk »

lukko wrote: post #18
yyyk wrote: post #14

Where are the actual bindings? Linking to a page with lots of long videos that are mostly not available (it says "Available on June 6" (or 7,8,9) with a editorialized title that is not even on the page is below HN standards.

Can download an Xcode project and view documentation here: https://developer.apple.com/documentation/vision/detecting_a...

Thanks. Where can we find bindings for other non-Swift languages? Or does the 'embedding for 27 lang' in the title refer to 'human language recognition' and not 'programming language binding'?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#22

Post by mbork_pl »

madsbuch wrote: post #12
mbork_pl wrote: post #7

Earlier quoted context omitted.

> I would be weird to have your social app trying to correct your pose ;) It would be less weird for it to call home so that Z*ck knows to serve you ads for painkillers for your spine...

This comment seems to be unrelated to the subject. Is there a specific reason you mention it (along with the down vote I take is also from you, given your passive aggressive tone)? The latent point is that most applications don't need specific APIs for their value propositions, why it would not make sense to write them in a native framework that enables these APIs.

> Is there a specific reason you mention it (along with the down vote I take is also from you, given your passive aggressive tone)?

Yes, the reason is I considered it funny. Sorry if that didn't work.

Also, I didn't downvote your comment, but I just upvoted it to compensate for someone who downvoted you, seemingly without a good reason – at least I agree with it.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#23

Post by Someone »

whywhywhywhy wrote: post #3
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

> It’s kinda weird how Apple doesn’t realize this and continues to build for that world.

If you’re a hardware manufacturer, I don’t think building for the common denominator of the web browser is a viable strategy. Looking at various of their competitors, it certainly brings in less money.

How many people would buy an iPhone that’s basically a “browser device” if, for 50% of its price, they could get something that’s 80% as good (percentages for illustration purposes)?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#24

Post by unstatusthequo »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

https://www.zerapy.ai/

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#25

Post by scottymac »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand facing the camera with you arms at your side/Stand sideways to the camera/etc”) and form correction (“Raise your right arm higher above your head etc”). Feedback was spoken out loud to the user and there was a relatively complex set of rules governing which feedback got priority and how often feedback was spoken. I also implemented an on-screen “skeleton” of the user’s human form points that rendered on top of the camera view. Pretty fun project from a tech point of view.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#26

Post by actualwitch »

codeflo wrote: post #13
whywhywhywhy wrote: post #3

Earlier quoted context omitted.

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

It's not just the machine learning stuff, they have a non-portable approach for everything, including the platform's primary programming language. They still seem to live in a world where a significant niche of developers targets Apple platforms and their bespoke APIs only. The problem with that world view is that (a) everything with a network effect can't target a single platform anymore, and (b) the business model…

They are relying on people looking into spending statistics by platform and realizing that if they want those sweet sweet $$$, they are forced to deal with apple and their walled garden.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#27

Post by Tempest1981 »

CrampusDestrus wrote: post #16
lukko wrote: post #10

Just in case you were wondering, animals seems to be just cats and dogs: https://developer.apple.com/documentation/vision/vnanimalide...

Seems logical, most people interact with their pets which are mostly cats and dogs. Horses will probably be next

Short-legged pets like hamsters and rabbits might be trickier.

vs goldfish, which are easier: the pose is simply "Live" or "Dead".

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#28

Post by smugma »

scottymac wrote: post #25
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand…

What’s the best app you’ve tried?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#29

Post by SoftTalker »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

So hire a personal trainer for a session or two?
Post reply on HN