Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

developer.apple.com

Post reply on HN
Print view View original

41–50 of 75 posts

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#41

Post by ladberg »

wlesieutre wrote: post #39
dingledork69 wrote: post #38

Earlier quoted context omitted.

> But if you are successful, there is a chance of getting sherlocked, so its a risky business model. What does this even mean? Watson shows up to help out?

Watson was an independent search application on Mac OS, until Apple basically photocopied it and named theirs Sherlock. Since then it's become a verb for when Apple takes your app and builds it into the OS. Another blatant example was Dashboard, which copied Konfabulator, Night Shift is a copy of F.lux, etc.

Technically Sherlock predates Watson, it's just a lot of the useful additional features added by Watson were copied to Sherlock.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#42

Post by wlesieutre »

ladberg wrote: post #41
wlesieutre wrote: post #39

Earlier quoted context omitted.

Watson was an independent search application on Mac OS, until Apple basically photocopied it and named theirs Sherlock. Since then it's become a verb for when Apple takes your app and builds it into the OS. Another blatant example was Dashboard, which copied Konfabulator, Night Shift is a copy of F.lux, etc.

Technically Sherlock predates Watson, it's just a lot of the useful additional features added by Watson were copied to Sherlock.

Ah you're right, it was Sherlock 3 that copied the Watson features. Mostly related to searching the web for things like ebay listings, recipes, stocks, software.

So the Watson name was probably inspired by Apple's from previous versions, but the Sherlock 3 feature set definitely got cloned from Karelia's.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#43

Post by itake »

(feel free to correct me if I am wrong), but my main gripe against mobile ML frameworks (Android too) is they require the app to embed the ML model with the app (as opposed to the OS storing the model like a shared library).

People with limited storage on low-end device don't have enough memory to store the apps.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#44

Post by paisawalla »

scottymac wrote: post #25
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

There are multiple apps in the App Store that do this. I spent last year implementing pose detection in an exercise app and we used both Apple’s pose detection and a 3rd party’s. The pose (each point of the human form) itself was sent to a machine learning backend at around 30 fps, analyzed, and data returned at about the same speed using gRPC. Each exercise had a set of specific feedback for both positioning (“Stand…

Can you name the app?

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#45

Post by kemayo »

whywhywhywhy wrote: post #3
lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

The “there’s an app for that” world where small to medium sized teams can build a very iOS native app that takes advantage of the latest and greatest of the device is long gone. It’s kinda weird how Apple doesn’t realize this and continues to build for that world. Maybe if they were willing to shift on their % for devs that do build that way but unless they did there just isn’t the audience buying apps outright and t…

> Until then no idea why any dev would build just for the Apple ecosystem and not something agnostic.

The standard reason given is that iPhone users are much more valuable than Android users, in that they're a lot more likely to pay for things. If I'm creating a workout app with a fancy form-correction feature then I might well want to use Apple-platform things that make it quicker to develop, at the cost to me of only slightly restricting my actual market.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#46

Post by porcoda »

yyyk wrote: post #21
lukko wrote: post #18

Earlier quoted context omitted.

Can download an Xcode project and view documentation here: https://developer.apple.com/documentation/vision/detecting_a...

Thanks. Where can we find bindings for other non-Swift languages? Or does the 'embedding for 27 lang' in the title refer to 'human language recognition' and not 'programming language binding'?

Given that the talk about 27 languages is about natural language processing, you can probably figure out the answer.

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#47

Post by rickguru »

lgrebe wrote: post #2

I remember when pose detection was announced, showing an app that corrected your workout movements. i have yet to see an app that actually does that. i'd love to have the equivalent of a personal trainer showing me where i need to adjust my pose in say pushups or other simple excercies. thus im equally sceptical of seeing these apis used. it seems developers are mostly porting web apps to all platforms ignoring neat…

Hey, I'm the founder of Guru (https://getguru.ai/), a video AI dev platform. Developers are using our movement APIs to build some cool form feedback apps, including NFL coaches.

- Demo: https://www.formguru.fitness/video/c96fa975-fd9e-4912-8f60-1...

- Blog: https://blog.getguru.ai/guru-sports-powering-the-top-prospec...

- Customers: https://www.cadoo.io/, https://www.breakawaydata.com/, https://pharosfit.com/, https://www.producthunt.com/posts/fitx.

We've trained our own models (and customers can finetune them), but it exports cleanly to iOS (and Android!).

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#48

Post by yyyk »

porcoda wrote: post #46
yyyk wrote: post #21

Earlier quoted context omitted.

Thanks. Where can we find bindings for other non-Swift languages? Or does the 'embedding for 27 lang' in the title refer to 'human language recognition' and not 'programming language binding'?

Given that the talk about 27 languages is about natural language processing, you can probably figure out the answer.

Ok, this was buried behind a few links from the linked page (can't one link directly?). Here's the actual presentation - which is not available yet:

https://developer.apple.com/videos/play/wwdc2023/10042

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#49

Post by heliophobicdude »

heliophobicdude wrote: post #20

I would be interested to know of a consistent, on-board embeddings model. Trying to reduce latency and dependence on API calls for simple vector database search will go a long wag

Turns out they have already [1]

https://developer.apple.com/documentation/naturallanguage/nl...

Re: Apple releasing segmentation/pose for humans and animals, embedding for 27 lang

#50

Post by SuperShibe »

mynegation wrote: post #36
supermatt wrote: post #31

Earlier quoted context omitted.

The signal to noise in fitness apps is high. The mainstream ones don’t do this, or if they do the implementation is so bad it’s not worth using, and discovery of anything else is fraught with shitware that wants a subscription to “unlock” it’s unknown potential.

Did you mean to say signal-to-noise [ratio] is _low_? Meaning that you get way too much noise for the amount of signal. Or did you mean to say it needs to be high (I.e. low noise) to be useful?

For every good fitness app that does what it promises (-> signal) there are at least 50 bad fitness apps that promise too much and let you pre-pay for the (broken) features you wanted, money you'll never get back (-> noise).

The amount of noise in Fitness apps is so high, nobody really dares to try out small apps. Therefore cool implementations from small devs like the workout-correction might stay unnoticed for years.

Post reply on HN