Neat. Is my phone classifying all this stuff, or is it sending all my photos to some Apple server to do it? I watched the video in the OP but it didn't go into any technical details.
Apple Support: How to hear image descriptions in the Camera app
31–40 of 52 posts
Re: Apple Support: How to hear image descriptions in the Camera app
#32Neat. Is my phone classifying all this stuff, or is it sending all my photos to some Apple server to do it? I watched the video in the OP but it didn't go into any technical details.
Re: Apple Support: How to hear image descriptions in the Camera app
#33Neat. Is my phone classifying all this stuff, or is it sending all my photos to some Apple server to do it? I watched the video in the OP but it didn't go into any technical details.
Re: Apple Support: How to hear image descriptions in the Camera app
#34The descriptions are shockingly detailed. I wish there was a way you could add these descriptions to the metadata of all the photos in your library, it would be an amazing way to add rich searchable data. In particular, asking Siri to "show me photos of " where x is a thing that the photo descriptions does recognize, doesn't always work.
Re: Apple Support: How to hear image descriptions in the Camera app
#35Neat. Is my phone classifying all this stuff, or is it sending all my photos to some Apple server to do it? I watched the video in the OP but it didn't go into any technical details.
I don't know of any ML stuff that Apple does serverside. That is why they have invested so much in ML processing on their devices.
Re: Apple Support: How to hear image descriptions in the Camera app
#36I tried to get Voice Over working but scroll broke once enabled. It says three fingers to scroll but that just won't work for me.
Re: Apple Support: How to hear image descriptions in the Camera app
#37Sound recognition is also another very cool accessibility feature: https://www.loopinsight.com/2021/05/11/apple-support-how-to-... Though I'm not sure if it comes at the cost of increased battery usage.
Re: Apple Support: How to hear image descriptions in the Camera app
#38Re: Apple Support: How to hear image descriptions in the Camera app
#39The YouTube channel by Kristy Viers has been helpful in understanding how they use an iPhone and other devices. Here’s a video on VoiceOver in the Camera app: https://youtu.be/8CAafjodkyE
Re: Apple Support: How to hear image descriptions in the Camera app
#40Neat. Is my phone classifying all this stuff, or is it sending all my photos to some Apple server to do it? I watched the video in the OP but it didn't go into any technical details.
I don't know of any ML stuff that Apple does serverside. That is why they have invested so much in ML processing on their devices.
Maybe its still too power hungry to run locally? Maybe they still need the data from the requests server side to improve the model?
I hope both Siri and Maps, and especially their integration, i.e. "Siri navigate to ____." "Siri find restaurants nearby (or along the way)" works on device in the near future. Its annoying for the CarPlay integration to stop working when you're in a remote area and need the navigational help.
[1] https://appleinsider.com/articles/18/11/15/apple-considering...