Since Apple uses Gemini to power its AI, are those features actually powered by Google Gemini?
They don't get, but they will be using Gemini derived models with iOS 27. For now it's all their own models.
Apple unveils new accessibility features
11–20 of 400 posts
Re: Apple unveils new accessibility features
#12This looks like a genuinely useful application of LLMs. I wish more companies focused on how they can help humans instead of replacing us or squeezing us as hard as possible in the name of productivity.
Its with their servers right? Do they trust a iPhone with their life? Or they are trusting their data center?
Looks like some of the features might use on-device models. They mention subtitle generation works on-device.
Re: Apple unveils new accessibility features
#13I'm super glad that they're doing this, but once again unexcited for another decade of Apple self-privileging on this stuff so they're the only ones allowed to touch or improve any of this surface, or UX outside an app's tiny box.
People talk a lot about how MacOS has gone downhill but I feel like it would have been a good start if developers could continue to patch over Apple's shortcomings like they used to be able to.
I imagine that we would be a few years into a spectrum of tools like this if they didn't lock it down like they do.
Totally aware that plenty of HN commenters are very glad that Apple keeps this locked down. I'm just the other opinion, that's all.
Re: Apple unveils new accessibility features
#14On-device video subtitles generation is exciting, should help with watching videos on mute. This seems like a low hanging fruit that should've already been grabbed by an app but I can't find any.
Re: Apple unveils new accessibility features
#15Fun fact: This video was made accessible to sighted people because no blind person would ever listen to voice at that speed. Honestly if you ever observe a blind person using computers you'd impressed how they can listen to audio at unimaginable speeds.
dont you worry, as a sighted person I am also infuriated by apples slooow reading speed, e.g. for "Announce Notifications".
Re: Apple unveils new accessibility features
#16Accessibility features are such a great way to keep technology focused on real-world problems and real-world experiences.
I think the trap in creating anything is doing it for a crowd. Art, software, anything... it turns out better when it is made with a specific, named individual in-mind.
Accessibility features are almost always championed and field-tested with one specific loved one in mind and I think that's what keeps the technical solutions personable and grounded.
Re: Apple unveils new accessibility features
#17This looks like a genuinely useful application of LLMs. I wish more companies focused on how they can help humans instead of replacing us or squeezing us as hard as possible in the name of productivity.
I agree. There seems to be a lot of potential in this space (from my outsider view). I really hope that this issue from an earlier article (https://news.ycombinator.com/item?id=48178378) doesn't become common enough to make useful functionality like this a danger. Seems unlikely in the short term but as use cases grow, so might the bad actors.
Re: Apple unveils new accessibility features
#18Fun fact: This video was made accessible to sighted people because no blind person would ever listen to voice at that speed. Honestly if you ever observe a blind person using computers you'd impressed how they can listen to audio at unimaginable speeds.
> Honestly if you ever observe a blind person using computers you'd impressed how they can listen to audio at unimaginable speeds.
Even better, fire up Orca (or whatever screenreader application your OS comes with) yourself and try to use your computer while shutting your eyes, kind of eye-opening (no pun intended) what kind of experience these sort of users typically get. And also, you quickly start to understand why they set the speech rate for their voice synthesizer to be so fast, it's almost unbearable navigating applications (and particularly lists) otherwise.
Re: Apple unveils new accessibility features
#19This looks like a genuinely useful application of LLMs. I wish more companies focused on how they can help humans instead of replacing us or squeezing us as hard as possible in the name of productivity.
I think we should reserve judgment until this lands in the hands of the people it helps.
My experience is limited to my elderly parents who have trouble seeing. With the text size Apple allows them to set it to, their phones are unreadable. Text runs off the screen in every app, 1st and 3rd party.
In their bill example, the user is told to confirm with the provider. Why not offer to call the number on the bill? Instead of telling them to use text detection, do it for them? Presumably Apple Intelligence would already have that capability. I’m afraid this will be a gimmick at best.
EDIT: Forgot to mention, the grip is good to see. Hopefully they don’t charge the apple tax on it.
Re: Apple unveils new accessibility features
#20> The total amount due on the bill is $83.89. Please verify this amount with your utility provider or by using Text Detection before making a payment. 1. Use AI to determine how much a bill is for 2. Call up the people who billed you and ask them how much they billed you 3. Pay billed amount
It’s still useful to get the information instantly and verify it later. Arguably asking someone you trust to read the number for you might be a better idea than calling the company. Not everybody has that option though.
And not everybody wants to use that option all the time. Asking a human makes you feel dependent more than using a tool does.