New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
1–10 of 34 posts
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#2If you're interested in this concept, it's not new and the alarm has been sounded since the android Facebook app required motion sensor permissions in android 4.
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#3Something to note here that annoys me about the title is that the LLMs aren't taking in the raw data (LLM's are for text, after all). The raw data is fed through audio and motion models that then produce natural language descriptions, that are then fed to the LLM.
Unrelated: yeah, this article is a little creepy, but damn is it interesting technically.
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#4AI will finally allow us to bring 1984's Telescreens into existence, at scale.
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#5If you're interested in this concept, it's not new and the alarm has been sounded since the android Facebook app required motion sensor permissions in android 4. https://par.nsf.gov/servlets/purl/10028982 https://arxiv.org/pdf/2109.13834.pdf
> alarm has been sounded since the android Facebook app required motion sensor permissions in android 4.
Serves as a useful reminder that just because someone may not care if these companies collect this data now, they are storing it, sometimes indefinitely, and as technology advances, will be able to make more use of it than they were at the time you agreed to share it with them.
It's like all the ransomware gangs hoarding the encrypted data they stole, waiting for a quantum computing breakthrough to be able to decrypt it.
Not sure what to do about it, if anything, but the average person is severely under-equipped and undereducated to deal with this and protect themselves from the levels of surveillance that are soon to come.
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#6Time to ditch the Apple Watch then
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#7AI will finally allow us to bring 1984's Telescreens into existence, at scale.
Doesn't the smartphone already far surpass the Telescreen's capabilities and presence? It does more and we carry them in our pockets.
Do people not realize we're beyond 1984? In 1984 the tech wasn't always listening, rather it had the capacity to. Much of it was about how not knowing meant you'd act as if you were just in case. It was making reference to totalitarian states where you don't know if you can freely talk to your neighbor or if they'd turn you in, where people end up creating a double speak
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#8Time to ditch the Apple Watch then
One more positive interpretation of Apple's research interests here is that devices like the Watch can better differentiate between "the wearer just fell and we should call 911" and "the wearer is playing with their kids".
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#9Why do you need LLM to interpret patterns?
Re: New Apple Study Shows LLMs Can Tell What You're Doing from Audio and Motion Data
#10Maybe the 2026 Apple Watch will be able to auto detect running as reliably as my 2015 Samsung Gear S2. My 2022 Series 8 is certainly not there yet.