The basic problem here for Apple is that LLMs will never actually be able to avoid prompt injection issues, and the entire "personal awareness" set of functionality they're trying to make uses LLMs. Unless somebody at Apple invents a new state of the art, it's not going to happen. With that said, I'm surprised they haven't yet at least replaced the 'dumb' Siri commands with something that's effectively an LLM transla…
I’m not sure I want / need an LLM for the handful of basic commands I want Siri to do in the car with no complication. Siri is good at some straightforward command patterns. And that’s how users have been trained. Adding an LLM feels like a solution looking for a problem
“Siri, drive to ” → “Now driving to .”
“Siri, send a message on .” → One of _two_ responses (seems random): “Sorry, I can't do that while you're in the car” OR “What would you like to say to ?”
“Siri, play ''.” → “Now playing .”
“Siri, remind me when I get home to .” → “Sorry, I don't have your address.” (My contact information, with complete address, is in my Apple Contacts, and set as my card.)
The list goes on. It's actually become somewhat of a game for my wife whether Siri will actually complete a given request.