I'm surprised that no media outlet is seriously talking about its on-device inference capability, which is the biggest next thing for LLM. Apple did a better job on its PR here, but they didn't also get all the attention that it deserves. On-device inference improves not just its latency, this also removes a huge chunk of LLM's economical constraints from software companies. The biggest advantage of software is its m…
For years, Google has been promising me a high-performance voice assistant. I find that in 2024 it still can't understand "call mom" and "call my wife's name" unless I'm in a perfectly silent environment. And it usually takes several tries. I'm not going to get carried away with technical announcements.
I travel a lot and often find myself in areas with poor or no connectivity, and things "get a little freaky" in those scenarios. Even things like Google Maps (which has downloaded/offline mode) often fail or spin for 30 seconds. I think Google/Android engineers don't test these scenarios enough (or at all), and they're usually bathed in perfect connections.