I'm surprised that no media outlet is seriously talking about its on-device inference capability, which is the biggest next thing for LLM. Apple did a better job on its PR here, but they didn't also get all the attention that it deserves. On-device inference improves not just its latency, this also removes a huge chunk of LLM's economical constraints from software companies. The biggest advantage of software is its m…
For years, Google has been promising me a high-performance voice assistant. I find that in 2024 it still can't understand "call mom" and "call my wife's name" unless I'm in a perfectly silent environment. And it usually takes several tries. I'm not going to get carried away with technical announcements.
"Play on living room stereo" has been hit and miss for my parents to the point where I regret setting them up with a Chromecast-supporting AV receiver and Google Nest speaker. They now just use the regular remote and listen to the station via FM.