Earlier quoted context omitted.
Amazon has been working on on-device voice for a while. Actually everyone is trying to do that. Running large speech models in the cloud is expensive, considering the number of devices, they probably need more than "surplus" :) https://www.amazon.science/blog/on-device-speech-processing-...
It could certainly rack up a big bill. This is also part of the work that Apple has done (and is likely part of the making Siri cost less for cloud compute). https://www.macrumors.com/how-to/use-siri-offline-ios/ > In iOS 15, Apple moved all Siri speech processing and personalization onto your device, making the virtual assistant more secure and faster at processing requests. This also means Siri can now handle a ran…
i just wanted to share my 2 cents, as it's not unique to Apple and the cloud can be costly even if you own it. Big tech has been investing in on-device for a while. besides voice commands, apple and google do transcription locally too. because now you can have local speech to text with cloud level accuracy and of all the reasons you shared - cost, privacy, latency etc. (but again, i'm biased)
https://www.androidauthority.com/voice-typing-opinion-322134... https://techcrunch.com/2022/05/17/apple-adds-live-captions-t...