Earlier quoted context omitted.
This comment is odd. I wouldn't say it is misleading, but it is odd because it borders on such definition. > Apple's AI strategy is to put inference (and longer term even learning) on edge devices This is pretty much everyone's strategy. Model distillation is huge because of this. This goes in line with federated learning. This goes in line with model pruning too. And parameter efficient tuning and fine tuning and pr…
Everyone’s strategy? The biggest players in commercial AI models at the moment - OpenAI and Google - have made absolutely no noise about pushing inference to end user devices at all. Microsoft, Adobe, other players who are going big on embedding ML models into their products, are not pushing those models to the edge, they’re investing in cloud GPU. Where are you picking up that this is everyone’s strategy?
Re: Apple introduces M4 chip
#10018 days after this comment, Google announced Gemini Nano local inference for Chrome.