Earlier quoted context omitted.
Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it
I already have one running on my phone: https://mlc.ai/mlc-llm/
Installed on my S21, it just crashes whenever opened.