Well PocketBot won't be AI related in a few years. We're using AI with it's only job being to eliminate itself. Automations, using a single simple prompt, fully private, with a massive user created library (~1000 testers so far). People create automations - our LLM makes a template out of it -> goes to our shared user library -> when someone asks for an automation we check if it already exists and if so then deterministically adjust it for their use. If no automation exists then request sent to our Tier 2 LLM which creates it. Maybe not exactly what you wanted to hear, I am just excited about our idea...
Edit: Sorry missed the most important point. So the more users and the bigger this library gets, the less LLM usage we have, until eventually we are able to run almost fully deterministic.