21–26 of 26 posts
Also: are there conditionals? So you can skip a step/column if not needed, or repeat as many times as needed?
My feedback: approach this problem, solve the problem, then use a technique. Show a repetitive work that someone does, and let the viewer watch machine doing it automatically.
In other words, your aim is right, but knowledge you possess is distracting you to solve it neat and clean.
Your assumption that operations managers will be swiftly replacing their human charges with AI agents indicates that you haven't spent enough time understanding the businesses of your customers. You really need to take a job in one of these roles for several months and spend more time talking to the people whose jobs you intend to automate away with this product, otherwise you're not going to reach people with this.…
Actually the biggest mistake is thinking technology is an optimisation at all.
Many times it's easier, cheaper and faster to do it manually especially when the magnitude or complexity of the work is low. And once a task becomes repetitive the cognitive load on the worker will be orders of magnitude higher with some app or AI agent.
If the probability of an LLM making a mistake = 5% and you have 10 steps then the accuracy of the overall workflow is 60%. Which is useless. Even if we have major advancements in the performance of LLMs and it drops to 1% then still the overall workflow is 90% which is poor.
So what is the plan here ? There is a limit to how many tasks in businesses can tolerate so much inaccuracy.
I still don't understand how multi-step LLM based AI agents work. If the probability of an LLM making a mistake = 5% and you have 10 steps then the accuracy of the overall workflow is 60%. Which is useless. Even if we have major advancements in the performance of LLMs and it drops to 1% then still the overall workflow is 90% which is poor. So what is the plan here ? There is a limit to how many tasks in businesses ca…
First step is collecting incoming emails
Second step is summarizing each one
Third step is batching by issue/severity
Notice how there is tolerance for deviance/error. "An error" looks like coding a ticket red instead of yellow, or slightly misrepresenting what a client said. The overall workflow can still be net positive.
Your assumption that operations managers will be swiftly replacing their human charges with AI agents indicates that you haven't spent enough time understanding the businesses of your customers. You really need to take a job in one of these roles for several months and spend more time talking to the people whose jobs you intend to automate away with this product, otherwise you're not going to reach people with this.…
> and that these people can't see obvious optimizations of their roles because of their lack of coding skills or something. Actually the biggest mistake is thinking technology is an optimisation at all. Many times it's easier, cheaper and faster to do it manually especially when the magnitude or complexity of the work is low. And once a task becomes repetitive the cognitive load on the worker will be orders of magnit…
The hard problems at most companies whose solutions could move the needle the farthest tend to be cultural. Sometimes we make gains in that direction as a side effect of introducing the right technology. Those cases are exceptional: technology is rarely sufficient, and as you say, often not needed in the first place.