Could Versus Should: How Operators Decide What AI Should Automate
Insights from senior operators across customer service, regulated devices, and operations on automation value, human-in-the-loop design, and prompt reliability.
Source: ZAI Operator Advisory Session · September 4, 2026
Operators are converging on a human-first view of automation: automate for speed and friction reduction, but judge every task by value, risk, and its place in the whole customer journey.
Senior operators across customer service, regulated devices, and operations shared a shared discipline about where AI belongs. The strongest theme was human-first automation. One operator argued that cutting email response times from long delays to seconds beats customer-facing chatbots, which do not improve engagement. Several warned that the question has shifted from could to should, since automating a process is not the same as improving it. In regulated medical devices, one advisor confined AI to reporting and documentation, with human testing still mandatory. Another cautioned that a customer's single experience masks many internal systems, so automating one step in a chain can strip value from the whole. The practical answer offered was to dimensionalize tasks by knowledge base, time to complete, and risk, then automate the longest and least risky work first while keeping humans in the loop elsewhere. Operators also flagged a reliability problem: the same prompt yields different results across user groups, so consistency requires testing and skilled analysis. Taken together, these operators are not chasing full automation. They want AI to reduce friction, centralize fragmented information for frontline advisors, and free people for the emotional and complex cases that matter most. Executives should measure baseline response times, add a value test to automation proposals, map full process chains before acting, and build prompt-testing skills. The gap between what can be automated and what should be is where the real decisions live.
Read the full intelligence
The full 6 signals with prevalence and trend, the risk dashboard, the industry breakdowns, and the actions are for owners of the Agents & Automation topic. Own it for $395, or get everything for $1,495.