I think this is probably a good thing. It’s not just public services, but any company that consumers have to deal with (in ways they don’t want to). Historically, only those with the most time, money, connections, and education have been able to extract benefits from these systems. E.g., if someone wants to fight an insurance claim being denied, they might need to hire an expensive lawyer or spend hours performing th…
A higher fraction of money going into the system is lost to navigating adversarial processes. And probably the occasional person getting in legal trouble for not validating their LLM output before feeding it to a formal process.
For customer-funded things (eg home insurance), this means higher prices for the same in-practice benefits (as distinct from nominal benefits; any gap between nominal and actual benefits will probably end up smaller).
For publicly-funded things (government benefits), this could show as increased budgets for the same result or decreased results on the same budget.
.
> So I suspect this will lead to a much more formally rigorous system with various “certificates” proving, e.g., that you lost your job or that a doctor has confirmed you have a disability.
Well, maybe standardization of how employers or doctors or whoever are required to report things to the government.