I have asked AI on multiple occasions to take items from some input and output a table, or a json structure and every time it has simply skipped or ignored several items from the input for no reason. This sounds like a terrible idea, and nearly impossible to debug when it inevitably drops data.
Yeah, we’ve seen that too. Raw AI output isn’t reliable enough for high-stakes data work.
That’s exactly why we don’t let AI run migrations. We use it to speed up the boring parts, like mapping table structures. But humans are always in control.