Compliance is usually the hard stop before we even get to capability. We can’t send code out, and local models are too heavy to run on the restricted VDI instances we’re usually stuck with. Even when I’ve tried it on isolated sandbox code, it struggles with the strict formatting. It tends to drift past column 72 or mess up period termination in nested IFs. You end up spending more time linting the output than it take…
Nuances of a codebase are the key. But I guess we are accelerating towards solving that. Let's see how much time will this take.
The prohibitions on other companies (LLM providers) being able to see your code also won’t be going away soon.