Much like how many people predicted we'd all be driving flying cars, the people predicting that coding will be replaced by AI just isn't realistic. Primarily because these AI models can literally only exist as long as there's humans constantly creating code for it to read (see: steal) in the first place. AI cannot sustain itself trained on AI work. If new languages, engines etc pop up it cannot synthesize new forms o…
> AI cannot sustain itself trained on AI work. This isn’t true. You can train LLMs entirely on synthetic data and get strong results. [0] > If new languages, engines etc pop up it cannot synthesize new forms of coding without that code having existed in the first place. You can describe the semantics to a LLM, have it generate code, tell it what went wrong (i.e. with compiler feedback), and then train on that. For an…
Every AI apology seems to include this statement. It is more likely that LLMs have already hit a local maximum, and the next iterations will provide diminishing incremental returns - if anything at all.