> We find that indiscriminate use of model-generated content in training causes irreversible defects in the resulting models The key word there is "indiscriminate". All of the big AI labs have been training on synthetic data for at least a year at this point, but they're doing so deliberately. I don't think the "model collapse" problem is particularly important these days. The people training models seem to have that…
" The people training models seem to have that well under control." The people training the models are not the C-Suite, and that is an element of entropy there is currently zero accounting for.