Earlier quoted context omitted.
> Published content will be later used to train subsequent models, and being able to distinguish AI from human input may be very valuable going forward Every discussion on AI take the example of ChatGPT and its inherent flaws but AI-generated content doesn't have to be dull and low quality. One question that bother me is does it really matter? If AI-generated content is on par with Human-made or even better does it m…
I don't think AI has to be low-quality for GP's concern to be valid. Humans get inputs from a large variety of sources, but if an AI's input is just text, then there's the potential for AI's input to mostly consist of its prior output. Iterate this, and its model could gradually diverge from the real world. The equivalent in human society is groupthink, where members of a subgroup get most of their information from t…
AI is often limited in ways we aren't, but it also trivially consumes more than we can in a lifetime.
"Just text" in the case of GPT-3, but also it is trained on a token count exceeding the number of times an average synapse in a human brain will fire in a lifetime.
It can still get biases from the training set; while I'm not sure if "group think" is quite the right phrase, it does seem to "want" everyone to get along even when asking it to create multiple characters engaged in a conflict. (Or perhaps that's just an artefact of it estimating that I want that). Reminds me — in a bad way — of Jules Verne's From The Earth to the Moon.