Idk, the models generating what are basically 1:1 copies of the training data from pretty generic descriptions feels like a severe case of overfitting to me. What use is a generational model that just regurgitates the input? I feel like the less advanced generations, maybe even because of their limitations in terms of size, were better at coming up with something that at least feels new. In the end, other than for co…
So I train a model to say y=2, and then I ask the model to guess the value of y and it says 2, and you call that overfitting? Overfitting is if you didn't exactly describe Indiana Jones and then it still gave Indiana Jones.
It didn't though, it just spat out what is basically a 1:1 copy of some Indiana Jones promo shoot. No where did the prompt ask for it to look like Harrison Ford.