It's interesting to compare two scenarios. The first is if you feed an LLM solely the works of a famous current author, say J.K Rowling, and ask it to create a new work in the style of her franchise. The second is if you include all of her works but also throw in every other book written in the last several years and ask it to create a work in the style of her franchise. Is the latter somehow "better" than the former…
In that case, is that difference here that it's not humanely possible to train on world's information compared to a single human getting inspired by specific works. And hence an algo doing that is violation?