Live data from Hacker News

OpenAI now tries to hide that ChatGPT was trained on copyrighted books

businessinsider.com

91–94 of 94 posts

Re: OpenAI now tries to hide that ChatGPT was trained on copyrighted books

#91

Earlier quoted context omitted.

false analogy. if openai is downloading and copying and distributing copyrighted material internally and then compressing that information into a model that can reproduce it later and selling access to that model that is a very different thing.

What if I just make a robot to go to public library and book store and then OCR everything, would it make a difference? Again there is no "compression of information" in deep learning.

> there is no "compression of information" in deep learning

i would strongly disagree. when you are training a model you are taking the information from a document and extracting the relationships between tokens and storing that information conglomerated with the same information from a massive amount of other documents. the model that results is a compressed form of all of the information from all of the documents where you have extracted and stored a synthesis of the relationships between the tokens in all of them. this is a lossy compression, but it does reproduce exact sequences of source documents in some cases, so the original information is stored there.

you can very plausibly argue that an LLM model trained on copyrighted material violates the copyright on every single copyrighted document that was fed to it.

Re: OpenAI now tries to hide that ChatGPT was trained on copyrighted books

#92
post #29

Earlier quoted context omitted.

And (most) people buy those copyrighted books.

Libraries exist. Borrowing books from a friend exists. Even if you stole the book, using the knowledge you learned from it to make money is not copyright infringement. If you steal a book about how to make money flipping houses and then start flipping houses, at worst you are on the hook for a minor theft. The author can't sue you for illicitly learning to flip houses from the stolen book. That is just not how that w…

The library is allowed to lend out books, they're not producing copies. I can lend you a book without producing a copy. I can steal a book without making a copy. I can learn from a book without making a copy.

ChatGPT was trained by copying works into a dataset and using that for commercial purposes. Surely you can see how that's different.

Re: OpenAI now tries to hide that ChatGPT was trained on copyrighted books

#93
post #55
post #44

Earlier quoted context omitted.

I am not saying that using knowledge is a copyright violation. Sorry but I think we're talking past each other. Inputting entire books verbatim into a model is not the same as a human learning a fact and using it later.

The book does not exist verbatim within the model. You cannot open the model and find the full text of some copyrighted work anywhere. The model just trains a set of weights for a neural network, then probabilistically generates text in response to prompts. And yeah, humans "input entire books verbatim" (aka, reading) and then regurgitate that knowledge later when they determine it is likely to be an appropriate resp…

The point the above poster is making is that copying a book into a training set is the copyright violation, the model using the trained weights to make an inference is not.

Re: OpenAI now tries to hide that ChatGPT was trained on copyrighted books

#94

Earlier quoted context omitted.

Could you explain the five basic plots? While the number of plot structures are fairly countable, a plot can still be considered different by changing part of its contents (character, setting, etc.). The decision on whether a plot outright infringes on an existing plot varies case-by-case. An example of outright copying is "Fistful of Dollars" directed by Sergio Leone, which lifts the plot from "Yojinbo" by Akira Kur…

1. David vs. Goliath 2. Romeo and Juliet 3. Robin Hood 4. Crime and Punishment 5. maybe there are only four.

Interesting. Is there a consensus of these story archetypes among writers?
Post reply on HN