Live data from Hacker News

Japan’s government will not enforce copyrights on data used in AI training

technomancers.ai

261–270 of 426 posts

Re: Japan’s government will not enforce copyrights on data used in AI training

#261
post #200

Earlier quoted context omitted.

You could still plausibly generate (a significant portion of), let's say, "Fire And Ice" by Robert Frost, which is only 50 words. See also: https://blogs.harvard.edu/ethicalesq/haiku-and-the-fair-use-...

If I were the copyright holder of such work, I would argue that the LLM was trained on text, including my copyrighted work, and that if the system produced text that a reasonable person who reads poetry would identify as the copyrighted work, the burden is then logically on the LLM owner to prove the LLM didn't regurgitate a piece of text from something it previously ingested. I think a jury would side with my argume…

The issue isn't that a generator lets you evade copyright somehow; it doesn't. The output is not the issue. If I sit in paint and my assprint happens to perfectly duplicate a Picasso, that's unlikely to fly in court if I try to sell copies. Picasso painted it first.

The point at issue here is that some people are arguing that the models themselves are like a giant collective copyright infringement, since they are in a vague sense simply a sum of the copyrighted works they were trained on. Those people would like to argue that distributing the models or even making use of them is mass copyright infringement. My thought experiment is a reductio ad absurdum of that reasoning.

Re: Japan’s government will not enforce copyrights on data used in AI training

#263
post #230
post #80

Earlier quoted context omitted.

Conflating training a model with human learning is wrong. When training a model you are deriving a function that takes some input and produces an output. The issue with copyright and licensing here is that a copy is made and reproduced numerous times when training. The model is not walking around a museum where it is an authorized viewing. It is not a being learning a skill. It is a function. The further issue is tha…

> When training a model you are deriving a function that takes some input and produces an output. The issue with copyright and licensing here is that a copy is made and reproduced numerous times when training. How's that any different from what happens inside a human's brain when learning? > The model is not walking around a museum where it is an authorized viewing. The training data could well be from an online muse…

It is different from a human brain in that it is not a human brain. It is a statistical function that produces some optimized outputs for some inputs.

I have made no mention of things being authorized in public. In the US you are allowed to take a photo of anything you want in public. These models are not being trained on datasets collected wholly in public though, it is very insidious to suggest that they are.

The internet is not "the public". It is a series of digital properties that define terms for interacting with them. Now, a lot of material is publicly accessible online, but that does not mean that it is not still governed by copyright. For example, my code on Github is publicly accessible, but that doesn't mean you can disregard the license.

If you use this copyrighted material to produce a product for commercial gain you will likely face a fair use test in court. If you use it for a non-commercial cause with public benefit you could probably pass that fair use test. Open source will do very well because of this.

The model is not a human though, and very often these are not "public" works that it is trained on.

Re: Japan’s government will not enforce copyrights on data used in AI training

#264
post #113

> With the effective implementation of AI, it could potentially boost the nation’s GDP by 50% or more in a short time. Err.. No, it won't. That's a ridiculous, laughable statement. Japan 2022 GDP: $4.1 Trillion Amazon 2022 Revenue: $513B Google 2022 Revenue: $279B Microsoft 2022 Revenue: $198B So even growing a brand new Amazon, Google and Microsoft in "a short period" would be insufficient to grow GDP by 50%

Comparing the revenues of tech companies to the gdp of a country, even to give a sense of scale is comparing apples to oranges. Even if a bit unlikely, I would not be completely surprised if the service industry as a whole produced twice the value its produces today thanks to AI in the next 20/30 years. Not to mention the productivity gains in other sectors.

Company revenue is probably the closest analogy of a country's GPD though. It's a rough measure of the money circulating in the company/country.

And GPD made us of: "goods and services produced for sale in the market..." which is fairly roughly the sum of all companies' revenue.

> I would not be completely surprised if the service industry as a whole produced twice the value its produces today thanks to AI in the next 20/30 years.

Sure. 20/30 years is Google's age so make sense.

I don't think 20 years is particularly short term though and 30 years certainly isn't.

Re: Japan’s government will not enforce copyrights on data used in AI training

#265
post #184

I testified to the US Copyright Office this morning on AI in their roundtable session on AI and music[1]. A good portion of the focus of this panel was on whether copyrighted inputs (in this case, sound recordings and musical compositions) being fed into AI models for training purposes could plausibly constitute a fair use under existing US copyright law. Some of the comments here are missing the context of the recen…

AI training has nothing to do with copyright as it currently exists. Someone has access to a boatload of IP (because it was made publicly available) and trained a neural net with it. Now you want to retroactively create restrictions on what the implicit public rights were. Traditionally the implied license was something like you can't republish, redistribute, or use commercially, even though restriction on private redistribution hasn't been possible to enforce since the internet era. Now you want more restrictions.

If someone generates an image that's sufficiently similar to a copyrighted work, and publishes it in a way that violates fair use, you can send a takedown and potentially sue them. How the image was created doesn't matter, any more than it would matter whether Warhol had been able to scan the photo and then manipulate it in photoshop to get that result, instead of artistically copying it by hand. The result is the same. The potential for copyright infringement is the same, because it's the derived work that matters, not the process.

What you're attempting to do instead is the equivalent of trying to regulate scanning because it operates on copyrighted works.

I suspect you understand why you want to regulate AI training rather than regulate its output. I think you know AI is going to flood the market, currently certain types of images and simple music, but soon photorealistic portraits, complex music, and eventually video and even more complex works. Essentially all of those works will be clearly novel, not close to existing human-created works. They won't be copyright violations, so you have to cut this tech off at the knees and feed the blood mouse [1] by retroactively deciding that AI training is a violation of the implied license granted when people make their creations publicly accessible. Those AI creations will destroy most of the market for human-created works, and you can't have that.

I don't think many people, other than rightsholders, desire the IP dystopia your desired policy would create, which is holders of large archives of IP churning out endless AI-generated content (which no doubt they'll want to be able to copyright, contra the copyright office's current guidance), while preventing most competition by others who won't have a sufficient library of the right flavor of IP to train an AI model.

[1] https://www.youtube.com/watch?v=5pIVVpoz5zk

Re: Japan’s government will not enforce copyrights on data used in AI training

#266
post #43
post #22

Earlier quoted context omitted.

There's no difference between an art student looking through a museum or archives for ideas and an AI using the material for training. Same could be said for reading. A medical student reading through textbooks or a writer who reads is essentially what an AI is doing. You can ask an art student to create something in a certain style. You can get writes to write in a certain style. Equivalent.

AI models will make 1:1 copies of training data where artists try and avoid doing so. It’s common to obscure this copying by intentionally inserting lossy steps, but making an MP3 isn’t a new work. It’s most obvious when large blocks of text are recreated, but the core mechanism doesn’t go away simply because you obscure the underlying output. “Extracting Training Data from Large Language Models” https://arxiv.org/ab…

Inserting lossy steps seems to work pretty well though.

https://twitter.com/giannis_daras/status/1663710057400524800...

Re: Japan’s government will not enforce copyrights on data used in AI training

#267
post #145
post #113

> With the effective implementation of AI, it could potentially boost the nation’s GDP by 50% or more in a short time. Err.. No, it won't. That's a ridiculous, laughable statement. Japan 2022 GDP: $4.1 Trillion Amazon 2022 Revenue: $513B Google 2022 Revenue: $279B Microsoft 2022 Revenue: $198B So even growing a brand new Amazon, Google and Microsoft in "a short period" would be insufficient to grow GDP by 50%

yeah. There are countries growing at 7% annually, but they're mostly in Africa. Niger, Rwanda, Congo, etc. But please for the love of God, don't compare GDP to revenue.

GPD is made up of the sum of revenue in a country though. It's not unreasonable to point out the scale in comparison to existing companies.

Re: Japan’s government will not enforce copyrights on data used in AI training

#268
post #89

Earlier quoted context omitted.

I strongly agree with this. There's a distinction between "learning from" and "copying". "Learning from" is a transformative process that distills from the observation. This distillation can be as simple as indexing for a search engine, or as complex as a deep neural network. Simply because a neural network can create something that is a copyright violation doesn't mean the training process itself it. A human can see…

I don't think the comparison with human learning holds. NNs and humans don't learn the same way - humans can fairly quickly generalise what they have learned and, most importantly, go beyond what they've learned. I haven't see that happen with neural networks or GPTs; at best, you're getting the average of what it has 'learned'. There's human learning and there's neural network 'learning' and they're a different thin…

NN's absolute can go beyond what they have learned and aren't just producing the "average".

Some good examples outside the typical LLM/images work:

* Deep Mind's work on AlphaFold, which generates predictions on proteins that haven't been seen before

* AlphaGo which plays games better than any human (so clearly can't be "the average")

If we look at LLMs, something like writing code in the style of Shakespear isn't really something that's been seen before.

Re: Japan’s government will not enforce copyrights on data used in AI training

#269
I could not be more thirsty for some nations to declare certain forms of copyright/ip to be invalid.

IP is by far one of the most virulent, fastest spreading, most persistent & aggressive legalisms. The texts get copy pasted across borders with unbelievable speed.

What doesn't happen is nations making reasonable decisions about what ip doesn't cover. Every nation is coerced quickly into following ip maximist guidelines. The world lacks the ability to see what would happen if we didn't allow endless patents on whatever the frak common sense nonsense, and then another half century beyond that of extenuating patents. The system is broken, and what can be controlled seems to only grow and grow and grow. There's no wins for the public. Ever. This is perhaps the only stake in the ground of the last 50 years, and what a fairly minor point. So sad to see society sold out to such depraved corporate interests, forver & ever. Society needs real representation too.

Re: Japan’s government will not enforce copyrights on data used in AI training

#270
post #230
post #80

Earlier quoted context omitted.

Conflating training a model with human learning is wrong. When training a model you are deriving a function that takes some input and produces an output. The issue with copyright and licensing here is that a copy is made and reproduced numerous times when training. The model is not walking around a museum where it is an authorized viewing. It is not a being learning a skill. It is a function. The further issue is tha…

> When training a model you are deriving a function that takes some input and produces an output. The issue with copyright and licensing here is that a copy is made and reproduced numerous times when training. How's that any different from what happens inside a human's brain when learning? > The model is not walking around a museum where it is an authorized viewing. The training data could well be from an online muse…

>> When training a model you are deriving a function that takes some input and produces an output. The issue with copyright and licensing here is that a copy is made and reproduced numerous times when training.

>How's that any different from what happens inside a human's brain when learning?

I don't know, nor does anyone else. So let me ask you - how is that the same as what happens inside a human's brain when learning?

Post reply on HN