Books in .txt format for AI training purposes
1–10 of 97 posts
Re: Books in .txt format for AI training purposes
#2Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned.
Re: Books in .txt format for AI training purposes
#3Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned.
> Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned.
Are you objecting to the use of data for training, or to the compilation of training datasets?
Re: Books in .txt format for AI training purposes
#4is bibliotik db bigger than libgen? any tips how to get invited?
Re: Books in .txt format for AI training purposes
#5Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned.
> Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned. Are you objecting to the use of data for training, or to the compilation of training datasets?
> Are you objecting to the use of data for training, or to the compilation of training datasets?
The GP is objecting to the casualness with which privacy rights and intellectual property rights are ignored by so many in the AI community, not to a choice of whether they object to one or another specific manifestation of how the community is doing so.
[edit added]: Those who would argue "no, there is no casual ignoring of rights", consider for example the official DMCA takedown instructions for the collection [0].
Re: Books in .txt format for AI training purposes
#6Earlier quoted context omitted.
> Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned. Are you objecting to the use of data for training, or to the compilation of training datasets?
> Are you objecting to the use of data for training, or to the compilation of training datasets? The GP is objecting to the casualness with which privacy rights and intellectual property rights are ignored by so many in the AI community, not to a choice of whether they object to one or another specific manifestation of how the community is doing so. [edit added]: Those who would argue "no, there is no casual ignoring…
The question is..if a AI reads a book is it against copyright?
Or is the trained model a derived work of those books?
Re: Books in .txt format for AI training purposes
#7This is very cool and useful, thanks.
However, saying: "Suppose you wanted to train a world-class GPT model, just like OpenAI. How? You have no data. Now you do. Now everyone does"
Is quite a stretch. You need much, much more that 36GB of quality data to train a world-class GPT model.
Re: Books in .txt format for AI training purposes
#8Earlier quoted context omitted.
> Are you objecting to the use of data for training, or to the compilation of training datasets? The GP is objecting to the casualness with which privacy rights and intellectual property rights are ignored by so many in the AI community, not to a choice of whether they object to one or another specific manifestation of how the community is doing so. [edit added]: Those who would argue "no, there is no casual ignoring…
The question is..if a AI reads a book is it against copyright? Or is the trained model a derived work of those books?
Of course it is a derived work.
Re: Books in .txt format for AI training purposes
#9Re: Books in .txt format for AI training purposes
#10Earlier quoted context omitted.
> Always impressive how the AI community, both inside large companies and not, seems to assume data just exists for them to use, copyright or personal rights be damned. Are you objecting to the use of data for training, or to the compilation of training datasets?
> Are you objecting to the use of data for training, or to the compilation of training datasets? The GP is objecting to the casualness with which privacy rights and intellectual property rights are ignored by so many in the AI community, not to a choice of whether they object to one or another specific manifestation of how the community is doing so. [edit added]: Those who would argue "no, there is no casual ignoring…
The official DMCA takedown instructions are actually at http://the-eye.eu/dmca/ and look much less unusual.