Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
1–10 of 184 posts
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#2Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#3Language Models are Injective and Hence Invertible https://arxiv.org/abs/2510.15511
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#4Ok we can drop the farce now that it isn’t compression at the core, the anthropomorphic bullshit has done the job it was supposed to - Allow us to centralize the knowledge economy at the cost of IP holders and we get to claim the efficiency gains from centralization as the result of technology and force governments to choose “teh future” (and investments ) over maintaining copyright - a massive value reallocation in society
Maybe we can disband the effective altruism cult that helped push it now.
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#5Full book content and model generations are not included because the books are copyrighted and the generations contain large portions of verbatim text.
There are plenty of old books in the public domain already... but I'm not sure what exactly this exercise is supposed to show, since the Kolmogorov limit still stands in the way of "infinite compression".
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#6Ok we can drop the farce now that it isn’t compression at the core, the anthropomorphic bullshit has done the job it was supposed to - Allow us to centralize the knowledge economy at the cost of IP holders and we get to claim the efficiency gains from centralization as the result of technology and force governments to choose “teh future” (and investments ) over maintaining copyright - a massive value reallocation in…
Intelligence is compression.
And frankly, if this means the end of copyright: good riddance.
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#7[deleted]
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#8Ok we can drop the farce now that it isn’t compression at the core, the anthropomorphic bullshit has done the job it was supposed to - Allow us to centralize the knowledge economy at the cost of IP holders and we get to claim the efficiency gains from centralization as the result of technology and force governments to choose “teh future” (and investments ) over maintaining copyright - a massive value reallocation in…
Intelligence is compression. And frankly, if this means the end of copyright: good riddance.
Copyright is what facilitates copyleft. Getting rid of IP protections also rids us of GPL, which gave us a few things including the most popular OS in the world.
It’s one thing to reject the specifics of IP laws as currently implementated; it’s another thing to celebrate the dismantling of the entire foundation of open source by for-profit corporate interests who sought to do it for decades.
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#9[deleted]
Re: Alignment whack-a-mole: Finetuning activates recall of copyrighted books in LLMs
#10Ok we can drop the farce now that it isn’t compression at the core, the anthropomorphic bullshit has done the job it was supposed to - Allow us to centralize the knowledge economy at the cost of IP holders and we get to claim the efficiency gains from centralization as the result of technology and force governments to choose “teh future” (and investments ) over maintaining copyright - a massive value reallocation in…
Intelligence is compression. And frankly, if this means the end of copyright: good riddance.
Copyright is what enables free and open licenses such as Creative Commons and every version/variant of the GPL. Without copyright, what would become of these licenses, and movements that have espoused them?