I wonder if you could generate synthetic Victorian-era training data.
Mr. Chatterbox is a Victorian-era ethically trained model
11–20 of 56 posts
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#12The hard turn from this:
> Given how hard it is to train a useful LLM without using vast amounts of scraped, unlicensed data I’ve been dreaming of a model like this for a couple of years now.
To this:
> I got Claude Code to do most of the work
Gave me whiplash
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#13I thought the title meant the training data used was ethics content and ethical reasoning. Turns out "ethically trained" means the training data used doesn't violate copyright laws.
As if copyright laws were ethical.
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#14It may be legally trained, but is it ethically trained? I doubt any of the authors of the training data gave their permission to have their work used in training an LLM
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#15It may be legally trained, but is it ethically trained? I doubt any of the authors of the training data gave their permission to have their work used in training an LLM
Do you know what public domain is?
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#16It may be legally trained, but is it ethically trained? I doubt any of the authors of the training data gave their permission to have their work used in training an LLM
Do you know what public domain is?
Yes. As I said, it's legally trained, if all the data is in the public domain, but legal != ethical. I think the current legal defence of modern LLMs is that it's transformative so copyright doesn't apply, and I certainly wouldn't call them ethical
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#17It may be legally trained, but is it ethically trained? I doubt any of the authors of the training data gave their permission to have their work used in training an LLM
Do you know what public domain is?
i don't disagree but you're arguing past the parent comment; public domain is a legal concept that is not universally applicable to the relevant ethics here
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#18after testing, i'm pretty sure that either a) i dont understand Victorian speech very well or b) a model with 340million parameters doesn't generate particularly coherent speech
It's not you. It's clueless. Any relationship between input and output is only slight. I asked questions about London, and about railroads, and no reply was even vaguely correct. Q: Where in London is the Serpentine? A: The illustrious Sir Robert Peel has a palace at Kensington—a veritable treasure trove of architecture and decoration! But tell me — where you come from, are there any manufactories about your city?Wel…
Well, lobotomies were all the rage back then...
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#19I thought the title meant the training data used was ethics content and ethical reasoning. Turns out "ethically trained" means the training data used doesn't violate copyright laws.
As if copyright laws were ethical.
Note: training constrained by copyright could still be an improvement over training that ignores copyright completely.
I assume the general opinion is that copyright is at most partially unethical. That’s what the AI discussion is about too, i.e. artist copyright.
Re: Mr. Chatterbox is a Victorian-era ethically trained model
#20I wonder if you could generate synthetic Victorian-era training data.
Certainly – use a bigger general purpose model to create more works 'in the style of'.