Earlier quoted context omitted.
> they are by definition the average of the internet. Are you referring to base models? Nowadays they also train on stolen books and are further "aligned" based on feedback. I imagine they are already learning to teach based on feedback from users.
To be honest, I was using internet as shorthand for average of human knowledge, on the basis that most books, peer reviewed articles, and everything else is already on the internet, even if they exist only in the more unsavory corners (I've seen nothing to suggest the FM producers were / are much bothered about where the data is from). But yes referring to base models. I'm also not convinced that the average book is…
the nice thing about books, especially STEM ones, is that you can tell if there's a problem because there will be inconsistencies. so even without the errata, you can fuzz until it all matches.