Viewing profile — hynky

HF recently released a blog about their pre-training dataset from PDFs. Alongside that they also shared a graph how much PDFs they were able to fetch by date, and the old internet …

HuggingFace recently released a report on their FinePDFs dataset, with this saddening report on state of current availability of old internet.

yes, both core web datasets are publicly available as well as the rest