Live data from Hacker News

A Change to Common Crawl Dataset Size Reporting

commoncrawl.org

1–2 of 2 posts

Re: A Change to Common Crawl Dataset Size Reporting

#2
Common Crawl is switching to reporting dataset sizes in nibbles. As an organisation dedicated to data preservation, we feel it would be remiss to allow this underrepresented unit to fall out of use. Our latest crawl now exceeds 689 tebibbles. Common Crawl Foundation