A Billion Words: Today's language modeling standard should be higher
googleresearch.blogspot.com
A Billion Words: Today's language modeling standard should be higher
1–3 of 3 posts
Re: A Billion Words: Today's language modeling standard should be higher
#2The GZ file is only 1.7GB, I imagine a densely-packed model would almost fit on a machine with 8GB of RAM, which is surprising.
Re: A Billion Words: Today's language modeling standard should be higher
#3The GZ file is only 1.7GB, I imagine a densely-packed model would almost fit on a machine with 8GB of RAM, which is surprising. http://www.statmt.org/lm-benchmark/
Along similar lines, all of the English Wikipedia is http://en.wikipedia.org/wiki/Wikipedia:Database_download#Eng.... That omits all the history (just the current pages), but still surprising to me how small it seems now.