Pretraining Under Infinite Compute
arxiv.org
Pretraining Under Infinite Compute
1–2 of 2 posts
Re: Pretraining Under Infinite Compute
#2"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."