Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke)
1–2 of 2 posts
Re: Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke)
#2Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".