Adam and AdamW: adaptive optimisation and weight decay
idlemachines.co.uk