Pytorch implementation of lookahead optimizer(https://arxiv.org/pdf/1907.08610.pdf) and RAdam(https://arxiv.org/pdf/1908.03265.pdf)
python deep-learning neural-network optimizer pytorch lookahead adamw radam lookahead-optim lookahead-pytorch
-
Updated
Jun 25, 2022 - Jupyter Notebook