Hi — I’m very happy to hear that! Thanks for sharing your results.

You may also want to try Ranger optimizer, which is RAdam + LookAhead and see if that provides further benefits. We used it to set 12 new high scores on the FastAI leaderboard.

Article about Ranger here:

New Deep Learning Optimizer, Ranger: Synergistic combination of RAdam + LookAhead for the best of…

and github:

lessw2020/Ranger-Deep-Learning-Optimizer

Thanks again for posting your results!