Hi Alex — SLS looks extremely promising. I’m working with Issam on Monday to hopefully get it up and running with support for parameter groups inside of FastAI. Once param groups are supported, then we can run SLS on larger datasets and I’ll be happy to write a detailed article on it. (I actually think diffGrads clamping and SLS may potentially work well together but we’ll see).