Hi Sathya,

I previously tested leaky relu (FastAI has a ‘general relu’ which can mimic leaky ReLU). Mish performs better in my testing.

Also, I can’t add images here so I’ll update the article with a chart showing how leaky relu did vs Mish (Mish won)…but the chart shows a whole mess of comparisons so it’s good to add to the article.

Hope that helps!