O'Reilly logo
  • Ollie Jones thinks this is interesting:

But when outliers are exponentially rare (like in a bell-shaped curve), the RMSE performs very well and is generally preferred.

From

Cover of Hands-On Machine Learning with Scikit-Learn and TensorFlow

Note

True when the tails aren't long. Not when you think they aren't long.