The spirit of moderation should also be the spirit of the lawgiver.
The success of a learning algorithm depends on its ability to balance between fitting the data and avoiding overfitting.