A key insight in learning theory is that the complexity of a hypothesis class is crucial for generalization.